Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[WIP] try to relax the tie_weights method#39555

Draft
molbap wants to merge 1 commit into
mainfrom
tied_weights_bother
Draft

[WIP] try to relax the tie_weights method#39555
molbap wants to merge 1 commit into
mainfrom
tied_weights_bother

Conversation

@molbap

@molbap molbap commented Jul 21, 2025

Copy link
Copy Markdown
Collaborator

What does this PR do?

as per title, trials to rework parts of inits and what is done at weight tying. Might be superseded by #39339

@vasqu

vasqu commented Jul 21, 2025

Copy link
Copy Markdown
Collaborator

Fyi had to change something there in #39228 for TP support on tied weights, so might be good to keep an eye there as well

@molbap

molbap commented Jul 21, 2025

Copy link
Copy Markdown
Collaborator Author

Gotcha @vasqu , took a look, seems compatible IMO! This PR is mostly to run more easily the test suite around weights tying 😆

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants