Thanks to visit codestin.com
Credit goes to github.com

Skip to content

SVD update with conv support + LoRA add, weight update following recent updates #140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
cloneofsimo merged 14 commits into from
Jan 29, 2023
Merged

SVD update with conv support + LoRA add, weight update following recent updates #140

cloneofsimo merged 14 commits into from
Jan 29, 2023

Conversation

@cloneofsimo
Copy link
Owner

@cloneofsimo cloneofsimo commented Jan 17, 2023 •
edited
Loading

This will update other features to incorporate resnet blocks in them as well.

@cloneofsimo cloneofsimo changed the base branch from master to develop January 17, 2023 08:07
@cloneofsimo
Copy link
Owner Author

cloneofsimo commented Jan 17, 2023

Examples with Modern disney diffusion and Analog diffusion

lion
peach2

@cloneofsimo
Copy link
Owner Author

cloneofsimo commented Jan 17, 2023

Lora adding is now updated! This implementation is likely to be futureproof.

image

This was referenced Jan 17, 2023
Open
Closed
@cloneofsimo
Copy link
Owner Author

cloneofsimo commented Jan 17, 2023

Comment : Example use case
lora_add runwayml/stable-diffusion-v1-5 ./example_loras/lora_krk.safetensors ./output_merged 0.8 --mode upl
lora_add ./example_loras/analog_svd_rank4.safetensors ./example_loras/lora_krk.safetensors ./krk_analog.safetensors 2.0 0.7

@cloneofsimo cloneofsimo mentioned this pull request Jan 28, 2023
Closed
@cloneofsimo
Copy link
Owner Author

cloneofsimo commented Jan 29, 2023

image

Sorry for taking ridiculous long for this update. Wild bug! Anyways, merging now works and this implementation is much canonical as well.

@cloneofsimo
Copy link
Owner Author

cloneofsimo commented Jan 29, 2023

CKPT done as well. As for PTI, textual inversion for A1111 is supported as well.

lora_add runwayml/stable-diffusion-v1-5 ./example_loras/lora_krk.safetensors ./output_merged.ckpt --alpha_1 0.7 --mode upl-ckpt-v2

image

@cloneofsimo cloneofsimo marked this pull request as ready for review January 29, 2023 05:15
@cloneofsimo cloneofsimo merged commit 20b46e3 into develop Jan 29, 2023
@cloneofsimo cloneofsimo mentioned this pull request Jan 29, 2023
Open
@oscarnevarezleal oscarnevarezleal mentioned this pull request Feb 1, 2023
Closed
@cloneofsimo cloneofsimo deleted the fix/util-updates branch February 2, 2023 15:34
@satwiksunnam19
Copy link

satwiksunnam19 commented Feb 28, 2023

RuntimeError: stack expects a non-empty TensorList
this is the error while converting the .safetensors to .ckpt format @cloneofsimo can you explain why this is happening ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@cloneofsimo @satwiksunnam19