Hi!

Are the current save and load hooks saving the added LoRA adapters weights? After using the code to train LoRA weights, I have problems when loading the model with the provided hooks? Should they be updated to save these explicitly?

Thank you!