Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Flux2 Dev+Klein support#1261

Merged
dxqb merged 60 commits into
Nerogar:mergefrom
dxqb:flux2_klein
Feb 3, 2026
Merged

Flux2 Dev+Klein support#1261
dxqb merged 60 commits into
Nerogar:mergefrom
dxqb:flux2_klein

Conversation

@dxqb

@dxqb dxqb commented Jan 16, 2026

Copy link
Copy Markdown
Collaborator
git fetch origin pull/1261/head:pr-1261
git switch pr-1261

update.sh or update.bat

see e50970f for code changes only for Klein

@HexaDucket

This comment was marked as resolved.

@Paul315d

Copy link
Copy Markdown

I received the same screen yesterday after attempting to train Flux Klein. The model will not load even though it is available as a drop down selection. Please Fix.

@Calamdor

Copy link
Copy Markdown
Contributor

It is a soft locked model, you need your hf key and to ask for access

@dxqb

dxqb commented Jan 29, 2026

Copy link
Copy Markdown
Collaborator Author

GGUF loading is broken for Flux2 because something in diffusers: huggingface/diffusers#13001
loading safetensors is NOT broken @Frostedbyte404 . You are trying to load a pre-quantized safetensors, which isn't supported for any model. OneTrainer quantizes during loading. If you want to use fp8, set fp8 but don't "Override" the transformer.

@Paul315d

Paul315d commented Jan 29, 2026

Copy link
Copy Markdown

It would not load the Klein 9b non quantized base model downloaded straight from black forest labs. A hugging face token was included. I tried every setting possible This was while using Massed Compute and their Ubuntu 22.04 os. Maybe it works on windows?

Update: I think I found my problem.

When selecting Flux 1 from the drop down menu, the Base Model field is populated with the exact location of the model. When selecting Flux 2 from the drop down menu, no base model link is selected.

I copied the syntax for the Flux 1 and found the corresponding syntax on the hugging face webpage. Inserting this into the base model path and the model began working correctly. I have not trained with it yet, but this seems to fix my issue.

You may want to insert the correct base model path for the Flux 2 Klein drop down like the Flux 1 so others don't have this minor mistake.

@dxqb

dxqb commented Jan 29, 2026

Copy link
Copy Markdown
Collaborator Author

GGUF loading works now, using the workaround suggested in huggingface/diffusers#13001

@Paul315d

Paul315d commented Feb 1, 2026

Copy link
Copy Markdown

Thank you for making the changes.

Don't know if it's a one trainer thing or a Klein thing, but the model does not train properly on .jpg data. Only Png. This is probably a good thing, but if you can't figure out why your loss rate is stuck very high, try training in .Png and watch a proper slope curve form.

@dxqb

dxqb commented Feb 3, 2026

Copy link
Copy Markdown
Collaborator Author

there was a bug that corrupted norm layers during saving a full finetune in safetensors format. This is fixed now

@dxqb dxqb merged commit eadbe9c into Nerogar:merge Feb 3, 2026
1 check passed
@trollver9000

Copy link
Copy Markdown

anyone has working json file for flux klein 9b for rtx 3090 and 32 gb ram?

Repository owner locked as resolved and limited conversation to collaborators Feb 17, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feat]: Flux Klein Finetuning + LoRA Training

10 participants