Description

1. LMFlow now defaults to using Accelerate (i.e, run scripts using accelerate launch ... finetune.py ...). If you prefer to use deepspeed (deepspeed ... finetune.py ...) or accelerate + deepspeed backend, please install using pip install -e '.[deepspeed]'
2. Removed/archived some less frequently used docs/scripts/modules.
   • docker
   • scripts/data_preprocess, scripts/speculative_decoding, scripts/tools, scripts/vocab_extension
   • service
   • utils

What's Changed

• [Feature] vllm inferencer and memory safe vllm inferencer by @wheresmyhair in #860
• [Feature] Add vllm inference example by @wheresmyhair in #863
• Add customized optimizer support by @research4pan in #865
• Expanding Optimization Options by @tianshijing in #871
• [Feature] reward model inferencer and dpov2 aligner by @wheresmyhair in #867
• Added more custom optimizers by @tianshijing in #876
• [ADD] T2I finetuning with SD1 and SD2 to contrib by @Aziily in #877
• update naacl best paper award by @shizhediao in #881
• [usability] make dpo eval dataset optional by @wheresmyhair in #889
• function-call-finetune by @HALIS-sh in #884
• Modify the formatter of function and observation by @HALIS-sh in #892
• [Feature] Iterative DPO by @wheresmyhair in #883
• [usability] remove numpy version requirement by @wheresmyhair in #901
• Fix load from LoRA weight & empty tools and system by @HALIS-sh in #902
• [fix] merge lora fix by @wheresmyhair in #909
• [usability] temporarily change default version to 0.0.8 by @wheresmyhair in #911
• [doc] Add wandb setup guide by @wheresmyhair in #912
• [temp] temporarily restrict transformers version by @wheresmyhair in #914
• [usability] deps streamlining by @wheresmyhair in #905
• [doc] update default branch by @wheresmyhair in #915
• Add Hymba and DoRA support by @Dominic789654 in #919
• announce support of hymba by @shizhediao in #921
• Hymba support announcement by @shizhediao in #922
• [usability] Add hymba lora target by @wheresmyhair in #924
• [usability] Change dataset check method by @wheresmyhair in #930
• [usability] support qwen2.5 and deepseek by @wheresmyhair in #931
• [fix] fix jinja template issue caused by empty system prompt by @wheresmyhair in #935
• [fix] fix get dataset type function by @wheresmyhair in #937
• [doc] readme update by @wheresmyhair in #938
• Added Muon Optimizer by @tianshijing in #939

New Contributors

• @tianshijing made their first contribution in #871
• @Aziily made their first contribution in #877

Full Changelog: v0.0.8...v1.0.0