Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[megatron] support megatron seq_cls task_type #5759

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 14 commits into
base: main
Choose a base branch
from
Open

[megatron] support megatron seq_cls task_type #5759

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
eb19cf6
support megatron seq_cls
Jintao-Huang Sep 10, 2025
deda1a4
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 10, 2025
6ad6ba2
update
Jintao-Huang Sep 10, 2025
24fd5db
update
Jintao-Huang Sep 10, 2025
0d9cb82
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 14, 2025
1d8e092
update
Jintao-Huang Sep 14, 2025
82cd5f6
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 16, 2025
84dcb08
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 16, 2025
17ee8b5
update
Jintao-Huang Sep 16, 2025
653ab00
update
Jintao-Huang Sep 16, 2025
9e16106
update
Jintao-Huang Sep 16, 2025
efc22f7
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 19, 2025
7cc54bd
Merge branch 'main' into megatron_support_seq_cls
Jintao-Huang Sep 19, 2025
d44635a
update
Jintao-Huang Sep 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
update
  • Loading branch information
@Jintao-Huang
Jintao-Huang committed Sep 16, 2025
commit 9e16106d87b4aea287fda777aa74d4f753170091
1 change: 0 additions & 1 deletion examples/train/packing/qwen2_5_vl.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,6 @@
# For local datasets, it is recommended to use streaming: `--streaming true` (save memory)
# You can also use padding_free to avoid the space/time cost caused by multi-modal packing:
# https://github.com/modelscope/ms-swift/blob/main/examples/train/padding_free/sft.sh
pip install "transformers==4.51.*"

NPROC_PER_NODE=4 \
MAX_PIXELS=1003520 \
Expand Down
1 change: 0 additions & 1 deletion examples/train/packing/streaming.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
# 4 * 36GB
# A demo using the Hugging Face dataset
# The first model weights will be saved around step 70.
pip install "transformers==4.51.*"

NPROC_PER_NODE=4 \
MAX_PIXELS=1003520 \
Expand Down