Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Fix IndexError with DeepSpeed ZeRO-3 when kernels rotary is active #45414

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ArthurZucker merged 2 commits into from
Apr 13, 2026
+12 −3
Merged

Fix IndexError with DeepSpeed ZeRO-3 when kernels rotary is active #45414

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
79d9c68
Fix `IndexError: pop from an empty deque` under DeepSpeed ZeRO-3
ArthurZucker Apr 13, 2026
bc4d35d
Add dates to new model cards to satisfy check-repository-consistency
ArthurZucker Apr 13, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/source/en/model_doc/pp_chart2table.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License.
rendered properly in your Markdown viewer.

-->
*This model was released on 2025-05-20 and added to Hugging Face Transformers on 2026-03-18.*
*This model was released on 2025-05-20 and added to Hugging Face Transformers on 2026-03-20.*

# PP-Chart2Table

Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/model_doc/slanext.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License.
rendered properly in your Markdown viewer.

-->
*This model was released on 2025-03-07 and added to Hugging Face Transformers on 2026-03-19.*
*This model was released on 2025-03-07 and added to Hugging Face Transformers on 2026-03-21.*

# SLANeXt

Expand Down
2 changes: 1 addition & 1 deletion docs/source/en/model_doc/uvdoc.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ specific language governing permissions and limitations under the License.
rendered properly in your Markdown viewer.

-->
*This model was released on 2023-02-06 and added to Hugging Face Transformers on 2026-03-19.*
*This model was released on 2023-02-06 and added to Hugging Face Transformers on 2026-03-21.*

# UVDoc

Expand Down
9 changes: 9 additions & 0 deletions src/transformers/integrations/hub_kernels.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -452,6 +452,15 @@ def decorator(cls):

def new_init(self, *args, **kwargs):
orig_init(self, *args, **kwargs)
# Skip attaching the kernelized submodule under DeepSpeed ZeRO-3: the coordinator traces
# the module graph at init time, and a child `nn.Module` that is not actually invoked
# during forward (e.g. when the model keeps calling the plain Python `apply_rotary_pos_emb`)
# breaks the parameter fetch trace and raises `IndexError: pop from an empty deque`.
# See https://github.com/huggingface/transformers/issues/45137
from .deepspeed import is_deepspeed_zero3_enabled

if is_deepspeed_zero3_enabled():
return
for fn in module_names:
# we hardcode the name of the function to "rotary_fn" for now
setattr(self, "rotary_fn", fn)
Expand Down
Loading