Thanks to visit codestin.com
Credit goes to github.com

Skip to content

[dynamo] warn instead of error on fullgraph=True fallback to eager#181940

Merged
atalman merged 1 commit into
release/2.12from
wwen/fullgraph-error-fix
Apr 30, 2026
Merged

[dynamo] warn instead of error on fullgraph=True fallback to eager#181940
atalman merged 1 commit into
release/2.12from
wwen/fullgraph-error-fix

Conversation

@williamwen42
Copy link
Copy Markdown
Member

@williamwen42 williamwen42 commented Apr 29, 2026

Original issue: #181817

We introduced a new behavior for fullgraph=True in #177809 where an error is thrown when no compiled code is run. However, an internal issue revealed that this new behavior is incompatible with the "eager_on_recompile" stance.

Our solution is that for 2.12, we will issue a warning instead of erroring out if no compiled code is ran under fullgraph=True. We will keep the erroring behavior on trunk as we seek to improve the behavior - i.e. steps 2 and 3 in the original issue.

Future plans: we will error on 2.13 after addressing the other points (2 and 3) in the issue.

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @kadeng @chauhang @amjames @Lucaskabela @jataylo @azahed98 @mlazos

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented Apr 29, 2026

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/181940

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ You can merge normally! (1 Unrelated Failure)

As of commit b1fdd17 with merge base 58e3fb0 (image):

FLAKY - The following job failed but was likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot Bot added ciflow/inductor ciflow/torchtitan Run TorchTitan integration tests module: dynamo labels Apr 29, 2026
@williamwen42 williamwen42 added this to the 2.12.0 milestone Apr 29, 2026
Copy link
Copy Markdown
Contributor

@Lucaskabela Lucaskabela left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For more context, this change surfaced an error in vLLM - we have patched it, but it is very likely it surfaces errors in other frameworks too so I think that underscores the criticality of including in this release

@Lucaskabela
Copy link
Copy Markdown
Contributor

#181247 for reference

Copy link
Copy Markdown
Contributor

@malfet malfet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is probably looks fine, but we should reject if similar cherry-pick is proposed for 2.13 release

@atalman atalman merged commit dea39b1 into release/2.12 Apr 30, 2026
197 of 198 checks passed
@atalman
Copy link
Copy Markdown
Collaborator

atalman commented May 11, 2026

The run is successful with 2.12.0 rc:

dev@gpu-dev-0b9fbe27:~/pytorch$ python test/dynamo/test_compile.py FullgraphTests.test_fullgraph_warns_on_frame_skip_with_dispatch_mode FullgraphTests.test_fullgraph_warns_on_frame_skip_dynamo_disabled -v
W0511 20:37:24.116000 3373 torch/_native/cutedsl_utils.py:55] CuTeDSL operators require optional Python packages `nvidia-cutlass-dsl` and `apache-tvm-ffi`; missing optional dependency `nvidia_cutlass_dsl` (importlib.util.find_spec(nvidia_cutlass_dsl) failed)
test_fullgraph_warns_on_frame_skip_with_dispatch_mode (__main__.FullgraphTests.test_fullgraph_warns_on_frame_skip_with_dispatch_mode) ... /home/dev/.local/lib/python3.12/site-packages/torch/jit/_script.py:365: DeprecationWarning: `torch.jit.script_method` is deprecated. Please switch to `torch.compile` or `torch.export`.
  warnings.warn(
ok
test_fullgraph_warns_on_frame_skip_dynamo_disabled (__main__.FullgraphTests.test_fullgraph_warns_on_frame_skip_dynamo_disabled) ... ok

----------------------------------------------------------------------
Ran 2 tests in 0.661s

OK

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants