8000 [dynamo, nested graph breaks] small fixes to resume function generation by williamwen42 · Pull Request #151056 · pytorch/pytorch · GitHub
[go: up one dir, main page]

Skip to content

[dynamo, nested graph breaks] small fixes to resume function generation #151056

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 11 commits into from

Conversation

williamwen42
Copy link
Member
@williamwen42 williamwen42 commented Apr 10, 2025

Stack from ghstack (oldest at bottom):

Old: pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang @amjames

Copy link
pytorch-bot bot commented Apr 10, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/151056

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 08a06f1 with merge base 1c7a70b (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

williamwen42 added a commit that referenced this pull request Apr 10, 2025
@williamwen42 williamwen42 changed the title [dynamo] pack resume function stack + locals into a list [dynamo, nested graph breaks] pack resume function stack + locals into a list Apr 10, 2025
@williamwen42 williamwen42 added the topic: not user facing topic category label Apr 10, 2025
@williamwen42 williamwen42 marked this pull request as draft April 10, 2025 22:39
… locals into a list"


We need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
williamwen42 added a commit that referenced this pull request Apr 15, 2025
… locals into a list"


We need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
@williamwen42 williamwen42 added the keep-going Don't stop on first failure, keep running tests until the end label May 14, 2025
… locals into a list"


We need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
… locals into a list"


We need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
@williamwen42 williamwen42 changed the title [dynamo, nested graph breaks] pack resume function stack + locals into a list [dynamo, nested graph breaks] small fixes to resume function generation May 15, 2025
…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
@williamwen42 williamwen42 marked this pull request as ready for review May 28, 2025 01:13
@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a revert job. Check the current status here.
Questions? Feedback? Please reach out to the PyTorch DevX Team

@pytorchmergebot
Copy link
Collaborator

Reverting PR 151056 failed

Reason: list index out of range

Details for Dev Infra team Raised by workflow job

…on generation"


Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 kadeng chauhang amjames

[ghstack-poisoned]
@pytorchmergebot
Copy link
Collaborator

Starting merge as part of PR stack under #153773

pytorchmergebot pushed a commit that referenced this pull request May 28, 2025
…en'ing (#153510)

Stop codegening NULLs that we need to pop later. Some output_graph.py changes to prepare for nested graph break support.

Pull Request resolved: #153510
Approved by: https://github.com/jansel
ghstack dependencies: #151056
pytorchmergebot pushed a commit that referenced this pull request May 28, 2025
pytorchmergebot pushed a commit that referenced this pull request May 28, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
…on (pytorch#151056)

Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

Pull Request resolved: pytorch#151056
Approved by: https://github.com/jansel
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
…en'ing (pytorch#153510)

Stop codegening NULLs that we need to pop later. Some output_graph.py changes to prepare for nested graph break support.

Pull Request resolved: pytorch#153510
Approved by: https://github.com/jansel
ghstack dependencies: pytorch#151056
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
…on (pytorch#151056)

Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

Pull Request resolved: pytorch#151056
Approved by: https://github.com/jansel
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
…en'ing (pytorch#153510)

Stop codegening NULLs that we need to pop later. Some output_graph.py changes to prepare for nested graph break support.

Pull Request resolved: pytorch#153510
Approved by: https://github.com/jansel
ghstack dependencies: pytorch#151056
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
nWEIdia pushed a commit to nWEIdia/pytorch that referenced this pull request Jun 2, 2025
qingyi-yan pushed a commit to qingyi-yan/pytorch that referenced this pull request Jun 3, 2025
…on (pytorch#151056)

Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

Pull Request resolved: pytorch#151056
Approved by: https://github.com/jansel
qingyi-yan pushed a commit to qingyi-yan/pytorch that referenced this pull request Jun 3, 2025
…en'ing (pytorch#153510)

Stop codegening NULLs that we need to pop later. Some output_graph.py changes to prepare for nested graph break support.

Pull Request resolved: pytorch#153510
Approved by: https://github.com/jansel
ghstack dependencies: pytorch#151056
qingyi-yan pushed a commit to qingyi-yan/pytorch that referenced this pull request Jun 3, 2025
qingyi-yan pushed a commit to qingyi-yan/pytorch that referenced this pull request Jun 3, 2025
iupaikov-amd pushed a commit to ROCm/pytorch that referenced this pull request Jun 4, 2025
…on (pytorch#151056)

Old: ~pack resume function stack + locals into a list: we need to be able to pass frame stack+locals in lists to hand off to nested functions in the future, so we implement this part first.~

We are no longer doing this right now since GraphModule/guard variable naming gets messed up. Going forward, our approach will be to keep the top frame unpacked, but pack the rest of the contents of other frames in a list.

Pull Request resolved: pytorch#151056
Approved by: https://github.com/jansel
iupaikov-amd pushed a commit to ROCm/pytorch that referenced this pull request Jun 4, 2025
…en'ing (pytorch#153510)

Stop codegening NULLs that we need to pop later. Some output_graph.py changes to prepare for nested graph break support.

Pull Request resolved: pytorch#153510
Approved by: https://github.com/jansel
ghstack dependencies: pytorch#151056
iupaikov-amd pushed a commit to ROCm/pytorch that referenced this pull request Jun 4, 2025
iupaikov-amd pushed a commit to ROCm/pytorch that referenced this pull request Jun 4, 2025
@github-actions github-actions bot deleted the gh/williamwen42/232/head branch June 29, 2025 02:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-no-td Do not run TD on this PR ciflow/inductor keep-going Don't stop on first failure, keep running tests until the end Merged module: dynamo Reverted topic: not user facing topic category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants
0