8000 supporting dynamo compilation of end-to-end send/recv in distributed · Issue #153642 · pytorch/pytorch · GitHub
[go: up one dir, main page]
Skip to content

supporting dynamo compilation of end-to-end send/recv in distributed #153642

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
qingyi-yan opened this issue May 15, 2025 · 1 comment
Open

supporting dynamo compilation of end-to-end send/recv in distributed #153642

qingyi-yan opened this issue May 15, 2025 · 1 comment
Labels
module: dynamo oncall: distributed Add this issue/PR to distributed oncall triage queue oncall: pt2 triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@qingyi-yan
Copy link
qingyi-yan commented May 15, 2025 •
edited by pytorch-bot bot
Loading

🚀 The feature, motivation and pitch

Currently the send and receive operations in torch distributed are not supported by the dynamo compiler, in that the compilation would fail for user-defined functions that attempt to perform these end-to-end communications. However, these operations are important to attain high performance for some distributed hardware architectures/platforms.

We are working on extending the dynamo compilation to support this new feature. We would like to upstream the extension to the main branch of the repository.

Alternatives

No response

Additional context

No response

cc @H-Huang @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k @chauhang @penguinwu @voznesenskym @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @amjames
@jcaip jcaip added oncall: pt2 oncall: distributed Add this issue/PR to distributed oncall triage queue labels May 16, 2025
@williamwen42
Copy link
Member

cc @yf225 for distributed + compiler

@williamwen42 williamwen42 added triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module module: dynamo labels May 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
module: dynamo oncall: distributed Add this issue/PR to distributed oncall triage queue oncall: pt2 triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@qingyi-yan @jcaip @williamwen42
0