8000 Parallelize sort by annop-w · Pull Request #149505 · pytorch/pytorch · GitHub
[go: up one dir, main page]

Skip to content

Parallelize sort #149505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

Parallelize sort #149505

wants to merge 1 commit into from

Conversation

annop-w
Copy link
Contributor
@annop-w annop-w commented Mar 19, 2025

PR #142391 erroneously used USE_OMP instead of USE_OPENMP.

cc @jgong5 @mingfeima @XiaobingSuper @sanchitintel @ashokei @jingxu10

Copy link
pytorch-bot bot commented Mar 19, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/149505

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 3 Unrelated Failures

As of commit 9378a79 with merge base 790f93d (image):

NEW FAILURES - The following jobs have failed:

UNSTABLE - The following jobs are marked as unstable, possibly due to flakiness on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@annop-w
Copy link
Contributor Author
annop-w commented Mar 19, 2025

@pytorchbot label "module: cpu"

@fadara01
Copy link
Collaborator

@pytorchbot label "ciflow/linux-aarch64"

@pytorch-bot pytorch-bot bot added module: cpu CPU specific problem (e.g., perf, algorithm) ciflow/linux-aarch64 linux aarch64 CI workflow labels Mar 19, 2025
fadara01
fadara01 previously approved these changes Mar 19, 2025
Copy link
Collaborator
@fadara01 fadara01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well spotted, LGTM!

@fadara01
Copy link
Collaborator

@pytorchbot label "topic: not user facing"

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Mar 19, 2025
@pytorch-bot pytorch-bot bot removed the ciflow/linux-aarch64 linux aarch64 CI workflow label Mar 20, 2025
@annop-w annop-w requested a review from fadara01 March 20, 2025 22:47
@annop-w
Copy link
Contributor Author
annop-w commented Mar 21, 2025

@nikhil-arm Could you please review ?

Skylion007
Skylion007 previously approved these changes Mar 21, 2025
Copy link
Collaborator
@Skylion007 Skylion007 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also a good backport candidate

@Skylion007 Skylion007 added this to the 2.7.0 milestone Mar 21, 2025
fadara01
fadara01 previously approved these changes Mar 21, 2025
Copy link
8000
Collaborator
@fadara01 fadara01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢 it

@fadara01
Copy link
Collaborator

All failures seem unrelated.

@fadara01
Copy link
Collaborator

@pytorchbot merge -f "Failures are unrelated"

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

8000

@fadara01
Copy link
Collaborator

@pytorchbot cherry-pick --onto release/2.7 -c "critical"

pytorchbot pushed a commit that referenced this pull request Mar 21, 2025
PR #142391 erroneously used `USE_OMP` instead of `USE_OPENMP`.

Pull Request resolved: #149505
Approved by: https://github.com/fadara01, https://github.com/Skylion007

(cherry picked from commit 842d515)
@pytorchbot
Copy link
Collaborator

Cherry picking #149505

The cherry pick PR is at #149765 and it is recommended to link a critical cherry pick PR with an issue. The following tracker issues are updated:

Details for Dev Infra team Raised by workflow job

@malfet
Copy link
Contributor
malfet commented Mar 26, 2025

@pytorchbot cherry-pick --onto release/2.7 -c "critical"

I think critical is a strong statement, but whatever...

@ZainRizvi
Copy link
Contributor
ZainRizvi commented Mar 27, 2025

@pytorchbot revert -c nosignal -m "Reverting since this is breaking inductor builds on trunk. More details GH job link HUD commit link"

Note that this failure is a bit flaky, but you can see that it started when this PR was merged

Also reverting the cherry-pick

@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a revert job. Check the current status here.
Questions? Feedback? Please reach out to the PyTorch DevX Team

@pytorchmergebot
Copy link
Collaborator

@annop-w your PR has been successfully reverted.

pytorchmergebot added a commit that referenced this pull request Mar 27, 2025
This reverts commit 842d515.

Reverted #149505 on behalf of https://github.com/ZainRizvi due to Reverting since this is breaking inductor builds on trunk. More details [GH job link](https://github.com/pytorch/pytorch/actions/runs/14000726218/job/39207447863) [HUD commit link](https://hud.pytorch.org/pytorch/pytorch/commit/842d51500be144d53f4d046d31169e8f46c063f6) ([comment](#149505 (comment)))
@pytorchmergebot pytorchmergebot added Reverted ci-no-td Do not run TD on this PR labels Mar 27, 2025
@pytorch-bot pytorch-bot bot dismissed stale reviews from fadara01, Skylion007, and fadara01 March 27, 2025 18:43

This PR was reopened (likely due to being reverted), so your approval was removed. Please request another review.

@annop-w annop-w closed this Mar 28, 2025
@annop-w annop-w deleted the fix_sort branch March 28, 2025 09:53
annop-w added a commit to annop-w/pytorch that referenced this pull request Mar 28, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
annop-w added a commit to annop-w/pytorch that referenced this pull request Mar 28, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
annop-w added a commit to annop-w/pytorch that referenced this pull request Mar 31, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
annop-w added a commit to annop-w/pytorch that referenced this pull request Mar 31, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
@atalman atalman removed this from the 2.7.0 milestone Apr 3, 2025
pytorchmergebot pushed a commit to annop-w/pytorch that referenced this pull request Apr 7, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
amathewc pushed a commit to amathewc/pytorch that referenced this pull request Apr 17, 2025
PR pytorch#142391 erroneously used `USE_OMP` instead of `USE_OPENMP`.

Pull Request resolved: pytorch#149505
Approved by: https://github.com/fadara01, https://github.com/Skylion007
amathewc pushed a commit to amathewc/pytorch that referenced this pull request Apr 17, 2025
annop-w added a commit to annop-w/pytorch that referenced this pull request May 1, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has
9DA1
 dependency on libtbb and we thus decide to avoid that.
pytorchmergebot pushed a commit to annop-w/pytorch that referenced this pull request May 13, 2025
Resolve pytorch#149977, pytorch#149979, pytorch#150094.
Previously, pytorch#149505 used libstdc++ parallel mode by enabling
-D_GLIBCXX_PARALLEL. However, mixing source files compiled with
and without parallel mode can lead to undefined behavior (See
https://gcc.gnu.org/onlinedocs/libstdc++/manual/parallel_mode_using.html)
We switch to using the specific paralell sort from <parallel/algorithm>
when compiled with GCC compiler. Note that use of std::execution policy
has dependency on libtbb and we thus decide to avoid that.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-no-td Do not run TD on this PR ciflow/inductor Merged module: cpu CPU specific problem (e.g., perf, algorithm) open source Reverted topic: not user facing topic category
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants
0