8000 DISABLED test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS) · Issue #87542 · pytorch/pytorch · GitHub
[go: up one dir, main page]
Skip to content

DISABLED test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS) #87542

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
ZainRizvi opened this issue Oct 22, 2022 · 2 comments
Closed

DISABLED test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS) #87542

ZainRizvi opened this issue Oct 22, 2022 · 2 comments
Labels
skipped Denotes a (flaky) test currently skipped in CI. triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@ZainRizvi
Copy link
Contributor

Platforms: macos

This test was disabled because it is failing on master.

Example:
https://hud.pytorch.org/pytorch/pytorch/commit/838b699e1082791d5e838ca0de0d72c4b6120e14

This appears to be part of a larger pattern of flaky tests failing with the error AssertionError: Tensor-likes are not close! and may have a deeper root cause than just this one test

Failing run on GitHub: https://github.com/pytorch/pytorch/actions/runs/3300182413/jobs/5446436403

Relevant logs:

2022-10-22T00:13:06.9665930Z ======================================================================
2022-10-22T00:13:06.9666150Z FAIL [0.247s]: test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS)
2022-10-22T00:13:06.9666640Z ----------------------------------------------------------------------
2022-10-22T00:13:06.9666860Z Traceback (most recent call last):
2022-10-22T00:13:06.9667220Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 381, in instantiated_test
2022-10-22T00:13:06.9667470Z     result = test(self, **param_kwargs)
2022-10-22T00:13:06.9667800Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 831, in test_wrapper
2022-10-22T00:13:06.9668040Z     return test(*args, **kwargs)
2022-10-22T00:13:06.9668340Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_device_type.py", line 991, in only_fn
2022-10-22T00:13:06.9668570Z     return fn(slf, *args, **kwargs)
2022-10-22T00:13:06.9668880Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 1307, in wrapper
2022-10-22T00:13:06.9669090Z     fn(*args, **kwargs)
2022-10-22T00:13:06.9669340Z   File "/Users/ec2-user/runner/_work/pytorch/pytorch/test/test_mps.py", line 7875, in test_numpy_ref_mps
2022-10-22T00:13:06.9669550Z     self.compare_with_reference(op, op.ref, sample_input)
2022-10-22T00:13:06.9670100Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2361, in compare_with_reference
2022-10-22T00:13:06.9670370Z     self.assertEqual(actual, expected, exact_device=False, **kwargs)
2022-10-22T00:13:06.9670710Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_internal/common_utils.py", line 2464, in assertEqual
2022-10-22T00:13:06.9670910Z     assert_equal(
2022-10-22T00:13:06.9671180Z   File "/Users/ec2-user/runner/_work/_temp/conda_environment_3300182413/lib/python3.9/site-packages/torch/testing/_comparison.py", line 1093, in assert_equal
2022-10-22T00:13:06.9671400Z     raise error_metas[0].to_error(msg)
2022-10-22T00:13:06.9671580Z AssertionError: Tensor-likes are not close!
2022-10-22T00:13:06.9671670Z 
2022-10-22T00:13:06.9671730Z Mismatched elements: 1 / 56 (1.8%)
2022-10-22T00:13:06.9671960Z Greatest absolute difference: 1.1682510375976562e-05 at index (0, 7, 3) (up to 1e-05 allowed)
2022-10-22T00:13:06.9672350Z Greatest relative difference: 1.2376390796915803e-05 at index (0, 7, 3) (up to 1.3e-06 allowed)
2022-10-22T00:13:06.9672480Z 
2022-10-22T00:13:06.9672600Z ----------------------------------------------------------------------
@pytorch-bot pytorch-bot bot added the skipped Denotes a (flaky) test currently skipped in CI. label Oct 22, 2022
@pytorch-bot
Copy link
pytorch-bot bot commented Oct 22, 2022
Hello there! From the DISABLED prefix in this issue title, it looks like you are attempting to disable a test in PyTorch CI. The information I have parsed is below:
  • Test name: test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS)
  • Platforms for which to skip the test: macos

Within ~15 minutes, test_numpy_ref_mps_nn_functional_conv_transpose1d_mps_float32 (__main__.TestCommonMPS) will be disabled in PyTorch CI for these platforms: macos. Please verify that your test name looks correct, e.g., test_cuda_assert_async (__main__.TestCuda).

To modify the platforms list, please include a line in the issue body, like below. The default action will disable the test for all platforms if no platforms list is specified.

Platforms: case-insensitive, list, of, platforms

We currently support the following platforms: asan, dynamo, linux, mac, macos, rocm, win, windows.

@ngimel ngimel added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Oct 23, 2022
@pytorch-bot PyTorch Bot
Copy link
pytorch-bot bot commented May 12, 2025

Resolving the issue because the test is not flaky anymore after 600 reruns without any failures and the issue hasn't been updated in 14 days. Please reopen the issue to re-disable the test if you think this is a false positive

@pytorch-bot pytorch-bot bot closed this as completed May 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
skipped Denotes a (flaky) test currently skipped in CI. triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ZainRizvi @ngimel
0