8000 [DataPipe] Snapshotting prototype by NivekT · Pull Request #70216 · pytorch/pytorch · GitHub
[go: up one dir, main page]
Skip to content

[DataPipe] Snapshotting prototype #70216

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 54 commits into from
Closed

[DataPipe] Snapshotting prototype #70216

wants to merge 54 commits into from

Conversation

NivekT
Copy link
Contributor
@NivekT NivekT commented Dec 20, 2021 •
edited
Loading

This was referenced Dec 20, 2021
Closed
Closed
@pytorch-probot
Copy link
pytorch-probot bot commented Dec 20, 2021 •
edited
Loading
CI Flow Status

⚛️ CI Flow

Ruleset - Version: v1
Ruleset - File: https://github.com/pytorch/pytorch/blob/806cca03bfa79e2793f7147ca55620e8b91e55f2/.github/generated-ciflow-ruleset.json
PR ciflow labels: ciflow/default

Workflows Labels (bold enabled) Status
Triggered Workflows
linux-binary-conda ciflow/binaries, ciflow/binaries/conda, ciflow/default ✅ triggered
linux-binary-libtorch-cxx11-abi ciflow/binaries, ciflow/binaries/libtorch, ciflow/default ✅ triggered
linux-binary-libtorch-pre-cxx11 ciflow/binaries, ciflow/binaries/libtorch, ciflow/default ✅ triggered
linux-binary-manywheel ciflow/binaries, ciflow/binaries/wheel, ciflow/default ✅ triggered
linux-bionic-py3.7-clang9 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/noarch, ciflow/trunk, ciflow/xla ✅ triggered
linux-docs ciflow/all, ciflow/cpu, ciflow/default, ciflow/docs, ciflow/linux, ciflow/trunk ✅ triggered
linux-vulkan-bionic-py3.7-clang9 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk, ciflow/vulkan ✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-cuda11.3-py3.7-gcc7-bazel-test ciflow/all, ciflow/bazel, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3-clang5-mobile-build ciflow/all, ciflow/default, ciflow/linux, ciflow/mobile, ciflow/trunk ✅ triggered
linux-xenial-py3-clang5-mobile-custom-build-static ciflow/all, ciflow/default, ciflow/linux, ciflow/mobile, ciflow/trunk ✅ triggered
linux-xenial-py3.7-clang7-asan ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/sanitizers, ciflow/trunk ✅ triggered
linux-xenial-py3.7-clang7-onnx ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/onnx, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc7 ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
linux-xenial-py3.7-gcc7-no-ops ciflow/all, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single ciflow/all, ciflow/android, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-gradle-custom-build-single-full-jit ciflow/all, ciflow/android, ciflow/cpu, ciflow/default, ciflow/linux, ciflow/trunk ✅ triggered
win-vs2019-cpu-py3 ciflow/all, ciflow/cpu, ciflow/default, ciflow/trunk, ciflow/win ✅ triggered
win-vs2019-cuda11.3-py3 ciflow/all, ciflow/cuda, ciflow/default, ciflow/trunk, ciflow/win ✅ triggered
Skipped Workflows
caffe2-linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped
docker-builds ciflow/all, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64 ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-coreml ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-custom-ops ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-full-jit ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-arm64-metal ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64 ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64-coreml ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
ios-12-5-1-x86-64-full-jit ciflow/all, ciflow/ios, ciflow/macos, ciflow/trunk 🚫 skipped
libtorch-linux-xenial-cuda10.2-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/trunk 🚫 skipped
libtorch-linux-xenial-cuda11.3-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/trunk 🚫 skipped
linux-bionic-cuda10.2-py3.9-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/slow, ciflow/trunk 🚫 skipped
linux-bionic-rocm4.5-py3.7 ciflow/all, ciflow/linux, ciflow/rocm, ciflow/trunk 🚫 skipped
linux-docs-push ciflow/all, ciflow/cpu, ciflow/linux, ciflow/scheduled 🚫 skipped
linux-xenial-cuda11.3-py3.7-gcc7-no-ops ciflow/all, ciflow/cuda, ciflow/linux, ciflow/trunk 🚫 skipped
macos-10-15-py3-arm64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
macos-10-15-py3-lite-interpreter-x86-64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
macos-11-py3-x86-64 ciflow/all, ciflow/macos, ciflow/trunk 🚫 skipped
parallelnative-linux-xenial-py3.7-gcc5.4 ciflow/all, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped
periodic-libtorch-linux-bionic-cuda11.5-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-libtorch-linux-xenial-cuda11.1-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/libtorch, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-linux-bionic-cuda11.5-py3.7-gcc7 ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-linux-xenial-cuda10.2-py3-gcc7-slow-gradcheck ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled, ciflow/slow, ciflow/slow-gradcheck 🚫 skipped
periodic-linux-xenial-cuda11.1-py3.7-gcc7-debug ciflow/all, ciflow/cuda, ciflow/linux, ciflow/scheduled 🚫 skipped
periodic-win-vs2019-cuda11.1-py3 ciflow/all, ciflow/cuda, ciflow/scheduled, ciflow/win 🚫 skipped
periodic-win-vs2019-cuda11.5-py3 ciflow/all, ciflow/cuda, ciflow/scheduled, ciflow/win 🚫 skipped
pytorch-linux-xenial-py3-clang5-android-ndk-r19c-build ciflow/all, ciflow/android, ciflow/cpu, ciflow/linux, ciflow/trunk 🚫 skipped

You can add a comment to the PR and tag @pytorchbot with the following commands: 
# ciflow rerun, "ciflow/default" will always be added automatically
@pytorchbot ciflow rerun

# ciflow rerun with additional labels "-l <ciflow/label_name>", which is equivalent to adding these labels manually and trigger the rerun
@pytorchbot ciflow rerun -l ciflow/scheduled -l ciflow/slow

For more information, please take a look at the CI Flow Wiki.

NivekT added a commit that referenced this pull request Dec 20, 2021
@NivekT
[DataPipe] Snapshotting prototype
39778c8 
ghstack-source-id: 7a96077
Pull Request resolved: #70216
@facebook-github-bot
Copy link
Contributor
facebook-github-bot commented Dec 20, 2021 •
edited
Loading

🔗 Helpful links

❌ 8 New Failures

As of commit 70f179d (more details on the Dr. CI page):

Expand to see more
  • 8/8 failures introduced in this PR

🕵️ 8 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build pull / linux-bionic-cuda11.6-py3.7-gcc7 / test (default, 4, 4, linux.4xlarge.nvidia.gpu) (1/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T23:11:06.1621221Z NameError: name 'reset_dps' is not defined 
2022-07-20T23:11:06.1617408Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T23:11:06.1617872Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T23:11:06.1618464Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:11:06.1618836Z 
2022-07-20T23:11:06.1618978Z ======================================================================
2022-07-20T23:11:06.1619340Z ERROR [0.005s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:11:06.1619869Z ----------------------------------------------------------------------
2022-07-20T23:11:06.1620244Z Traceback (most recent call last):
2022-07-20T23:11:06.1620593Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T23:11:06.1620883Z     reset_dps()
2022-07-20T23:11:06.1621221Z NameError: name 'reset_dps' is not defined
2022-07-20T23:11:06.1621415Z 
2022-07-20T23:11:06.1621553Z ======================================================================
2022-07-20T23:11:06.1621926Z ERROR [0.006s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:11:06.1622398Z ----------------------------------------------------------------------
2022-07-20T23:11:06.1622749Z Traceback (most recent call last):
2022-07-20T23:11:06.1623089Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T23:11:06.1623454Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T23:11:06.1623870Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:11:06.1624111Z 
2022-07-20T23:11:06.1624253Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (dynamo, 2, 2, linux.2xlarge) (2/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:49.0713694Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:49.0710161Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:49.0710536Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:49.0710844Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:49.0711043Z 
2022-07-20T22:42:49.0711142Z ======================================================================
2022-07-20T22:42:49.0711435Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:49.0712008Z ----------------------------------------------------------------------
2022-07-20T22:42:49.0712424Z Traceback (most recent call last):
2022-07-20T22:42:49.0712829Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:49.0713231Z     reset_dps()
2022-07-20T22:42:49.0713694Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:49.0713943Z 
2022-07-20T22:42:49.0714118Z ======================================================================
2022-07-20T22:42:49.0714645Z ERROR [0.005s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:49.0715315Z ----------------------------------------------------------------------
2022-07-20T22:42:49.0715705Z Traceback (most recent call last):
2022-07-20T22:42:49.0716129Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:49.0716647Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:49.0717170Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:49.0717496Z 
2022-07-20T22:42:49.0717662Z ======================================================================

See GitHub Actions build pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (3/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T23:53:51.2752836Z NameError: name 'reset_dps' is not defined 
2022-07-20T23:53:51.2750406Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T23:53:51.2750696Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T23:53:51.2751014Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:53:51.2751213Z 
2022-07-20T23:53:51.2751307Z ======================================================================
2022-07-20T23:53:51.2751567Z ERROR [0.000s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:53:51.2751882Z ----------------------------------------------------------------------
2022-07-20T23:53:51.2752136Z Traceback (most recent call last):
2022-07-20T23:53:51.2752421Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T23:53:51.2752629Z     reset_dps()
2022-07-20T23:53:51.2752836Z NameError: name 'reset_dps' is not defined
2022-07-20T23:53:51.2752972Z 
2022-07-20T23:53:51.2753073Z ======================================================================
2022-07-20T23:53:51.2753329Z ERROR [0.016s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T23:53:51.2753640Z ----------------------------------------------------------------------
2022-07-20T23:53:51.2753892Z Traceback (most recent call last):
2022-07-20T23:53:51.2754166Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T23:53:51.2754435Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T23:53:51.2754739Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T23:53:51.2754920Z 
2022-07-20T23:53:51.2755117Z ======================================================================

See GitHub Actions build pull / linux-focal-py3.7-clang7-asan / test (default, 4, 5, linux.2xlarge) (4/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:48:59.6137919Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:48:59.6134524Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:48:59.6135104Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:48:59.6135686Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:48:59.6136029Z 
2022-07-20T22:48:59.6136201Z ======================================================================
2022-07-20T22:48:59.6136502Z ERROR [0.005s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:48:59.6136891Z ----------------------------------------------------------------------
2022-07-20T22:48:59.6137173Z Traceback (most recent call last):
2022-07-20T22:48:59.6137441Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:48:59.6137662Z     reset_dps()
2022-07-20T22:48:59.6137919Z NameError: name 'reset_dps' is not defined
2022-07-20T22:48:59.6138061Z 
2022-07-20T22:48:59.6138160Z ======================================================================
2022-07-20T22:48:59.6138427Z ERROR [0.005s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:48:59.6138810Z ----------------------------------------------------------------------
2022-07-20T22:48:59.6139076Z Traceback (most recent call last):
2022-07-20T22:48:59.6139332Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:48:59.6139607Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:48:59.6139928Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:48:59.6140112Z 
2022-07-20T22:48:59.6140216Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (crossref, 1, 2, linux.2xlarge) (5/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:46.7484073Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:46.7480311Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:46.7480803Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:46.7481538Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:46.7481857Z 
2022-07-20T22:42:46.7482022Z ======================================================================
2022-07-20T22:42:46.7482452Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:46.7482889Z ----------------------------------------------------------------------
2022-07-20T22:42:46.7483162Z Traceback (most recent call last):
2022-07-20T22:42:46.7483431Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:46.7483685Z     reset_dps()
2022-07-20T22:42:46.7484073Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:46.7484371Z 
2022-07-20T22:42:46.7484585Z ======================================================================
2022-07-20T22:42:46.7485174Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:46.7486018Z ----------------------------------------------------------------------
2022-07-20T22:42:46.7486435Z Traceback (most recent call last):
2022-07-20T22:42:46.7486870Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:46.7487382Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:46.7487915Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:46.7488243Z 
2022-07-20T22:42:46.7488417Z ======================================================================

See GitHub Actions build pull / linux-bionic-py3.7-clang9 / test (default, 1, 2, linux.2xlarge) (6/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:42:34.3580875Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:42:34.3577268Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:42:34.3577610Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:34.3578329Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:34.3578653Z 
2022-07-20T22:42:34.3578822Z ======================================================================
2022-07-20T22:42:34.3579443Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:34.3579851Z ----------------------------------------------------------------------
2022-07-20T22:42:34.3580125Z Traceback (most recent call last):
2022-07-20T22:42:34.3580391Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:42:34.3580613Z     reset_dps()
2022-07-20T22:42:34.3580875Z NameError: name 'reset_dps' is not defined
2022-07-20T22:42:34.3581017Z 
2022-07-20T22:42:34.3581116Z ======================================================================
2022-07-20T22:42:34.3581400Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:42:34.3581775Z ----------------------------------------------------------------------
2022-07-20T22:42:34.3582047Z Traceback (most recent call last):
2022-07-20T22:42:34.3582308Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:42:34.3582585Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:42:34.3582900Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:42:34.3583083Z 
2022-07-20T22:42:34.3583179Z ======================================================================

See GitHub Actions build Lint / lintrunner (7/8)

Step: "Run lintrunner on all files" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:06:04.0619455Z ##[error]oncall: f...se from https://github.com/pytorch/pytorch/labels) 
2022-07-20T22:06:04.0602749Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0604412Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0606062Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0607705Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0609358Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0611016Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0612777Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0614442Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0616144Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0617799Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0619455Z ##[error]oncall: fx is not a PyTorch label (please choose from https://github.com/pytorch/pytorch/labels)
2022-07-20T22:06:04.0657174Z Post job cleanup.
2022-07-20T22:06:04.0690908Z Post job cleanup.
2022-07-20T22:06:04.1782803Z [command]/usr/bin/git version
2022-07-20T22:06:04.1831218Z git version 2.37.1
2022-07-20T22:06:04.1875299Z Temporarily overriding HOME='/home/runner/actions-runner/_work/_temp/92dafca9-108f-4c23-b738-dd0a390adc3b' before making global git config changes
2022-07-20T22:06:04.1875778Z Adding repository directory to the temporary git global config as a safe directory
2022-07-20T22:06:04.1881602Z [command]/usr/bin/git config --global --add safe.directory /home/runner/actions-runner/_work/pytorch/pytorch
2022-07-20T22:06:04.1930106Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-07-20T22:06:04.1972608Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2022-07-20T22:06:04.2240931Z Entering 'android/libs/fbjni'

See GitHub Actions build pull / linux-focal-py3.7-gcc7 / test (default, 2, 2, linux.2xlarge) (8/8)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-07-20T22:37:15.7396436Z NameError: name 'reset_dps' is not defined 
2022-07-20T22:37:15.7392975Z   File "test_datapipe.py", line 1423, in test_collate_iterdatapipe
2022-07-20T22:37:15.7393266Z     snapshot_test_helper(collate_dp, new_dp, n_elements_to_advance)
2022-07-20T22:37:15.7393575Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:37:15.7393756Z 
2022-07-20T22:37:15.7394044Z ======================================================================
2022-07-20T22:37:15.7394445Z ERROR [0.004s]: test_concat_iterdatapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:37:15.7394857Z ----------------------------------------------------------------------
2022-07-20T22:37:15.7395270Z Traceback (most recent call last):
2022-07-20T22:37:15.7395607Z   File "test_datapipe.py", line 885, in test_concat_iterdatapipe
2022-07-20T22:37:15.7395970Z     reset_dps()
2022-07-20T22:37:15.7396436Z NameError: name 'reset_dps' is not defined
2022-07-20T22:37:15.7396606Z 
2022-07-20T22:37:15.7396700Z ======================================================================
2022-07-20T22:37:15.7397047Z ERROR [0.004s]: test_filter_datapipe (__main__.TestFunctionalIterDataPipe)
2022-07-20T22:37:15.7398347Z ----------------------------------------------------------------------
2022-07-20T22:37:15.7398800Z Traceback (most recent call last):
2022-07-20T22:37:15.7399282Z   File "test_datapipe.py", line 1573, in test_filter_datapipe
2022-07-20T22:37:15.7399630Z     snapshot_test_helper(filter_dp, new_dp, n_elements_to_advance)
2022-07-20T22:37:15.7399940Z TypeError: snapshot_test_helper() takes 2 positional arguments but 3 were given
2022-07-20T22:37:15.7400119Z 
2022-07-20T22:37:15.7400217Z ======================================================================
This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@NivekT NivekT marked this pull request as draft December 20, 2021 23:55
@NivekT NivekT added the module: data torch.utils.data label Dec 20, 2021
@NivekT NivekT mentioned this pull request Dec 21, 2021
Closed
NivekT added a commit that referenced this pull request Dec 21, 2021
@NivekT
[DataPipe] Snapshotting prototype
a34ee6c 
ghstack-source-id: 51ad768
Pull Request resolved: #70216
@NivekT NivekT mentioned this pull request Dec 23, 2021
Closed
NivekT added a commit that referenced this pull request Dec 23, 2021
@NivekT
[DataPipe] Snapshotting prototype
e583b8b 
ghstack-source-id: 229604b
Pull Request resolved: #70216
@NivekT NivekT mentioned this pull request Dec 29, 2021
Closed
NivekT added a commit that referenced this pull request Dec 29, 2021
@NivekT
[DataPipe] Snapshotting prototype
24238de 
ghstack-source-id: 088fdc8
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Dec 30, 2021
@NivekT
[DataPipe] Snapshotting prototype
05f70b8 
ghstack-source-id: 3e6e893
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 24, 2022
@NivekT
[DataPipe] Snapshotting prototype
21ceee4 
ghstack-source-id: cf4840c
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
5f720a1 
ghstack-source-id: e3883c7
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
9fe65b3 
ghstack-source-id: c9d0b23
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 28, 2022
@NivekT
[DataPipe] Snapshotting prototype
8ba3c59 
ghstack-source-id: 2174050
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jun 29, 2022
@NivekT
[DataPipe] Snapshotting prototype
a242908 
ghstack-source-id: 012226c
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 13, 2022
@NivekT
[DataPipe] Snapshotting prototype
03dcc7a 
ghstack-source-id: da839c1
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 18, 2022
@NivekT
[DataPipe] Snapshotting prototype
c90b20e 
ghstack-source-id: f61b860
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 19, 2022
@NivekT
[DataPipe] Snapshotting prototype
43588ad 
ghstack-source-id: e8973a1
Pull Request resolved: #70216
NivekT added a commit that referenced this pull request Jul 20, 2022
@NivekT
[DataPipe] Snapshotting prototype
4836d14 
ghstack-source-id: 69213ec
Pull Request resolved: #70216
@github-actions
Copy link
Contributor

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

@github-actions github-actions bot added the Stale label Sep 19, 2022
@facebook-github-bot
Copy link
Contributor

/easycla

As part of the transition to the PyTorch Foundation, this project now requires contributions be covered under the new CLA. See #85559 for additional details.

This comment will trigger a new check of this PR. If you are already covered, you will simply see a new "EasyCLA" check that passes. If you are not covered, a bot will leave a new comment with a link to sign.

@github-actions github-actions bot closed this Nov 3, 2022
@facebook-github-bot facebook-github-bot deleted the gh/nivekt/38/head branch June 8, 2023 18:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
cla signed module: data torch.utils.data Stale
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@NivekT @facebook-github-bot @suo
0