-
Notifications
You must be signed in to change notification settings - Fork 24.7k
Closed
Labels
high prioritymodule: binariesAnything related to official binaries that we release to usersAnything related to official binaries that we release to usersmodule: cudaRelated to torch.cuda, and CUDA support in generalRelated to torch.cuda, and CUDA support in generalmodule: regressionIt used to work, and now it doesn'tIt used to work, and now it doesn'ttriage review
Milestone
Description
🐛 Describe the bug
Run:
% docker run --rm --gpus all -it amazonlinux:latest bash -c "yum install -y python3-pip; pip3 install torch --extra-index-url https://download.pytorch.org/whl/test/cu121_pypi_cudnn; python3 -c 'import torch'"
...
Traceback (most recent call last):
File "/usr/local/lib64/python3.9/site-packages/torch/__init__.py", line 174, in _load_global_deps
ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
File "/usr/lib64/python3.9/ctypes/__init__.py", line 374, in __init__
self._handle = _dlopen(self._name, mode)
OSError: libcufft.so.11: cannot open shared object file: No such file or directory
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/local/lib64/python3.9/site-packages/torch/__init__.py", line 234, in <module>
_load_global_deps()
File "/usr/local/lib64/python3.9/site-packages/torch/__init__.py", line 195, in _load_global_deps
_preload_cuda_deps(lib_folder, lib_name)
File "/usr/local/lib64/python3.9/site-packages/torch/__init__.py", line 160, in _preload_cuda_deps
raise ValueError(f"{lib_name} not found in the system path {sys.path}")
ValueError: libnvrtc.so.*[0-9].*[0-9] not found in the system path ['', '/usr/lib64/python39.zip', '/usr/lib64/python3.9', '/usr/lib64/python3.9/lib-dynload', '/usr/local/lib64/python3.9/site-packages', '/usr/local/lib/python3.9/site-packages', '/usr/lib64/python3.9/site-packages', '/usr/lib/python3.9/site-packages']
Please note that above works as expected with 2.0 release, i.e. #88869 was reintroduced in trunk/2.1.0 branch
Versions
2.1.0
Metadata
Metadata
Assignees
Labels
high prioritymodule: binariesAnything related to official binaries that we release to usersAnything related to official binaries that we release to usersmodule: cudaRelated to torch.cuda, and CUDA support in generalRelated to torch.cuda, and CUDA support in generalmodule: regressionIt used to work, and now it doesn'tIt used to work, and now it doesn'ttriage review