TensorNVMe icon indicating copy to clipboard operation
TensorNVMe copied to clipboard
verified publisher icon hpcaitech

Failed to build installable wheels for some pyproject.toml based projects (tensornvme)

Open KLL535 opened this issue 1 year ago • 2 comments

Help me!

(venv) user@DESKTOP-ULK7M66:~/Open-Sora$ pip install git+https://github.com/hpcaitech/TensorNVMe.git Collecting git+https://github.com/hpcaitech/TensorNVMe.git Cloning https://github.com/hpcaitech/TensorNVMe.git to /tmp/pip-req-build-64o7_c6v Running command git clone --filter=blob:none --quiet https://github.com/hpcaitech/TensorNVMe.git /tmp/pip-req-build-64o7_c6v Resolved https://github.com/hpcaitech/TensorNVMe.git to commit 6403388f7c8929f43e407c8f7f39c6453d78c5d4 Preparing metadata (setup.py) ... done Requirement already satisfied: packaging in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (24.2) Requirement already satisfied: click in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (8.1.8) Requirement already satisfied: torch in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (2.2.2) Requirement already satisfied: filelock in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.16.1) Requirement already satisfied: typing-extensions>=4.8.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (4.12.2) Requirement already satisfied: sympy in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (1.13.3) Requirement already satisfied: networkx in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.4.2) Requirement already satisfied: jinja2 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.1.5) Requirement already satisfied: fsspec in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2024.12.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (8.9.2.26) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.19.3) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105) Requirement already satisfied: triton==2.2.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.2.0) Requirement already satisfied: nvidia-nvjitlink-cu12 in ./venv/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->tensornvme==0.1.0) (12.6.85) Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.11/site-packages (from jinja2->torch->tensornvme==0.1.0) (2.1.5) Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./venv/lib/python3.11/site-packages (from sympy->torch->tensornvme==0.1.0) (1.3.0) Building wheels for collected packages: tensornvme Building wheel for tensornvme (setup.py) ... error error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [176 lines of output] -- The CXX compiler identification is GNU 13.3.0 -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done liburing is found in /home/user/.tensornvme/lib/liburing.so libaio is found in /home/user/.tensornvme/lib/libaio.so -- Configuring done (0.3s) -- Generating done (0.0s) -- Build files have been written to: /tmp/pip-req-build-64o7_c6v/cmake-build make: *** No rule to make target 'extern_uring'. Stop. make: *** No rule to make target 'extern_aio'. Stop. running bdist_wheel running build running build_py creating build/lib.linux-x86_64-cpython-311/tensornvme copying tensornvme/async_file_io.py -> build/lib.linux-x86_64-cpython-311/tensornvme copying tensornvme/offload.py -> build/lib.linux-x86_64-cpython-311/tensornvme copying tensornvme/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme creating build/lib.linux-x86_64-cpython-311/tensornvme/cli copying tensornvme/cli/cli.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli copying tensornvme/cli/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli copying tensornvme/cli/check.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli running build_ext building 'tensornvme._C' extension creating /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc Emitting ninja build file /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/build.ninja... Compiling objects... Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N) [1/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13, from /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp:1: /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory 6 | #include <cuda_runtime_api.h> | ^~~~~~~~~~~~~~~~~~~~ compilation terminated. [2/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/space_mgr.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 [3/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13, from /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp:15: /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory 6 | #include <cuda_runtime_api.h> | ^~~~~~~~~~~~~~~~~~~~ compilation terminated. [4/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/async_file_io.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 [5/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 In file included from /usr/include/c++/13/memory:78, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/C++17.h:8, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/TypeList.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/Metaprogramming.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/DispatchKeySet.h:4, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Backend.h:5, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Layout.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/TensorBody.h:12, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/Tensor.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/Tensor.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/variable.h:6, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/autograd.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7, from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:3, from /tmp/pip-req-build-64o7_c6v/include/aio.h:4, from /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:1: In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’, inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17, inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1: /usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete] 99 | delete __ptr; | ^~~~~~~~~~~~ /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’: /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’ 23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]); | ^ In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’, inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17, inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1: /usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete] 99 | delete __ptr; | ^~~~~~~~~~~~ /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’: /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’ 23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]); | ^ [6/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/uring.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 [7/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_write(const at::Tensor&, const std::string&)’: /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:85:10: warning: ignoring return value of ‘ssize_t write(int, const void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 85 | write(this->fd, tensor.data_ptr(), bytes); | ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_read(const at::Tensor&, const std::string&)’: /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:93:9: warning: ignoring return value of ‘ssize_t read(int, void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 93 | read(this->fd, tensor.data_ptr(), bytes); | ~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_writev(const std::vectorat::Tensor&, const std::string&)’: /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:182:11: warning: ignoring return value of ‘ssize_t writev(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 182 | writev(this->fd, iov, tensors.size()); | ~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_readv(const std::vectorat::Tensor&, const std::string&)’: /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:192:10: warning: ignoring return value of ‘ssize_t readv(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result] 192 | readv(this->fd, iov, tensors.size()); | ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ [8/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/py_api.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17 ninja: build stopped: subcommand failed. Traceback (most recent call last): File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2096, in _run_ninja_build subprocess.run( File "/usr/lib/python3.11/subprocess.py", line 571, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-req-build-64o7_c6v/setup.py", line 172, in <module>
      setup(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 183, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 199, in run_commands
      dist.run_commands()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 954, in run_commands
      self.run_command(cmd)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 381, in run
      self.run_command("build")
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
      self.distribution.run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
      self.distribution.run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
      self.build_extensions()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 871, in build_extensions
      build_ext.build_extensions(self)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 476, in build_extensions
      self._build_extensions_serial()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 502, in _build_extensions_serial
      self.build_extension(ext)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 264, in build_extension
      _build_ext.build_extension(self, ext)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 557, in build_extension
      objects = self.compiler.compile(
                ^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 684, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2112, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for tensornvme Running setup.py clean for tensornvme Failed to build tensornvme ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (tensornvme)

KLL535 avatar Jan 03 '25 19:01 KLL535

ls /usr/local/cuda Nothing

echo $LD_LIBRARY_PATH Nothing

sudo apt install nvidia-cuda-toolkit

ls /usr/lib/nvidia-cuda-toolkit bin compute-sanitizer libdevice

sudo ln -s /usr/lib/nvidia-cuda-toolkit/ /usr/local/cuda export LD_LIBRARY_PATH=/usr/lib/nvidia-cuda-toolkit/bin

WORK

KLL535 avatar Jan 03 '25 20:01 KLL535

@KLL535 Hello, have you solved this problem? I also encountered this problem, what is the cause?

bbyyj avatar May 29 '25 10:05 bbyyj