Add Multi-hot feature into the movie-lens example
Added 'genres' as a multi-hot feature into the sample.
Click to view CI Results
GitHub pull request #1021 of commit 6be67eafb33b8c8035b5411d15fdb8da4b7bf884, no merge conflicts.
Running as SYSTEM
Setting status of 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3093/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
> git rev-parse 6be67eafb33b8c8035b5411d15fdb8da4b7bf884^{commit} # timeout=10
Checking out Revision 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 # timeout=10
Commit message: "Add Multi-hot example"
> git rev-list --no-walk 9a9267eb90c52dfa82a47ca7a89dbe6e82e54267 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins5271119042589813411.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.2.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+2.g6be67ea -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+2.g6be67ea is already the active version in easy-install.pth
Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Processing dependencies for nvtabular==0.6.0+2.g6be67ea
Searching for pyarrow==1.0.1
Best match: pyarrow 1.0.1
Adding pyarrow 1.0.1 to easy-install.pth file
Installing plasma_store script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for tqdm==4.61.2
Best match: tqdm 4.61.2
Processing tqdm-4.61.2-py3.8.egg
tqdm 4.61.2 is already the active version in easy-install.pth
Installing tqdm script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg
Searching for numba==0.53.1
Best match: numba 0.53.1
Adding numba 0.53.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for pandas==1.1.5
Best match: pandas 1.1.5
Adding pandas 1.1.5 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for distributed==2021.4.1
Best match: distributed 2021.4.1
Adding distributed 2021.4.1 to easy-install.pth file
Installing dask-ssh script to /var/jenkins_home/.local/bin
Installing dask-scheduler script to /var/jenkins_home/.local/bin
Installing dask-worker script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for dask==2021.4.1
Best match: dask 2021.4.1
Processing dask-2021.4.1-py3.8.egg
dask 2021.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg
Searching for PyYAML==5.4.1
Best match: PyYAML 5.4.1
Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg
PyYAML 5.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg
Searching for numpy==1.20.2
Best match: numpy 1.20.2
Adding numpy 1.20.2 to easy-install.pth file
Installing f2py script to /var/jenkins_home/.local/bin
Installing f2py3 script to /var/jenkins_home/.local/bin
Installing f2py3.8 script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for llvmlite==0.36.0
Best match: llvmlite 0.36.0
Adding llvmlite 0.36.0 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for setuptools==57.4.0
Best match: setuptools 57.4.0
Adding setuptools 57.4.0 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for python-dateutil==2.8.2
Best match: python-dateutil 2.8.2
Adding python-dateutil 2.8.2 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for pytz==2021.1
Best match: pytz 2021.1
Adding pytz 2021.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for cloudpickle==1.6.0
Best match: cloudpickle 1.6.0
Processing cloudpickle-1.6.0-py3.8.egg
cloudpickle 1.6.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg
Searching for tblib==1.7.0
Best match: tblib 1.7.0
Processing tblib-1.7.0-py3.8.egg
tblib 1.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg
Searching for toolz==0.11.1
Best match: toolz 0.11.1
Processing toolz-0.11.1-py3.8.egg
toolz 0.11.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg
Searching for zict==2.0.0
Best match: zict 2.0.0
Processing zict-2.0.0-py3.8.egg
zict 2.0.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg
Searching for sortedcontainers==2.4.0
Best match: sortedcontainers 2.4.0
Processing sortedcontainers-2.4.0-py3.8.egg
sortedcontainers 2.4.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg
Searching for psutil==5.8.0
Best match: psutil 5.8.0
Processing psutil-5.8.0-py3.8-linux-x86_64.egg
psutil 5.8.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg
Searching for tornado==6.1
Best match: tornado 6.1
Processing tornado-6.1-py3.8-linux-x86_64.egg
tornado 6.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg
Searching for click==8.0.1
Best match: click 8.0.1
Processing click-8.0.1-py3.8.egg
click 8.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg
Searching for msgpack==1.0.2
Best match: msgpack 1.0.2
Processing msgpack-1.0.2-py3.8-linux-x86_64.egg
msgpack 1.0.2 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg
Searching for partd==1.2.0
Best match: partd 1.2.0
Processing partd-1.2.0-py3.8.egg
partd 1.2.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg
Searching for fsspec==2021.7.0
Best match: fsspec 2021.7.0
Processing fsspec-2021.7.0-py3.8.egg
fsspec 2021.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/fsspec-2021.7.0-py3.8.egg
Searching for six==1.15.0
Best match: six 1.15.0
Adding six 1.15.0 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for HeapDict==1.0.1
Best match: HeapDict 1.0.1
Processing HeapDict-1.0.1-py3.8.egg
HeapDict 1.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg
Searching for locket==0.2.1
Best match: locket 0.2.1
Processing locket-0.2.1-py3.8.egg
locket 0.2.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg
Finished processing dependencies for nvtabular==0.6.0+2.g6be67ea
Running black --check
All done! β¨ π° β¨
110 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 2 files
Running bandit
Running pylint
************* Module nvtabular.ops.categorify
nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module nvtabular.ops.fill
nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Running flake8-nb
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[135]:254:1: E902 IndentationError: unindent does not match any outer indentation level
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:4:15: E231 missing whitespace after ':'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:5:6: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:6:4: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:7:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:10:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:11:3: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:12:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:15:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:16:3: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:17:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:20:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:22:7: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:23:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:24:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:29:15: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:30:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:31:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:33:9: E231 missing whitespace after ':'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:37:11: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:38:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:39:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:69: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:43:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:32: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:47:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:31: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:51:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:31: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:55:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:59:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:63:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:66:2: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:67:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:71:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:75:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:30: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:79:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:32: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:3:25: E272 multiple spaces before keyword
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:9:20: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:10:19: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:15:8: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:26:1: W293 blank line contains whitespace
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:28:19: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:19: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:64: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:30:99: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:32:33: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:33:1: W293 blank line contains whitespace
examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb#In[17]:2:1: E265 block comment should start with '# '
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins5827686255363110841.sh
Click to view CI Results
GitHub pull request #1021 of commit 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc, no merge conflicts.
Running as SYSTEM
Setting status of 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3094/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
> git rev-parse 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc^{commit} # timeout=10
Checking out Revision 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc # timeout=10
Commit message: "modified path to data"
> git rev-list --no-walk 6be67eafb33b8c8035b5411d15fdb8da4b7bf884 # timeout=10
[nvtabular_tests] $ /bin/bash /tmp/jenkins1937025196937848310.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.2.2)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (57.4.0)
Requirement already satisfied: wheel in /usr/local/lib/python3.8/dist-packages (0.36.2)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.7.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+3.g78c8ae4 is already the active version in easy-install.pth
Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Processing dependencies for nvtabular==0.6.0+3.g78c8ae4
Searching for pyarrow==1.0.1
Best match: pyarrow 1.0.1
Adding pyarrow 1.0.1 to easy-install.pth file
Installing plasma_store script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for tqdm==4.61.2
Best match: tqdm 4.61.2
Processing tqdm-4.61.2-py3.8.egg
tqdm 4.61.2 is already the active version in easy-install.pth
Installing tqdm script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg
Searching for numba==0.53.1
Best match: numba 0.53.1
Adding numba 0.53.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for pandas==1.1.5
Best match: pandas 1.1.5
Adding pandas 1.1.5 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for distributed==2021.4.1
Best match: distributed 2021.4.1
Adding distributed 2021.4.1 to easy-install.pth file
Installing dask-ssh script to /var/jenkins_home/.local/bin
Installing dask-scheduler script to /var/jenkins_home/.local/bin
Installing dask-worker script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for dask==2021.4.1
Best match: dask 2021.4.1
Processing dask-2021.4.1-py3.8.egg
dask 2021.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg
Searching for PyYAML==5.4.1
Best match: PyYAML 5.4.1
Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg
PyYAML 5.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg
Searching for numpy==1.20.2
Best match: numpy 1.20.2
Adding numpy 1.20.2 to easy-install.pth file
Installing f2py script to /var/jenkins_home/.local/bin
Installing f2py3 script to /var/jenkins_home/.local/bin
Installing f2py3.8 script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for llvmlite==0.36.0
Best match: llvmlite 0.36.0
Adding llvmlite 0.36.0 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for setuptools==57.4.0
Best match: setuptools 57.4.0
Adding setuptools 57.4.0 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for python-dateutil==2.8.2
Best match: python-dateutil 2.8.2
Adding python-dateutil 2.8.2 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for pytz==2021.1
Best match: pytz 2021.1
Adding pytz 2021.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for tblib==1.7.0
Best match: tblib 1.7.0
Processing tblib-1.7.0-py3.8.egg
tblib 1.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg
Searching for zict==2.0.0
Best match: zict 2.0.0
Processing zict-2.0.0-py3.8.egg
zict 2.0.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg
Searching for toolz==0.11.1
Best match: toolz 0.11.1
Processing toolz-0.11.1-py3.8.egg
toolz 0.11.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg
Searching for click==8.0.1
Best match: click 8.0.1
Processing click-8.0.1-py3.8.egg
click 8.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg
Searching for tornado==6.1
Best match: tornado 6.1
Processing tornado-6.1-py3.8-linux-x86_64.egg
tornado 6.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg
Searching for msgpack==1.0.2
Best match: msgpack 1.0.2
Processing msgpack-1.0.2-py3.8-linux-x86_64.egg
msgpack 1.0.2 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg
Searching for psutil==5.8.0
Best match: psutil 5.8.0
Processing psutil-5.8.0-py3.8-linux-x86_64.egg
psutil 5.8.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg
Searching for sortedcontainers==2.4.0
Best match: sortedcontainers 2.4.0
Processing sortedcontainers-2.4.0-py3.8.egg
sortedcontainers 2.4.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg
Searching for cloudpickle==1.6.0
Best match: cloudpickle 1.6.0
Processing cloudpickle-1.6.0-py3.8.egg
cloudpickle 1.6.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg
Searching for partd==1.2.0
Best match: partd 1.2.0
Processing partd-1.2.0-py3.8.egg
partd 1.2.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg
Searching for fsspec==2021.7.0
Best match: fsspec 2021.7.0
Processing fsspec-2021.7.0-py3.8.egg
fsspec 2021.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/fsspec-2021.7.0-py3.8.egg
Searching for six==1.15.0
Best match: six 1.15.0
Adding six 1.15.0 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for HeapDict==1.0.1
Best match: HeapDict 1.0.1
Processing HeapDict-1.0.1-py3.8.egg
HeapDict 1.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg
Searching for locket==0.2.1
Best match: locket 0.2.1
Processing locket-0.2.1-py3.8.egg
locket 0.2.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg
Finished processing dependencies for nvtabular==0.6.0+3.g78c8ae4
Running black --check
All done! β¨ π° β¨
110 files would be left unchanged.
Running flake8
Running isort
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/images
warn(f"Likely recursive symlink detected to {resolved_path}")
/usr/local/lib/python3.8/dist-packages/isort/main.py:141: UserWarning: Likely recursive symlink detected to /var/jenkins_home/workspace/nvtabular_tests/nvtabular/examples/scaling-criteo/imgs
warn(f"Likely recursive symlink detected to {resolved_path}")
Skipped 2 files
Running bandit
Running pylint
************* Module nvtabular.ops.categorify
nvtabular/ops/categorify.py:459:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module nvtabular.ops.fill
nvtabular/ops/fill.py:66:15: I1101: Module 'nvtabular_cpp' has no 'inference' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
************* Module bench.datasets.tools.train_hugectr
bench/datasets/tools/train_hugectr.py:28:13: I1101: Module 'hugectr' has no 'solver_parser_helper' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
bench/datasets/tools/train_hugectr.py:41:16: I1101: Module 'hugectr' has no 'optimizer' member, but source is unavailable. Consider adding this module to extension-pkg-allow-list if you want to perform analysis based on run-time introspection of living objects. (c-extension-no-member)
Your code has been rated at 10.00/10 (previous run: 10.00/10, +0.00)
Running flake8-nb
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[135]:254:1: E902 IndentationError: unindent does not match any outer indentation level
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:4:15: E231 missing whitespace after ':'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:5:6: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:6:4: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:7:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:9:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:10:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:11:3: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:12:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:14:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:15:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:16:3: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:17:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:19:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:20:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:22:7: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:23:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:24:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:12: E201 whitespace after '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:26:15: E202 whitespace before ']'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:29:15: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:30:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:31:5: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:33:9: E231 missing whitespace after ':'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:37:11: E211 whitespace before '['
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:38:3: E121 continuation line under-indented for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:39:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:40:69: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:43:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:44:32: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:47:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:48:31: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:51:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:52:31: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:55:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:56:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:59:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:60:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:63:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:64:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:66:2: E131 continuation line unaligned for hanging indent
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:67:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:68:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:71:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:72:29: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:75:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:76:30: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:79:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:3: E122 continuation line missing indentation or outdented
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:11: E201 whitespace after '{'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[100]:80:32: E202 whitespace before '}'
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:3:25: E272 multiple spaces before keyword
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:9:20: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:10:19: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:15:8: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:26:1: W293 blank line contains whitespace
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:28:19: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:19: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:29:64: E225 missing whitespace around operator
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:30:99: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:32:33: E231 missing whitespace after ','
examples/getting-started-movielens/inference-HugeCTR/Triton-Inference-with-HugeCTR.ipynb#In[136]:33:1: W293 blank line contains whitespace
examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb#In[17]:2:1: E265 block comment should start with '# '
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins7146219636824817313.sh
@jershi425 when I train the model in the Training-with-HugeCTR nb, I get the following during model training:
[22d23h55m60s][HUGECTR][INFO]: Iter: 1900 Time(100 iters): 0.262071s Loss: 0.523336 lr:0.001000
[22d23h55m60s][HUGECTR][INFO]: Rank0: Dump hash table from GPU0
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write hash table <key,value> pairs to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Dumping sparse weights to files, successful
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write optimzer state to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Rank0: Write optimzer state to file
[22d23h55m60s][HUGECTR][INFO]: Done
[22d23h55m60s][HUGECTR][INFO]: Dumping sparse optimzer states to files, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping dense weights to file, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping dense optimizer states to file, successful
[22d23h55m60s][HUGECTR][INFO]: Dumping untrainable weights to file, successful
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
set_mempolicy: Operation not permitted
Finish 2000 iterations with batchsize: 2048 in 5.82s
[22d23h55m70s][HUGECTR][INFO]: Save the model graph to /model/movielens_hugectr/1/movielens.json, successful
Do you have any idea why I am getting set_mempolicy: Operation not permitted ? I use merlin-training:0.6 docker image.
@jershi425 can you also explain these lines? why range(1, 31) ? where is 31 coming from? thanks.
rp_lst = [0]
cur = 0
for i in range(1, 31):
if i % 3 == 0:
cur += 2
rp_lst.append(cur)
else:
cur += 1
rp_lst.append(cur)
@rnyak The set_mempolicy: Operation not permitted issue can be solved after you add --privileged when you start your docker container. The range(1, 31) comes from the fact that we have 3 columns in our data and I am using the first 10 samples to do the inference test. Therefore we have 3 * 10 = 30 row pointers.
@rnyak The
set_mempolicy: Operation not permittedissue can be solved after you add--privilegedwhen you start your docker container. The range(1, 31) comes from the fact that we have 3 columns in our data and I am using the first 10 samples to do the inference test. Therefore we have 3 * 10 = 30 row pointers.
@jershi425 thanks I solved set_mempolicy warning. Thanks for the explanation regarding range(1, 31).
Check out this pull request onΒ ![]()
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
@rnyak @jershi425 what is the plan for this PR?
@rnyak @jershi425 what is the plan for this PR?
@albert17 we already have multi-hot training example with HugeCTR based on this PR. It should work without issues. What is missing is the inference part. You only need to make the inference code created by Onur's PR work, and you can take Jerry's inference notebook as a guidance/reference/test point. Once you are done we can close this PR without merging :)
Click to view CI Results
GitHub pull request #1021 of commit 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc, has merge conflicts.
Running as SYSTEM
Setting status of 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3744/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
> git rev-parse 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc^{commit} # timeout=10
Checking out Revision 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 78c8ae4b8bce3aa4e0d6bec2002c367938701ecc # timeout=10
Commit message: "modified path to data"
> git rev-list --no-walk 5eb6c540ea1c3dfd08c4ca62c7e21fc01139e43a # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins2276861310117143877.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.1.1)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+3.g78c8ae4 -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+3.g78c8ae4 is already the active version in easy-install.pth
Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Processing dependencies for nvtabular==0.6.0+3.g78c8ae4
Searching for distributed==2021.4.1
Reading https://pypi.org/simple/distributed/
Downloading https://files.pythonhosted.org/packages/63/f8/ac2c18adde6477bca3881c4d3cfa74c7f4da7ee82f3c83c201aa3b9ca5ee/distributed-2021.4.1-py3-none-any.whl#sha256=fe0e005e9aa79d68e185008bd2ce6562388311efd1c59a04ab6127ee631b8808
Best match: distributed 2021.4.1
Processing distributed-2021.4.1-py3-none-any.whl
Installing distributed-2021.4.1-py3-none-any.whl to /var/jenkins_home/.local/lib/python3.8/site-packages
Removing distributed 2021.7.1 from easy-install.pth file
Adding distributed 2021.4.1 to easy-install.pth file
Installing dask-ssh script to /var/jenkins_home/.local/bin
Installing dask-scheduler script to /var/jenkins_home/.local/bin
Installing dask-worker script to /var/jenkins_home/.local/bin
Installed /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.4.1-py3.8.egg
Searching for dask==2021.4.1
Reading https://pypi.org/simple/dask/
Downloading https://files.pythonhosted.org/packages/c3/23/42159cdb5c9edac174296c9976e175742513883f0f7bc132cfc2a2480fab/dask-2021.4.1-py3-none-any.whl#sha256=344c342d699466c3f742019b7a33caf2472b751f38370b200ede7d2f354aa1e4
Best match: dask 2021.4.1
Processing dask-2021.4.1-py3-none-any.whl
Installing dask-2021.4.1-py3-none-any.whl to /var/jenkins_home/.local/lib/python3.8/site-packages
Adding dask 2021.4.1 to easy-install.pth file
Installed /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg
Searching for pyarrow==4.0.1
Best match: pyarrow 4.0.1
Adding pyarrow 4.0.1 to easy-install.pth file
Installing plasma_store script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for tqdm==4.61.2
Best match: tqdm 4.61.2
Processing tqdm-4.61.2-py3.8.egg
tqdm 4.61.2 is already the active version in easy-install.pth
Installing tqdm script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg
Searching for numba==0.54.0
Best match: numba 0.54.0
Processing numba-0.54.0-py3.8-linux-x86_64.egg
numba 0.54.0 is already the active version in easy-install.pth
Installing pycc script to /var/jenkins_home/.local/bin
Installing numba script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/numba-0.54.0-py3.8-linux-x86_64.egg
Searching for pandas==1.2.5
Best match: pandas 1.2.5
Processing pandas-1.2.5-py3.8-linux-x86_64.egg
Removing pandas 1.3.3 from easy-install.pth file
Adding pandas 1.2.5 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.2.5-py3.8-linux-x86_64.egg
Searching for PyYAML==5.4.1
Best match: PyYAML 5.4.1
Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg
PyYAML 5.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg
Searching for numpy==1.20.3
Best match: numpy 1.20.3
Adding numpy 1.20.3 to easy-install.pth file
Installing f2py script to /var/jenkins_home/.local/bin
Installing f2py3 script to /var/jenkins_home/.local/bin
Installing f2py3.8 script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for setuptools==59.1.1
Best match: setuptools 59.1.1
Adding setuptools 59.1.1 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for llvmlite==0.37.0
Best match: llvmlite 0.37.0
Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg
llvmlite 0.37.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg
Searching for pytz==2021.1
Best match: pytz 2021.1
Adding pytz 2021.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for python-dateutil==2.8.2
Best match: python-dateutil 2.8.2
Adding python-dateutil 2.8.2 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for zict==2.0.0
Best match: zict 2.0.0
Processing zict-2.0.0-py3.8.egg
zict 2.0.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg
Searching for tornado==6.1
Best match: tornado 6.1
Processing tornado-6.1-py3.8-linux-x86_64.egg
tornado 6.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg
Searching for toolz==0.11.1
Best match: toolz 0.11.1
Processing toolz-0.11.1-py3.8.egg
toolz 0.11.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg
Searching for tblib==1.7.0
Best match: tblib 1.7.0
Processing tblib-1.7.0-py3.8.egg
tblib 1.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg
Searching for sortedcontainers==2.4.0
Best match: sortedcontainers 2.4.0
Processing sortedcontainers-2.4.0-py3.8.egg
sortedcontainers 2.4.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg
Searching for psutil==5.8.0
Best match: psutil 5.8.0
Processing psutil-5.8.0-py3.8-linux-x86_64.egg
psutil 5.8.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg
Searching for msgpack==1.0.2
Best match: msgpack 1.0.2
Processing msgpack-1.0.2-py3.8-linux-x86_64.egg
msgpack 1.0.2 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg
Searching for cloudpickle==1.6.0
Best match: cloudpickle 1.6.0
Processing cloudpickle-1.6.0-py3.8.egg
cloudpickle 1.6.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg
Searching for click==8.0.1
Best match: click 8.0.1
Processing click-8.0.1-py3.8.egg
click 8.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg
Searching for partd==1.2.0
Best match: partd 1.2.0
Processing partd-1.2.0-py3.8.egg
partd 1.2.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg
Searching for fsspec==2021.11.0
Best match: fsspec 2021.11.0
Adding fsspec 2021.11.0 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for six==1.15.0
Best match: six 1.15.0
Adding six 1.15.0 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for HeapDict==1.0.1
Best match: HeapDict 1.0.1
Processing HeapDict-1.0.1-py3.8.egg
HeapDict 1.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg
Searching for locket==0.2.1
Best match: locket 0.2.1
Processing locket-0.2.1-py3.8.egg
locket 0.2.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg
Finished processing dependencies for nvtabular==0.6.0+3.g78c8ae4
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.1.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.0.2.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.1.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.1.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.2.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.2.3.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.1.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.2.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.3.3.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.4.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.5.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.6.0.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 1.6.1.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.4.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.5.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.7.6.linux-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 0.8.1.macosx-10.5-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/pkg_resources/init.py:116: PkgResourcesDeprecationWarning: 10.5-x86-64 is an invalid version and will not be supported in a future release
warnings.warn(
Running black --check
would reformat nvtabular/ops/fill.py
would reformat nvtabular/ops/operator.py
would reformat setup.py
Oh no! π₯ π π₯
3 files would be reformatted, 107 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins8362599707933361944.sh
@rnyak Awesome.
Then, do we still need this notebook, https://github.com/NVIDIA-Merlin/NVTabular/blob/main/examples/getting-started-movielens/inference-HugeCTR/Training-with-HugeCTR.ipynb ?
Click to view CI Results
GitHub pull request #1021 of commit 44e957babd909db09989d5b80b3c990fe07f7087, has merge conflicts.
Running as SYSTEM
Setting status of 44e957babd909db09989d5b80b3c990fe07f7087 to PENDING with url http://10.20.13.93:8080/job/nvtabular_tests/3848/ and message: 'Pending'
Using context: Jenkins Unit Test Run
Building on master in workspace /var/jenkins_home/workspace/nvtabular_tests
using credential nvidia-merlin-bot
Cloning the remote Git repository
Cloning repository https://github.com/NVIDIA-Merlin/NVTabular.git
> git init /var/jenkins_home/workspace/nvtabular_tests/nvtabular # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
> git --version # timeout=10
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/NVIDIA-Merlin/NVTabular.git # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/NVTabular.git
using GIT_ASKPASS to set credentials This is the bot credentials for our CI/CD
> git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/NVTabular.git +refs/pull/1021/*:refs/remotes/origin/pr/1021/* # timeout=10
> git rev-parse 44e957babd909db09989d5b80b3c990fe07f7087^{commit} # timeout=10
Checking out Revision 44e957babd909db09989d5b80b3c990fe07f7087 (detached)
> git config core.sparsecheckout # timeout=10
> git checkout -f 44e957babd909db09989d5b80b3c990fe07f7087 # timeout=10
Commit message: "solved multi-hot issue in movielens example"
> git rev-list --no-walk 21cf20a5b0d00eb3366c97c4351234c40df48a63 # timeout=10
First time build. Skipping changelog.
[nvtabular_tests] $ /bin/bash /tmp/jenkins372624190229744329.sh
Installing NVTabular
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Requirement already satisfied: pip in /var/jenkins_home/.local/lib/python3.8/site-packages (21.3.1)
Requirement already satisfied: setuptools in /var/jenkins_home/.local/lib/python3.8/site-packages (59.4.0)
Requirement already satisfied: wheel in /var/jenkins_home/.local/lib/python3.8/site-packages (0.37.0)
Requirement already satisfied: pybind11 in /var/jenkins_home/.local/lib/python3.8/site-packages (2.8.1)
running develop
running egg_info
creating nvtabular.egg-info
writing nvtabular.egg-info/PKG-INFO
writing dependency_links to nvtabular.egg-info/dependency_links.txt
writing requirements to nvtabular.egg-info/requires.txt
writing top-level names to nvtabular.egg-info/top_level.txt
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
adding license file 'LICENSE'
writing manifest file 'nvtabular.egg-info/SOURCES.txt'
running build_ext
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.8 -c flagcheck.cpp -o flagcheck.o -std=c++17
building 'nvtabular_cpp' extension
creating build
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/cpp
creating build/temp.linux-x86_64-3.8/cpp/nvtabular
creating build/temp.linux-x86_64-3.8/cpp/nvtabular/inference
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/__init__.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/categorify.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o -std=c++17 -fvisibility=hidden -g0
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DVERSION_INFO=0.6.0+4.g44e957b -I./cpp/ -I/var/jenkins_home/.local/lib/python3.8/site-packages/pybind11/include -I/usr/include/python3.8 -c cpp/nvtabular/inference/fill.cc -o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -std=c++17 -fvisibility=hidden -g0
creating build/lib.linux-x86_64-3.8
x86_64-linux-gnu-g++ -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -Wl,-Bsymbolic-functions -Wl,-z,relro -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-3.8/cpp/nvtabular/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/__init__.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/categorify.o build/temp.linux-x86_64-3.8/cpp/nvtabular/inference/fill.o -o build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so
copying build/lib.linux-x86_64-3.8/nvtabular_cpp.cpython-38-x86_64-linux-gnu.so ->
Generating nvtabular/inference/triton/model_config_pb2.py from nvtabular/inference/triton/model_config.proto
Creating /var/jenkins_home/.local/lib/python3.8/site-packages/nvtabular.egg-link (link to .)
nvtabular 0.6.0+4.g44e957b is already the active version in easy-install.pth
Installed /var/jenkins_home/workspace/nvtabular_tests/nvtabular
Processing dependencies for nvtabular==0.6.0+4.g44e957b
Searching for pyarrow==4.0.1
Best match: pyarrow 4.0.1
Adding pyarrow 4.0.1 to easy-install.pth file
Installing plasma_store script to /var/jenkins_home/.local/bin
Using /usr/local/lib/python3.8/dist-packages
Searching for tqdm==4.61.2
Best match: tqdm 4.61.2
Processing tqdm-4.61.2-py3.8.egg
tqdm 4.61.2 is already the active version in easy-install.pth
Installing tqdm script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tqdm-4.61.2-py3.8.egg
Searching for numba==0.54.1
Best match: numba 0.54.1
Adding numba 0.54.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for pandas==1.2.5
Best match: pandas 1.2.5
Processing pandas-1.2.5-py3.8-linux-x86_64.egg
Removing pandas 1.3.3 from easy-install.pth file
Adding pandas 1.2.5 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages/pandas-1.2.5-py3.8-linux-x86_64.egg
Searching for distributed==2021.4.1
Best match: distributed 2021.4.1
Processing distributed-2021.4.1-py3.8.egg
Removing distributed 2021.7.1 from easy-install.pth file
Adding distributed 2021.4.1 to easy-install.pth file
Installing dask-ssh script to /var/jenkins_home/.local/bin
Installing dask-scheduler script to /var/jenkins_home/.local/bin
Installing dask-worker script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages/distributed-2021.4.1-py3.8.egg
Searching for dask==2021.4.1
Best match: dask 2021.4.1
Processing dask-2021.4.1-py3.8.egg
Removing dask 2021.7.1 from easy-install.pth file
Adding dask 2021.4.1 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages/dask-2021.4.1-py3.8.egg
Searching for PyYAML==5.4.1
Best match: PyYAML 5.4.1
Processing PyYAML-5.4.1-py3.8-linux-x86_64.egg
PyYAML 5.4.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg
Searching for numpy==1.20.3
Best match: numpy 1.20.3
Adding numpy 1.20.3 to easy-install.pth file
Installing f2py script to /var/jenkins_home/.local/bin
Installing f2py3 script to /var/jenkins_home/.local/bin
Installing f2py3.8 script to /var/jenkins_home/.local/bin
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for llvmlite==0.37.0
Best match: llvmlite 0.37.0
Processing llvmlite-0.37.0-py3.8-linux-x86_64.egg
llvmlite 0.37.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/llvmlite-0.37.0-py3.8-linux-x86_64.egg
Searching for setuptools==59.4.0
Best match: setuptools 59.4.0
Adding setuptools 59.4.0 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for pytz==2021.3
Best match: pytz 2021.3
Adding pytz 2021.3 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for python-dateutil==2.8.2
Best match: python-dateutil 2.8.2
Adding python-dateutil 2.8.2 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for zict==2.0.0
Best match: zict 2.0.0
Processing zict-2.0.0-py3.8.egg
zict 2.0.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg
Searching for tornado==6.1
Best match: tornado 6.1
Processing tornado-6.1-py3.8-linux-x86_64.egg
tornado 6.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg
Searching for toolz==0.11.1
Best match: toolz 0.11.1
Processing toolz-0.11.1-py3.8.egg
toolz 0.11.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/toolz-0.11.1-py3.8.egg
Searching for tblib==1.7.0
Best match: tblib 1.7.0
Processing tblib-1.7.0-py3.8.egg
tblib 1.7.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg
Searching for sortedcontainers==2.4.0
Best match: sortedcontainers 2.4.0
Processing sortedcontainers-2.4.0-py3.8.egg
sortedcontainers 2.4.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg
Searching for psutil==5.8.0
Best match: psutil 5.8.0
Processing psutil-5.8.0-py3.8-linux-x86_64.egg
psutil 5.8.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg
Searching for msgpack==1.0.2
Best match: msgpack 1.0.2
Processing msgpack-1.0.2-py3.8-linux-x86_64.egg
msgpack 1.0.2 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/msgpack-1.0.2-py3.8-linux-x86_64.egg
Searching for cloudpickle==1.6.0
Best match: cloudpickle 1.6.0
Processing cloudpickle-1.6.0-py3.8.egg
cloudpickle 1.6.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/cloudpickle-1.6.0-py3.8.egg
Searching for click==8.0.1
Best match: click 8.0.1
Processing click-8.0.1-py3.8.egg
click 8.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/click-8.0.1-py3.8.egg
Searching for partd==1.2.0
Best match: partd 1.2.0
Processing partd-1.2.0-py3.8.egg
partd 1.2.0 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg
Searching for fsspec==2021.11.1
Best match: fsspec 2021.11.1
Adding fsspec 2021.11.1 to easy-install.pth file
Using /usr/local/lib/python3.8/dist-packages
Searching for six==1.15.0
Best match: six 1.15.0
Adding six 1.15.0 to easy-install.pth file
Using /var/jenkins_home/.local/lib/python3.8/site-packages
Searching for HeapDict==1.0.1
Best match: HeapDict 1.0.1
Processing HeapDict-1.0.1-py3.8.egg
HeapDict 1.0.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg
Searching for locket==0.2.1
Best match: locket 0.2.1
Processing locket-0.2.1-py3.8.egg
locket 0.2.1 is already the active version in easy-install.pth
Using /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg
Finished processing dependencies for nvtabular==0.6.0+4.g44e957b
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/easy_install.py:156: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
/var/jenkins_home/.local/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
Running black --check
would reformat nvtabular/ops/fill.py
would reformat nvtabular/ops/operator.py
would reformat setup.py
Oh no! π₯ π π₯
3 files would be reformatted, 107 files would be left unchanged.
Build step 'Execute shell' marked build as failure
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://api.GitHub.com/repos/NVIDIA-Merlin/NVTabular/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[nvtabular_tests] $ /bin/bash /tmp/jenkins7655371699406797279.sh