Requirements.txt completely out of date

Open TheKings1ayer opened this issue 5 years ago • 0 comments

SimplyEmail Version

All the dependencies, even after correcting many in the requirements.txt file, rely on old python libraries, namely pdfminer etc. py 2.*

OS Information (Linux flavor, Python version)

Kali 2020.2

Expected behavior and description of the error, including any actions taken immediately prior to the error. The more detail the better.

Errors out, even after going into requirements.txt and editing to the version it should use. Finding this a lot with different tools having been made for previous versions of Kali, 2020.2 requires up-to-date py libraries all in 3.x and above. This is if I try the 'onelinesetup' Which worked worse than my own attempt at requirements.txt

Screenshot of error, embedded text output, or Pastebin link to the error

ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-7_v8l1tl/BeautifulSoup/setup.py'"'"'; file='"'"'/tmp/pip-install-7_v8l1tl/BeautifulSoup/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-07d428wr
cwd: /tmp/pip-install-7_v8l1tl/BeautifulSoup/
Complete output (6 lines):
Traceback (most recent call last):
File "", line 1, in
File "/tmp/pip-install-7_v8l1tl/BeautifulSoup/setup.py", line 22
print "Unit tests have failed!"
^
SyntaxError: Missing parentheses in call to 'print'. Did you mean print("Unit tests have failed!")?
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

THIS IS FROM WHEN I RUN THE MODIFIED REQUIREMENTS.TXT pip install -r requirments.txt
Requirement already satisfied: beautifulsoup4==4.9.1 in /usr/lib/python3/dist-packages (from -r requirments.txt (line 2)) (4.9.1)
Requirement already satisfied: certifi==2017.7.27.1 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 3)) (2017.7.27.1)
Requirement already satisfied: chardet==3.0.4 in /usr/lib/python3/dist-packages (from -r requirments.txt (line 4)) (3.0.4)
Requirement already satisfied: configparser==3.5.0 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 5)) (3.5.0)
Requirement already satisfied: dnspython==1.15.0 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 6)) (1.15.0)
Requirement already satisfied: docx2txt==0.6 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 7)) (0.6)
Requirement already satisfied: html5lib==0.999999999 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 8)) (0.999999999)
Requirement already satisfied: idna==2.6 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 9)) (2.6)
Requirement already satisfied: mechanize==0.4.5 in /usr/lib/python3/dist-packages (from -r requirments.txt (line 10)) (0.4.5)
Requirement already satisfied: pdfminer==20191125 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 11)) (20191125)
Requirement already satisfied: python-magic==0.4.13 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 12)) (0.4.13)
Requirement already satisfied: requests==2.18.4 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 13)) (2.18.4)
Requirement already satisfied: six==1.11.0 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 14)) (1.11.0)
Requirement already satisfied: urllib3==1.22 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 15)) (1.22)
Requirement already satisfied: webencodings==0.5.1 in /usr/lib/python3/dist-packages (from -r requirments.txt (line 16)) (0.5.1)
Requirement already satisfied: xlsx2csv==0.7.3 in /usr/local/lib/python3.8/dist-packages (from -r requirments.txt (line 17)) (0.7.3)
Collecting XlsxWriter==1.0.2
Using cached XlsxWriter-1.0.2-py2.py3-none-any.whl (139 kB)
Collecting lxml==4.1.0
Using cached lxml-4.1.0.tar.gz (4.2 MB)
Processing /root/.cache/pip/wheels/cc/39/5e/dc460b82bc7dc7c5d7850ac163dcb815d5b621dfd8d5fd93b1/coverage-4.4.1-cp38-cp38-linux_x86_64.whl
Collecting coveralls==1.2.0
Using cached coveralls-1.2.0-py2.py3-none-any.whl (17 kB)
Collecting nose==1.3.7
Using cached nose-1.3.7-py3-none-any.whl (154 kB)
Processing /root/.cache/pip/wheels/f1/e6/83/b86a6a31f516e5a74e6720d0fe3c6937488952805905697bf1/fake_useragent-0.1.8-py3-none-any.whl
Requirement already satisfied: setuptools>=18.5 in /usr/lib/python3/dist-packages (from html5lib==0.999999999->-r requirments.txt (line 8)) (46.1.3)
Requirement already satisfied: pycryptodome in /usr/local/lib/python3.8/dist-packages (from pdfminer==20191125->-r requirments.txt (line 11)) (3.9.7)
Processing /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c/docopt-0.6.2-py2.py3-none-any.whl
Building wheels for collected packages: lxml
Building wheel for lxml (setup.py) ... |

If complicated error please provide (.SimplyEmail.log) in pastebin/gist /or code text block for the scrape.

To increase logging go to Helpers/helpers.py -- line 144 and change to "logger.setLevel(logging.DEBUG)"

Any additional information

ERROR: Command errored out with exit status 1:
command: /usr/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-jcc5rh0v/lxml/setup.py'"'"'; file='"'"'/tmp/pip-install-jcc5rh0v/lxml/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-yi3l58sv
cwd: /tmp/pip-install-jcc5rh0v/lxml/
Complete output (175 lines):
Building lxml version 4.1.0.
Building without Cython.
Using build configuration of libxslt 1.1.32
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-3.8
creating build/lib.linux-x86_64-3.8/lxml
copying src/lxml/ElementInclude.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/init.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/usedoctest.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/builder.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/doctestcompare.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/sax.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/_elementpath.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/cssselect.py -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/pyclasslookup.py -> build/lib.linux-x86_64-3.8/lxml
creating build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/init.py -> build/lib.linux-x86_64-3.8/lxml/includes
creating build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/_html5builder.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/_setmixin.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/init.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/clean.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/usedoctest.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/builder.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/html5parser.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/soupparser.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/diff.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/formfill.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/ElementSoup.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/defs.py -> build/lib.linux-x86_64-3.8/lxml/html
copying src/lxml/html/_diffcommand.py -> build/lib.linux-x86_64-3.8/lxml/html
creating build/lib.linux-x86_64-3.8/lxml/isoschematron
copying src/lxml/isoschematron/init.py -> build/lib.linux-x86_64-3.8/lxml/isoschematron
copying src/lxml/etree.h -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/etree_api.h -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/lxml.etree.h -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/lxml.etree_api.h -> build/lib.linux-x86_64-3.8/lxml
copying src/lxml/includes/htmlparser.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/schematron.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/c14n.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/config.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xinclude.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/dtdvalid.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/uri.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/init.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/tree.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xpath.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/relaxng.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xmlschema.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xslt.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/etreepublic.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xmlparser.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/xmlerror.pxd -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/etree_defs.h -> build/lib.linux-x86_64-3.8/lxml/includes
copying src/lxml/includes/lxml-version.h -> build/lib.linux-x86_64-3.8/lxml/includes
creating build/lib.linux-x86_64-3.8/lxml/isoschematron/resources
creating build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/rng
copying src/lxml/isoschematron/resources/rng/iso-schematron.rng -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/rng
creating build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl
copying src/lxml/isoschematron/resources/xsl/XSD2Schtrn.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl
copying src/lxml/isoschematron/resources/xsl/RNG2Schtrn.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl
creating build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_skeleton_for_xslt1.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_svrl_for_xslt1.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_abstract_expand.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_dsdl_include.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/iso_schematron_message.xsl -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
copying src/lxml/isoschematron/resources/xsl/iso-schematron-xslt1/readme.txt -> build/lib.linux-x86_64-3.8/lxml/isoschematron/resources/xsl/iso-schematron-xslt1
running build_ext
building 'lxml.etree' extension
creating build/temp.linux-x86_64-3.8
creating build/temp.linux-x86_64-3.8/src
creating build/temp.linux-x86_64-3.8/src/lxml
x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DCYTHON_CLINE_IN_TRACEBACK=1 -I/usr/include/libxml2 -Isrc -Isrc/lxml/includes -I/usr/include/python3.8 -c src/lxml/etree.c -o build/temp.linux-x86_64-3.8/src/lxml/etree.o -w
src/lxml/etree.c: In function ‘PyxExceptionSave’:
src/lxml/etree.c:243273:21: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243273 | type = tstate->exc_type;
| ^~
| curexc_type
src/lxml/etree.c:243274:22: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243274 | value = tstate->exc_value;
| ^
| curexc_value
src/lxml/etree.c:243275:19: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243275 | tb = tstate->exc_traceback;
| ^~~
| curexc_traceback
src/lxml/etree.c: In function ‘PyxExceptionReset’:
src/lxml/etree.c:243282:24: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243282 | tmp_type = tstate->exc_type;
| ^~
| curexc_type
src/lxml/etree.c:243283:25: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243283 | tmp_value = tstate->exc_value;
| ^
| curexc_value
src/lxml/etree.c:243284:22: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243284 | tmp_tb = tstate->exc_traceback;
| ^~~
| curexc_traceback
src/lxml/etree.c:243285:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243285 | tstate->exc_type = type;
| ^~
| curexc_type
src/lxml/etree.c:243286:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243286 | tstate->exc_value = value;
| ^
| curexc_value
src/lxml/etree.c:243287:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243287 | tstate->exc_traceback = tb;
| ^~~
| curexc_traceback
src/lxml/etree.c: In function ‘PyxGetException’:
src/lxml/etree.c:243357:24: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243357 | tmp_type = tstate->exc_type;
| ^~
| curexc_type
src/lxml/etree.c:243358:25: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243358 | tmp_value = tstate->exc_value;
| ^
| curexc_value
src/lxml/etree.c:243359:22: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243359 | tmp_tb = tstate->exc_traceback;
| ^~~
| curexc_traceback
src/lxml/etree.c:243360:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243360 | tstate->exc_type = local_type;
| ^~
| curexc_type
src/lxml/etree.c:243361:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243361 | tstate->exc_value = local_value;
| ^
| curexc_value
src/lxml/etree.c:243362:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243362 | tstate->exc_traceback = local_tb;
| ^~~
| curexc_traceback
src/lxml/etree.c: In function ‘PyxExceptionSwap’:
src/lxml/etree.c:243695:24: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243695 | tmp_type = tstate->exc_type;
| ^~
| curexc_type
src/lxml/etree.c:243696:25: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243696 | tmp_value = tstate->exc_value;
| ^
| curexc_value
src/lxml/etree.c:243697:22: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243697 | tmp_tb = tstate->exc_traceback;
| ^~~
| curexc_traceback
src/lxml/etree.c:243698:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
243698 | tstate->exc_type = type;
| ^~
| curexc_type
src/lxml/etree.c:243699:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_value’; did you mean ‘curexc_value’?
243699 | tstate->exc_value = value;
| ^
| curexc_value
src/lxml/etree.c:243700:13: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_traceback’; did you mean ‘curexc_traceback’?
243700 | tstate->exc_traceback = tb;
| ^
| curexc_traceback
src/lxml/etree.c: In function ‘PyxReturnWithStopIteration’:
src/lxml/etree.c:244741:24: error: ‘PyThreadState’ {aka ‘struct _ts’} has no member named ‘exc_type’; did you mean ‘curexc_type’?
244741 | if (!__pyx_tstate->exc_type) {
| ^~
| curexc_type
Compile failed: command 'x86_64-linux-gnu-gcc' failed with exit status 1
creating tmp
cc -I/usr/include/libxml2 -I/usr/include/libxml2 -c /tmp/xmlXPathInitj52pyyn6.c -o tmp/xmlXPathInitj52pyyn6.o
cc tmp/xmlXPathInitj52pyyn6.o -lxml2 -o a.out
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

ERROR: Failed building wheel for lxml

Jun 07 '20 06:06 TheKings1ayer