pydoxtools icon indicating copy to clipboard operation
pydoxtools copied to clipboard

after install, error on import

Open kr0b3rts opened this issue 2 years ago • 8 comments

Picking up from email as requested ....

Here is the traceback. The exception occurs on the import pydoxtools step

Traceback (most recent call last): File "testpydox.py", line 1, in import pydoxtools as pdx File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/init.py", line 9, in from .document import Document, DocumentBag, DatabaseSource File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/document.py", line 25, in from . import dask_operators File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/dask_operators.py", line 12, in from .document_base import Pipeline File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/document_base.py", line 239, in class DocumentLocation(pydantic.BaseModel): File "pydantic/main.py", line 178, in pydantic.main.ModelMetaclass.new File "pydantic/typing.py", line 400, in pydantic.typing.resolve_annotations

File "/usr/lib/python3.8/typing.py", line 270, in _eval_type return t._evaluate(globalns, localns) File "/usr/lib/python3.8/typing.py", line 518, in _evaluate eval(self.forward_code, globalns, localns), File "", line 1, in TypeError: 'type' object is not subscriptable

kr0b3rts avatar Sep 06 '23 17:09 kr0b3rts

ok, thank you for the error log. I suspect its because of the python3.8 version you're using. Python 3.10 works much better with pydoxtools. Let me check that and see if I can reproduce the error!

yeus avatar Sep 06 '23 17:09 yeus

yes. working on removing some of the python3.10 dependencies...

yeus avatar Sep 08 '23 21:09 yeus

Thanks. My environment may need some cleanup as well. i attempted to create a venv and install 3.10, but was then having issues in that venv getting pip to work to even run the install! (This is Ubuntu 20.04 in WSL ... what could go wrong? ;-) Ken

On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede @.***> wrote:

yes. working on removing some of the python3.10 dependencies...

— Reply to this email directly, view it on GitHub https://github.com/Xyntopia/pydoxtools/issues/1#issuecomment-1712268330, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE . You are receiving this because you authored the thread.Message ID: @.***>

--

@.*** @.***>

kr0b3rts avatar Sep 08 '23 22:09 kr0b3rts

I keep trying to install.

getting hung on

  pygraphviz/graphviz_wrap.c:168:11: fatal error: Python.h: No such

file or directory 168 | # include <Python.h> | ^~~~~~~~~~ compilation terminated. error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for pygraphviz

On Fri, Sep 8, 2023 at 3:15 PM Ken Roberts @.***> wrote:

Thanks. My environment may need some cleanup as well. i attempted to create a venv and install 3.10, but was then having issues in that venv getting pip to work to even run the install! (This is Ubuntu 20.04 in WSL ... what could go wrong? ;-) Ken

On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede @.***> wrote:

yes. working on removing some of the python3.10 dependencies...

— Reply to this email directly, view it on GitHub https://github.com/Xyntopia/pydoxtools/issues/1#issuecomment-1712268330, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE . You are receiving this because you authored the thread.Message ID: @.***>

--

@.*** @.***>

--

@.*** @.***>

kr0b3rts avatar Sep 18 '23 22:09 kr0b3rts

okay, got past the Python.h issue. (needed sudo apt-get install libpython3.10-dev)

Now the following on import. any quick pointers to what is missing

$ python3 Python 3.10.13 (main, Aug 25 2023, 13:20:03) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import pydoxtools as pdx installed pandoc version 2.5, which doesn't support rtf file format!in order to be able to use rtf, you need to install a pandoc version >= 2.14.2Checkout this link here: https://github.com/jgm/pandoc/releases/tag/2.19.2 Traceback (most recent call last): File "", line 1, in File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/init.py", line 9, in from .document import Document, DocumentBag, DatabaseSource File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/document.py", line 640, in f"Currently available models are: {extract_nlpchat.gpt4_models()}" File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/extract_nlpchat.py", line 71, in gpt4_models from gpt4all import GPT4All File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/init.py", line 1, in from .gpt4all import Embed4All, GPT4All # noqa File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/gpt4all.py", line 13, in from . import pyllmodel File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/pyllmodel.py", line 48, in llmodel = load_llmodel_library() File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/pyllmodel.py", line 43, in load_llmodel_library llmodel_lib = ctypes.CDLL(llmodel_dir) File "/usr/lib/python3.10/ctypes/init.py", line 374, in init self._handle = _dlopen(self._name, mode) OSError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /home/kroberts/.local/lib/python3.10/site-packages/gpt4all/llmodel_DO_NOT_MODIFY/build/libllmodel.so)

On Mon, Sep 18, 2023 at 3:37 PM Ken Roberts @.***> wrote:

I keep trying to install.

getting hung on

  pygraphviz/graphviz_wrap.c:168:11: fatal error: Python.h: No such

file or directory 168 | # include <Python.h> | ^~~~~~~~~~ compilation terminated. error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for pygraphviz

On Fri, Sep 8, 2023 at 3:15 PM Ken Roberts @.***> wrote:

Thanks. My environment may need some cleanup as well. i attempted to create a venv and install 3.10, but was then having issues in that venv getting pip to work to even run the install! (This is Ubuntu 20.04 in WSL ... what could go wrong? ;-) Ken

On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede @.***> wrote:

yes. working on removing some of the python3.10 dependencies...

— Reply to this email directly, view it on GitHub https://github.com/Xyntopia/pydoxtools/issues/1#issuecomment-1712268330, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE . You are receiving this because you authored the thread.Message ID: @.***>

--

@.*** @.***>

--

@.*** @.***>

--

@.*** @.***>

kr0b3rts avatar Sep 26 '23 22:09 kr0b3rts

hm... interesting error I haven't seen this one before. Does this one here help you?

https://stackoverflow.com/questions/65349875/where-can-i-find-glibcxx-3-4-29

Things have progress, so I am searching for alternatives to gpt4all right now though. I hope the hf transformers library will get to a point where it can run the local quantized models out-of-the-box

yeus avatar Jan 12 '24 17:01 yeus

i recently got a new system, so i'll try this in a much fresher environment soon!

On Fri, Jan 12, 2024 at 9:57 AM Thomas Meschede @.***> wrote:

hm... interesting error I haven't seen this one before. Does this one here help you?

https://stackoverflow.com/questions/65349875/where-can-i-find-glibcxx-3-4-29

Things have progress, so I am searching for alternatives to gpt4all right now though. I hope the hf transformers library will get to a point where it can run the local quantized models out-of-the-box

— Reply to this email directly, view it on GitHub https://github.com/Xyntopia/pydoxtools/issues/1#issuecomment-1889727404, or unsubscribe https://github.com/notifications/unsubscribe-auth/A6JP6FSDDT5XQUCEFBV72NTYOF2QXAVCNFSM6AAAAAA4NUQ5IGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBZG4ZDONBQGQ . You are receiving this because you authored the thread.Message ID: @.***>

--

@.*** @.***>

kr0b3rts avatar Jan 12 '24 18:01 kr0b3rts

just released a new version. maybe it works better now! I updated a lot of the dependencies...

yeus avatar Jan 28 '24 21:01 yeus