refinery icon indicating copy to clipboard operation
refinery copied to clipboard

Add further requirements to execution environments

Open FelixKirsch opened this issue 3 years ago • 25 comments

Is your feature request related to a problem? Please describe. I want to import the following libraries in the execution environments:

langdetect==1.0.9
phonenumbers==8.13.0
python-levenshtein==0.20.8
textblob==0.17.1
textstat==0.7.3

Describe the solution you'd like Add the requirements to the exec-env parent image

FelixKirsch avatar Nov 07 '22 13:11 FelixKirsch

langdetect==1.0.9
nltk==3.7
phonenumbers==8.13.0
python-levenshtein==0.20.8
textblob==0.17.1
textstat==0.7.3
translate==3.6.1
spacy==3.4.2
quantulum3==0.7.11
LeXmo==0.1.4

jhoetter avatar Nov 17 '22 13:11 jhoetter

fuzzywuzzy==0.18.0
langdetect==1.0.9
nltk==3.7
phonenumbers==8.13.0
python-levenshtein==0.20.8
textblob==0.17.1
textstat==0.7.3
translate==3.6.1
spacy==3.4.2
quantulum3==0.7.11
LeXmo==0.1.4

LeonardPuettmann avatar Nov 21 '22 10:11 LeonardPuettmann

current requirements included. for new one reopen the issue

JWittmeyer avatar Nov 22 '22 08:11 JWittmeyer

better_profanity==0.7.0
flashtext==2.7

divyanshukatiyar avatar Nov 22 '22 16:11 divyanshukatiyar

stemming==1.0.1

LeonardPuettmann avatar Dec 01 '22 12:12 LeonardPuettmann

nltk.downloader words stopwords wordnet omw-1.4 brown punkt

JWittmeyer avatar Dec 06 '22 10:12 JWittmeyer

current requirements included in base image v1.7.0. for new one reopen the issue

JWittmeyer avatar Dec 06 '22 10:12 JWittmeyer

openai==0.25.0

LeonardPuettmann avatar Dec 16 '22 12:12 LeonardPuettmann

bayesian-optimization==1.4.2
google-search-results==2.4.1
vaderSentiment==3.3.2

LeonardPuettmann avatar Jan 10 '23 09:01 LeonardPuettmann

included in image 1.8.0 reopen with new requirements

JWittmeyer avatar Jan 26 '23 15:01 JWittmeyer

textacy==0.12.0

LeonardPuettmannKern avatar Feb 22 '23 15:02 LeonardPuettmannKern

included in image 1.8.1 reopen with new requirements

JWittmeyer avatar Feb 23 '23 11:02 JWittmeyer

scikit-optimize==0.9.0

divyanshu404 avatar Feb 27 '23 15:02 divyanshu404

included in exec env image 1.8.2 reopen with new requirements

JWittmeyer avatar Feb 28 '23 12:02 JWittmeyer

holidays==0.21.13

JWittmeyer avatar Apr 17 '23 07:04 JWittmeyer

sumy==0.11.0

JWittmeyer avatar May 09 '23 14:05 JWittmeyer

Please update OpenAI from openai==0.25.0 to openai==0.27.7. Otherwise, GPT-3.5-Turbo and GPT-4 won't be usable in refinery. Thanks! :)

LeonardPuettmannKern avatar May 24 '23 19:05 LeonardPuettmannKern

included in exec env image 1.11.0 reopen with new requirements

FelixKirschKern avatar Jun 01 '23 10:06 FelixKirschKern

Please include knowledge==0.3

SvenjaKern avatar Jun 23 '23 11:06 SvenjaKern

PyPDF2==3.0.1

SvenjaKern avatar Sep 06 '23 11:09 SvenjaKern

@SvenjaKern I added pypdf==3.15.5 instead. pypdf and pypdf2 have the same maintainer and he wants the community to switch to pypdf (https://stackoverflow.com/questions/63199763/maintained-alternatives-to-pypdf2, first answer). He states that both should be similar. PyPDF2 also raised a dependabot alert, which also suggested the switch to pypdf as fix.

Please check if the new brick also works with pypdf. If that's the case, you can simply close the issue. Otherwise, I will add pypdf2 instead.

FelixKirschKern avatar Sep 08 '23 11:09 FelixKirschKern

@FelixKirschKern Please add tiktoken==0.4.0 and remove pypdf==3.15.5 if it was added, as it's not needed. Thanks!

LeonardPuettmannKern avatar Sep 28 '23 07:09 LeonardPuettmannKern

also increase psycopg2-binary version to psycopg2-binary==2.9.7

and urllib3 to 1.26.17 where possible

JWittmeyer avatar Sep 28 '23 07:09 JWittmeyer

Added tiktoken==0.4.0 and removed pypdf==3.15.5, updated urllib3

FelixKirschKern avatar Oct 10 '23 14:10 FelixKirschKern

increase psycopg2-binary version to psycopg2-binary==2.9.7 (or maybe even higher) add spacy ja support to exec env (add dockerfile run line for: RUN pip3 install spacy[ja]) - also for gateway but probably not base image

JWittmeyer avatar Nov 07 '23 10:11 JWittmeyer

Updated psycopg2-binary and added language support for japanese

FelixKirschKern avatar Mar 04 '24 16:03 FelixKirschKern