Michelangiolo Mazzeschi

Thank you @aBurmeseDev `aws ecs register-task-definition --family %name% --task-role-arn %ecs_role_arn% --execution-role-arn %ecs_role_arn% --network-mode bridge --container-definitions name=%container_name%,image=%container_uri%,memory=128,portMappings="[{"containerPort"="7000"},{"hostPort"="7000"},{"protocol"="tcp"` I updated the query to use --network-mode bridge, to make it easier I would...

Running in the same issue, (installation for transformers 2.5.0 is also very problematic, so far unable to try this fix)

hi, i have the same problem Additionally, requirements.txt does not have the PythonGit library which is necessary to run install.py

> Hi @DanqingZ, I'm running gradio Application with FastAPI, how to handle it in such cases? > > Following is the configuration of my gradio application: > > ```python >...

I find out there are some queries that make the search function stall for over 1 minute, then they return 429, regardless of waiting time. Ex. "Malaysia sugar tax, RM0.40...

``` ENV LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/cuda/compat:$LD_LIBRARY_PATH ``` Seems that this solve the problem, however, when checking if cuda is enabled, it return False: from llama_cpp.llama_cpp import load_shared_library import pathlib ``` lib = load_shared_library('llama',pathlib.Path('/root/.local/lib/python3.10/site-packages/llama_cpp/lib'))...