openui icon indicating copy to clipboard operation
openui copied to clipboard

Ollama models not loading

Open ZeyoYT opened this issue 1 year ago • 2 comments

i am going to use ollama with this, as i dont own openai key or anthropic key, i still added them to the env var in docker compose, but still asking for login via github, and even if i do try to login, it wont allow me to, the github page gives 404

i have it running in production mode, and i also have a domain attached to it, its also behind a basic auth

ZeyoYT avatar Sep 10 '24 15:09 ZeyoYT

Update, after looking thru some issues, i removed OPENUI_ENVIRONMENT=production, and it worked, while i cannot access the ui locally thru the ip ( as its running in a remote machine ), i am able to access it with the domain as nginx and openui are running in same machine maybe, but issue is that there are no models being loaded

ollama is running in a remote machine and its accessible because my other apps that uses ollama are working. the env variable i am using in docker for ollama is

OLLAMA_HOST=http://192.168.0.121:11434

ZeyoYT avatar Sep 10 '24 16:09 ZeyoYT

Hi @ZeyoYT,

It seems the issue arises from the OLLAMA_HOST environment variable. Ensure that the IP address that you are using, is accessible from your Docker container. If the container is on the same host as Ollama, set OLLAMA_HOST to http://host.docker.internal:11434. If on a different host, verify network connectivity between the container and the Ollama server.

confirm that the Ollama server is running and listening on port 11434.

raman0c17 avatar Nov 19 '24 06:11 raman0c17