OpenWebUI-Tools icon indicating copy to clipboard operation
OpenWebUI-Tools copied to clipboard

[bug] Ollama tool use in user-output

Open Asher9971 opened this issue 1 year ago • 8 comments

Hi, do you know about the "load failed" error that appears when complex tasks take longer to complete?

Sometimes i try the same prompt again and then it works. For "easy" prompts like "translate..." or something i never get the load failed error message.

Maybe there is a default timeout somewhere? I use llama3.1:8b-instruct-q8_0 for small and medium and llama3.1:70b-instruct-q4_K_S for large and huge. Running on a RTX 6000 48GB

Asher9971 avatar Oct 06 '24 10:10 Asher9971