abdinal1

Not finding a useful Ollama model for stock example

6

Im running the stock example with open source models on Ollama. I have tried various open models (did not write my own modelfile) and it always ended up either delivering...

Getting timeout error when request takes longer than 5 minutes

5

I get `HTTPSConnectionPool(host='foobar.com', port=443): Max retries exceeded with url: /foo/bar` With certain models which take more than 5 minutes for an inference. If I swap to a tinyer model it...