Matthieu Beaumont
Matthieu Beaumont
https://github.com/ollama/ollama/blob/main/docs/faq.md#where-are-models-stored
Problem still present with llava:34b-v1.6 despite the use of an even larger context size
this works literally the same way as with models, you need to find a embedding model in gguf format and use it in a ModelFile (see https://github.com/ollama/ollama/blob/main/docs/modelfile.md).
> Maybe I am confused but I am not sure I understand how embedding works with ollama. Usually, the embedding model is different to the chat model (i.e. intfloat/multilingual-e5-small vs....
> Maybe I am confused but I am not sure I understand how embedding works with ollama. Usually, the embedding model is different to the chat model (i.e. intfloat/multilingual-e5-small vs....
ollama is already supported
> > Doesn't ollama have OpenAI compatibility. > > https://ollama.com/blog/openai-compatibility > > Yup but for that you would need to edit the domain in the project of the OpenAI api!...
> Why OLLAMA_HOST is not working with langchain? try with base_url as shown in this [tutorial ](https://github.com/jmorganca/ollama/blob/main/docs/tutorials/langchainpy.md)
I think we need an admin section
see [#1062](https://github.com/mckaywrigley/chatbot-ui/pull/1062)