SMRY icon indicating copy to clipboard operation
SMRY copied to clipboard

[feature] Support Ollama

Open GeorgelPreput opened this issue 1 year ago • 2 comments

Would it be possible to integrate with Ollama, in addition to OpenAI for those of us who would like a self-hosted solution?

I'm no JS dev, but looking at the code it seems the use of OpenAI is fairly localized, and the Ollama API is not overly complex either. You would need to add an extra config for what model is being used, though.

GeorgelPreput avatar Aug 10 '24 06:08 GeorgelPreput

...also happy to chip in, if you have a Patreon or something

GeorgelPreput avatar Aug 10 '24 06:08 GeorgelPreput

Seconding this but also I think the OpenAI API is somewhere for things like LiteLLM? Not sure

TomLucidor avatar Oct 24 '24 01:10 TomLucidor