developer Option to use alternatives to Openai

I am trying to use alternatives to openai One alternative is to use https://github.com/go-skynet/LocalAI Another is to use llama.cpp with the python API plugin which I have partially working. I just need to find a good model to use to generate code.

It would be nice to have official support for alternative locally housed alternatives

Jun 08 '23 18:06 apcameron

try this one https://huggingface.co/replit/replit-code-v1-3b/tree/main

Jun 08 '23 18:06 d3287t328

I would like to see an option to choose other local models for noobs like me.

Jun 08 '23 21:06 OWL7seven

Any progress on this yet? Or if someone has forked and implemented it that would be great too.

Jun 11 '23 02:06 Dr-42

@apcameron I wonder would StarCoder be a good model https://huggingface.co/bigcode/starcoder#intended-use

Jun 22 '23 03:06 shusso

@shusso It may be but I do not have enough RAM to try that model on my local computers.

Jun 23 '23 21:06 apcameron

Is anyone looking into this? I'd absolutely love this tool, but using a non-local LLM model is a no-go for me.

Sep 15 '23 04:09 iamjameswalters