matatonic

FYI, I updated #3499 with an update on the openai api for oobabooga/text-generator-webui.

oobabooga/text-generation-webui#1475 is mine, I just wanted to mention that I've updated it and done some testing with langchain... Frankly, It doesn't work well yet. Things like assuming zero shot json...

I reviewed the #990 but I don't think it applied to this, the websocket streaming code is very different. I did manage to fix up the stopping strings though, so...

@drndos I looked over their code and I changed a couple parts (added some extra stopping strings standard, I think I fixed why it's always replying as system too, they...

@oobabooga I think this is a good start, it seems to work well enough for a number of use cases.

@oobabooga I'm not sure how you feel about this extension, but just as a heads up gpt4free ( a similar api to openai ) just got a takedown notice from...

Updated to include the embeddings API. I used SentenceTransformer with the all-MiniLM-L6-v2 model, seems to work well. @oobabooga

> Thank you very much for your contribution. I have tested the interface and found that it performs almost identically to OpenAI's API. However, I'm not sure why when I...

> This is the .env: ```################################################################################ > > ### LLM PROVIDER > ################################################################################ > > ### OPENAI > ## OPENAI_API_KEY - OpenAI API Key (Example: my-openai-api-key) > ## TEMPERATURE -...

1536 is the standard sized embedding from OpenAI's text-embedding-ada-002 model, the current default. The embeddings from that model are not compatible with the embeddings from this - ie. you cannot...