LangChain icon indicating copy to clipboard operation
LangChain copied to clipboard

Serve: Provide OpenAI SDK compatible API

Open HavenDV opened this issue 1 year ago • 5 comments

What would you like to be added:

Why is this needed:

Anything else we need to know?

HavenDV avatar Apr 30 '24 21:04 HavenDV

It should allow https://github.com/open-webui/open-webui usage

HavenDV avatar May 18 '24 11:05 HavenDV

Could you please add non-ssl url (for example, LM Studio's open ai using url for local server is http://localhost:1234 by default) supported in OpenAIProvider?

erisonliang avatar May 21 '24 09:05 erisonliang

image. image you can use this constructor and https = false in OpenAIClientSettings to bypass it

HavenDV avatar May 21 '24 09:05 HavenDV

I will soon change the OpenAI sdk (it will be completely generated from their official OpenAPI and will contain all the features at the time of their release) so there is no point in changing anything yet

HavenDV avatar May 21 '24 09:05 HavenDV

Thank you so much. I'll try it soon.

erisonliang avatar May 22 '24 23:05 erisonliang