void icon indicating copy to clipboard operation
void copied to clipboard

[Feature] Support Multiple `OpenAI-Compatible` Providers

Open suisanka opened this issue 8 months ago • 6 comments

Support Multiple OpenAI-Compatible Providers. It is very useful to add multiple third-party vendors at once.

suisanka avatar May 16 '25 17:05 suisanka

I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .

izdrail avatar May 16 '25 21:05 izdrail

I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .

Yes, i mean cloud apis, like some api proxy providers. Because it's very difficult to access the services of OpenAI Models, Claude and others in some countries (like China).

suisanka avatar May 17 '25 01:05 suisanka

I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .

Yes, i mean cloud apis, like some api proxy providers. Because it's very difficult to access the services of OpenAI Models, Claude and others in some countries (like China).

+1 It's Extremely urgently needed ( custom baseURL for each providers is very urgently needed too)

wukemon avatar May 17 '25 08:05 wukemon

+1, Use different API providers for different models

AlexBlack772 avatar May 19 '25 14:05 AlexBlack772

+1, Now there are more and more providers that provide us the better price for the popular models, not only Open Router.

buiducnhat avatar May 20 '25 02:05 buiducnhat

+1

mrmikkl avatar Oct 17 '25 12:10 mrmikkl