[Feature] Support Multiple `OpenAI-Compatible` Providers
Support Multiple OpenAI-Compatible Providers.
It is very useful to add multiple third-party vendors at once.
I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .
I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .
Yes, i mean cloud apis, like some api proxy providers. Because it's very difficult to access the services of OpenAI Models, Claude and others in some countries (like China).
I don't think it's possible if you run on local you will be bound by the graphic memory. maybe it makes sens on when you run on apis .
Yes, i mean cloud apis, like some api proxy providers. Because it's very difficult to access the services of OpenAI Models, Claude and others in some countries (like China).
+1 It's Extremely urgently needed ( custom baseURL for each providers is very urgently needed too)
+1, Use different API providers for different models
+1, Now there are more and more providers that provide us the better price for the popular models, not only Open Router.
+1