How to connect to LLM compatible with OpenAI but OpenAI

[roy-sr]

I want to connect DeepInfra hosted models. They have OpenAI type connection. How to do that? For other softwares, only changing the OpenAI URL, Model and passing the key connects to the DeepInfra models

[waleedlatif1]

@roy-sr hey, we are looking into allowing users to specify a custom base url, so we can re-use the openai library but use your own base url & model name

[Jakdaw]

The 'Azure' provider already allows you to chose API base URL, but you'd still be stuck with static list of Azure model names.