anomalyco
[Feature] : Add Nebius Token Factory Models Support
It currently supports multiple LLM providers out of the box. It would be great to add Nebius AI Studio as an additional provider.
Nebius AI Studio offers:
- High-performance LLMs with low-latency streaming
- Tool calling support
- Competitive pricing and scalability
- Compatibility with OpenAI-compatible APIs (making integration straightforward)
This would give developers more flexibility and allow them to try Nebius models alongside other providers already supported.
This issue might be a duplicate of existing issues. Please check:
- #2784: Request to add agentrouter.org provider support - similar provider addition request
- #2901: Request for OpenAI-compatible /v1/models endpoint - mentions OpenAI-compatible APIs integration
- #2781: Request to add Gemini model support - similar model/provider addition request
- #2746: AWS Bedrock custom inference profiles support - another provider enhancement request
Feel free to ignore if none of these address your specific case.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
If this is something you'd like to contribute it'd be welcome, just so you know we have a model list: https://github.com/sst/models.dev
And adding Nebius models there would be first step
Once that is done it would be pretty easy to document how to use it in our docs.
Ofc you should be able to use Nebius right now see how to make a custom provider: https://opencode.ai/docs/providers/#custom-provider
If more people ask for this it will be prioritized but right now we have a few bigger ticket items to take care of so just forewarning
Hey @rekram1-node ,
I can work on this. So, First I will add nebius to models.dev after that we can move forward
Hey @rekram1-node ,
I've made the PR on Models.dev
https://github.com/sst/models.dev/pull/271
Should I wait for it to get merged or can i make the PR for the Docs update here?
you can go ahead and make PR here too just link to models.dev one and leave a note saying that the models.dev pr should be merged first
I can't approve models.dev prs but other people could
Hey @rekram1-node
models.dev PR has been merged. Can you please merge this PR?