voideditor
[Provider] Cohere: [OpenAICompatibleModel Chat + tools]
This PR adds support for Cohere as a model provider via the OpenAI compatibility API, and includes the model command-a-03-2025.
This is a good start! It needs a little work (doesn't compile right now).
We should look into Cohere's free tier the way we did for Gemini and OpenRouter. Is the main reason you want to add Cohere the free tier? If so, it would be great to add a description about the rate limits for the most common models.
This is a good start! It needs a little work (doesn't compile right now).
We should look into Cohere's free tier the way we did for Gemini and OpenRouter. Is the main reason you want to add Cohere the free tier? If so, it would be great to add a description about the rate limits for the most common models.
I work at cohere, and i have been using Void, so the main reason I want to add cohere is personal excitement :)
We should look into Cohere's free tier the way we did for Gemini and OpenRouter. The limits on the free tier are:
- 1000 requests a month
- 20rpm rate limit
as per https://docs.cohere.com/v2/docs/rate-limits
@andrewpareles do you want to give this another look, i think the compiling was fixed?
Can you add a few more models, too? Ideally we’d have all of them, but we definitely at least want all the common ones besides command-a-03-2025. Happy to do this if you don't want to, but maybe you have a better sense of the good models than I do?
@andrewpareles i think we should start with command A and we can add more models as they come out