crewAI icon indicating copy to clipboard operation
crewAI copied to clipboard

Request: Ability to limit the amount of LLM API calls per minute

Open mindwellsolutions opened this issue 2 years ago • 1 comments

When using CrewAI with the Free Gemini Pro API that has a limit of 60 API calls per minute. It would be incredibly helpful to have a simple way to define the max LLM API calls that can take place per minute, so people can use free LLM API's without going over the max threshold which blocks access for an hour or more.

Much thanks in advance!

mindwellsolutions avatar Jan 05 '24 19:01 mindwellsolutions

Yes Please add Google gemini Model support

haseeb-heaven avatar Jan 08 '24 02:01 haseeb-heaven