devika icon indicating copy to clipboard operation
devika copied to clipboard

[FEATURE] wait 60 seconds on HTTP 429 response

Open Polygons1 opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe.

Devika will stop after an HTTP 429 response

Describe the solution you'd like

sleep for 60 seconds on an HTTP 429 response and then retry again

Describe alternatives you've considered

redo the entire project

Additional context

24.05.02 19:16:04: root: ERROR : Error code: 429 - {'error': {'message': 'Rate limit reached for model mixtral-8x7b-32768in organizationPLACEHOLDER on tokens per minute (TPM): Limit 5000, Used 0, Requested ~5597. Please try again in 7.164s. Visit https://console.groq.com/docs/rate-limits for more information.', 'type': 'tokens', 'code': 'rate_limit_exceeded'}}

Polygons1 avatar May 02 '24 16:05 Polygons1