devika
devika copied to clipboard
[FEATURE] wait 60 seconds on HTTP 429 response
Is your feature request related to a problem? Please describe.
Devika will stop after an HTTP 429 response
Describe the solution you'd like
sleep for 60 seconds on an HTTP 429 response and then retry again
Describe alternatives you've considered
redo the entire project
Additional context
24.05.02 19:16:04: root: ERROR : Error code: 429 - {'error': {'message': 'Rate limit reached for model mixtral-8x7b-32768in organizationPLACEHOLDER on tokens per minute (TPM): Limit 5000, Used 0, Requested ~5597. Please try again in 7.164s. Visit https://console.groq.com/docs/rate-limits for more information.', 'type': 'tokens', 'code': 'rate_limit_exceeded'}}