ratelimit icon indicating copy to clipboard operation
ratelimit copied to clipboard

Support for requests-toolbelt

Open leeprevost opened this issue 5 years ago • 1 comments

I'm using the requests extension called requests-toolbelt which allows for mult-threaded requests. I believe the algorithm feeds multiple URLs to a requests.Session object and threads them up in a pool.

Can this be adapted to do rate limit/throttling for APIs that limit requests to something like 20 requests per second?

https://toolbelt.readthedocs.io/en/latest/

leeprevost avatar Sep 21 '20 15:09 leeprevost

Look at my "Usage note" issue for one way around this.

samwyse avatar Jul 24 '21 12:07 samwyse