python-craigslist icon indicating copy to clipboard operation
python-craigslist copied to clipboard
verified publisher icon juliomalegria

Request failed

Open damanc7 opened this issue 5 years ago • 3 comments

I'm getting a 'request failed, retrying' I'm polling every 3 mins, should I wait longer? Request failed (('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))). Retrying ...

damanc7 avatar May 30 '20 16:05 damanc7

Capture

damanc7 avatar May 31 '20 02:05 damanc7

Mmmm, might be that Craigslist is throttling your requests? Did this suddently stop working? Does the error go away after not sending further requests for say 1h? If so, it definitely sounds like throttling. Otherwise I could take a deeper look. Can you share what command are you exactly calling, and every how often?

juliomalegria avatar Jun 03 '20 10:06 juliomalegria

It looks to me like you probably have a while loop that doesn't have any wait time ( ex. time.sleep(1) or something) implemented into it. So you're essentially just opening tons of connections to CL which obviously looks like a DDoS attack on their end and gets shut down.

Edit- you say you're polling every 3 mins... but how exactly do you have that implemented?

mnowicky avatar Nov 23 '20 08:11 mnowicky