boxrec icon indicating copy to clipboard operation
boxrec copied to clipboard

Add proxy

Open lyudad opened this issue 5 years ago • 4 comments

Hello. Account become blocked very quickly. Do you have opportunity to add proxies as parameter?

lyudad avatar Sep 17 '20 22:09 lyudad

NPM does allow proxies, although I can't recall for requests if you have to set it up through npm config or if environment variables will be enough HTTP_PROXY/HTTPS_PROXY.

. BoxRec has increased their security since this was worked on. Things to avoid are:

  • Too many requests at once. Allow a few seconds between requests
  • Certain pages might trigger the captcha. No workaround at this time

mikedidomizio avatar Sep 18 '20 13:09 mikedidomizio

There might a solution around this by passing requests through serverless lambdas. I have not investigated it as yet. Another approach is simply throttling the requests. In terms of the captcha, you can parse the response and intercept the captcha nd trigger a retry if detected.

panoply avatar Sep 28 '21 14:09 panoply

Yeah, for testing I added a throttle which seems to be fine most of the time. It still does occasionally trip the captcha. As far as the captcha, I haven't found a solution yet.

I'm open to solutions if you come up with something 👍

mikedidomizio avatar Sep 28 '21 14:09 mikedidomizio

Happy days.

I will be working with the module on a side project, so I will see how far I can push it. Boxrec is getting difficult as we progress into a more digital landscape. It's ambitious but I am going to attempt to skin a UX and couple user interaction, twitter voices and generally just breathe some new life across the nexus.

Side note: Thanks for creating this Mike. There are very few boxing enthusiasts and/or former/active pugilists in this field. It's deeply refreshing when you find like minded folks who share a passion for the sweet science together with software engineering.

panoply avatar Sep 28 '21 15:09 panoply