abenassi
What to do if I got banned by Google?
It seems I've been banned by google. Now with only one request, I got HTTP 429 error: too many requests. I am wondering how to remove the ban.
Is it possible to add some payment feature? I don't mind to paying google for using their engine if it doesn't cost too much.
I've had the same issue in the past, just try spoofing your ip address by using a vpn network or some kind of proxies.
I've had the same issue, just add time.sleep(2) in your loop/requests. The 429 only happens because you are requesting too much in a given amount of time.
I am getting 429 even if I wait and make single request at the time
I have met the same issue. Have you solved it?
After a day, I am unbanned. I tried tor, but it didn't work. One workaround if you need it quick would be to use something like repl.it and install Google-Search-API package
After a day, I am unbanned. I tried tor, but it didn't work. One workaround if you need it quick would be to use something like repl.it and install Google-Search-API package
Why repl.it can solve this problem?
How about add time.sleep() between different requests? Thanks!
before I added sleep, they already banned me (for a day I think) and if you want to execute your script in ban period, you can run it with VPN (or some remote server). Since I don't own VPN nor remote server I used repl to run the script.
Have you tried to run requests through a third-party proxy? For example webshare.io, or something like that. I am not sure, but there should be less chance of getting banned because you are going through different ips each time.
@RayLei Rotate proxies and user agents on each request and add a delay between similar requests. Check the quality of proxies you use, because some cheap proxies are overused and Google responds with captcha more quickly.
If you don't mind paying to extract data from Google search results, you can use SerpApi. It supports everything this package does and much more. It has a 14-days trial.
Disclaimer: I work at SerpApi.
