networkdynamics
Authentication issue
Apparently TikTok changed something and you need to login before scraping data. Is there any workaround?
Hey, I've seen this happen occasionally before but generally it's not a persistent issue for me, i.e. sometimes I get a login prompt, but only for the occasional request, and if I reload it no longer prompts me to login.
Seeing as I can't persistently reproduce it, it will be difficult for me to add a workaround unfortunately. Try just reloading the page.
If you feel like it, I would love a PR to automatically login, or to correctly throw an error if the login prompt pops up!
Hi, thank you for the reply! Unfortunately, it is not occasional, it has not been working for 2 weeks. Below the error and the view I see when I run the script
Thanks for the extra info! What country are you making these requests from? I ask because it may help me reproduce the issue.
Thank to you for the interest. I'm making the request from Italy
Hey! Sorry for the delay in response! I unfortunately don't really have the bandwidth to look into this right now. I'm considering switching the browser automation from Playwright to nodriver, which may help with this issue. If you want to address this issue, the best thing you could do is create a PR switching from Playwright to nodriver. Otherwise I probably will make that change myself at some point in the future, but can't promise when that will be!