SeleniumBase
SeleniumBase copied to clipboard
GitHub Actions examples of scraping data from Copilot and Walmart
GitHub Actions examples of scraping data from Copilot and Walmart
Copilot and Walmart are two sites that use anti-bot services (Cloudflare and PerimeterX).
The following GitHub Actions examples show SeleniumBase scraping data from both sites via Ubuntu Linux servers:
-
https://github.com/mdmintz/seleniumbase-examples/actions/runs/18667847608/job/53222753997#step:14:15
-
https://github.com/mdmintz/undetected-testing/actions/runs/18480056309/job/52652811730#step:17:14
Screenshot of scraping Copilot:
Screenshot of scraping Walmart:
Example code for the above:
- examples/cdp_mode/raw_copilot.py (UC Mode + CDP Mode)
- examples/cdp_mode/raw_cdp_copilot.py (Pure CDP Mode)
- examples/cdp_mode/raw_walmart.py (UC Mode + CDP Mode)
- examples/cdp_mode/raw_cdp_walmart.py (Pure CDP Mode)