python-scraping icon indicating copy to clipboard operation
python-scraping copied to clipboard

Code samples from the book Web Scraping with Python http://shop.oreilly.com/product/0636920034391.do

Results 91 python-scraping issues
Sort by recently updated
recently updated
newest added

I'm going through the 2nd ed. of the book now and it's great. I've spent hours upon hours trying to log into Yahoo! with a POST request but I'm being...

Hi, I'm running the 3-javascriptRedirect.py file from chapter 10, and StaleElementReferenceException is not thrown, therefore the full 10 sec timeout is performed. Is this a bug?

FreeGeoIP service renamed ipstack and it needs access_key for using that service

I found the error of UnboundLocalError linked to the "content" variable. So we need to set "content" as a global variable in the def portion.

When i was run this code, the redirect can be detected, so i guess this is a bug and i fixed it.

On the second loop there is a slight indentation issue to have the proper form ``` csvFile = open('editors.csv', 'wt+') writer = csv.writer(csvFile) try: for row in rows: csvRow =...

the text uses `find_all` > Using this BeautifulSoup object, you can use the find_all function... where as the example uses `findAll` instead: ``` = bs.findAll('span', {'class':'green'}) for name in nameList:...

No "getNextExternalLink" method

What is the meaning of the sentence "horrify web administrators by sending their website traffic from Internet Explorer 5.0." ? What special feature does Internet Explorer 5.0 have ?

Hi everybody! I am newbie and try to implement my first test scrapy project wikiSpider . I done everything as described in the book and got the result- **NotImplementedError: ArticleSpider.parse...