REMitchell
Chapter3.Article"Crawling with Scrapy". NotImplementedError
Hi everybody! I am newbie and try to implement my first test scrapy project wikiSpider . I done everything as described in the book and got the result- NotImplementedError: ArticleSpider.parse callback is not defined.
files: -articleSpider.py: from scrapy.selector import Selector from scrapy import Spider from wikiSpider.items import Article
class ArticleSpider(Spider): name="article" allowed_domains = ["en.wikipedia.org"] start_urls = ["http://en.wikipedia.org/wiki/Main_Page", "http://en.wikipedia.org/wiki/Python_%28programming_language%29"]
def parse(self, response): item = Article() title = response.xpath('//h1/text()')[0].extract() print("Title is: "+title) item['title'] = item return item
-items.py
from scrapy import Item, Field
class Article(Item): # define the fields for your item here like: # name = scrapy.Field() title=Field()
More details you can see here... 