web-scraping-Riyasewana.lk icon indicating copy to clipboard operation
web-scraping-Riyasewana.lk copied to clipboard

Web scraping script written in python using scrapy library in order to scrape product data from popular Sri Lankan vehicle selling web sites.

web-scraping-Riyasewana.lk

Web scraping script written in python using scrapy library in order to scrape product data from popular Sri Lankan vehicle selling web sites.

You can scrape the data by executing following commands

scrapy crawl riyasewana -o riyasewana.json

Make sure you have installed scrapy in your virtual enviornment along with python 3.7

pip install scrapy