Scrapy

Scrapy: Basic Commands

Posted on

Create Project scrapy startproject EXAMPLE /home/Scripts/scrapy/EXAMPLE   2 . Create Project inside the spiders folder with the format: example_spider.py         3.  Start testing with the console.   scrapy shell ‘http://quotes.toscrape.com’   And execute the XPath commands https://devhints.io/xpath   To run the spider execute the followng command on the folder. scrapy crawl <spider […]