Scrapy

Scrapy: Basic Commands

Posted on

Create Project scrapy startproject EXAMPLE /home/Scripts/scrapy/EXAMPLE   2 . Create Project inside the spiders folder with the format: example_spider.py   3.  Start testing with the console. scrapy shell 'http://quotes.toscrape.com'   And execute the XPath commands https://devhints.io/xpath   To run the spider execute the followng command on the folder. scrapy crawl <spider name> -o file.csv -t […]