scrapy: basic commands

  1. Create Project

scrapy startproject EXAMPLE /home/Scripts/scrapy/EXAMPLE


2 . Create Project inside the spiders folder

with the format:


3.  Start testing with the console.

scrapy shell ''


And execute the XPath commands


To run the spider execute the followng command on the folder.

scrapy crawl <spider name> -o file.csv -t csv

Leave a Reply

Your email address will not be published. Required fields are marked *