Scrapy: Basic Commands

PHP-FPM Performance Tweaks
November 22, 2017
Prestashop Shortlinks
December 10, 2017
  1. Create Project

scrapy startproject EXAMPLE /home/Scripts/scrapy/

 

2 . Create Project inside the spiders folder

with the format: example_spider.py

 

 

 

 

3.  Start testing with the console.

 

scrapy shell ‘http://quotes.toscrape.com’

 

And execute the XPath commands

https://devhints.io/xpath

 

To run the spider execute the followng command on the folder.

scrapy crawl <spider name> -o file.csv -t csv

 

Leave a Reply

Your email address will not be published. Required fields are marked *