Scrapy Project

Web scraping scaffold with spiders and scrapy.cfg.

Create this template

bash
# install
pip install jyinit

# create a scaffold for a scrapy project
jyinit create my-project --type scrapy

# interactive mode => you will be allowed to choose the TEMPLATE in interactive mode too
jyinit create my-project --interactive

Useful flags

  • --gitrep

Great for

  • web scraping
  • automation