scrapy

Python framework for web scraping and web crawling projects

brewmacoslinux
Try with needOr install directly
Source

About

Web crawling & scraping framework

Commands

scrapy

Examples

Create a new Scrapy project$ scrapy startproject myproject
Generate a new spider in an existing project$ scrapy genspider myspider example.com
Run a spider to crawl and scrape data$ scrapy crawl myspider