npm

scrapy

Web scraping and crawling framework for extracting data from websites.

brewmacoslinux
Try with needOr install directly
Source

About

Web crawling & scraping framework

Commands

scrapy

Examples

create a new web scraping project$ scrapy startproject myproject
generate a spider template to scrape a website$ scrapy genspider myspider example.com
run a spider to crawl and extract data$ scrapy crawl myspider
test CSS selectors to extract page content$ scrapy shell https://example.com
save scraped data to CSV or JSON file$ scrapy crawl myspider -o output.json