npm

pipet

Web scraping Swiss-army knife for extracting data from websites

brewmacoslinux
Try with needOr install directly
Source

About

Swiss-army tool for web scraping, made for hackers

Commands

pipet

Examples

extract text content from a webpage$ pipet get https://example.com
scrape HTML and convert to JSON$ pipet parse https://example.com --format json
find all links on a webpage$ pipet select https://example.com 'a' --attr href
extract table data from website$ pipet select https://example.com 'table' --format csv
scrape multiple pages with selector$ pipet select https://example.com '.product-title' --text