gau

Fetches known URLs for a domain from OTX, Wayback, and Common Crawl

brewmacoslinux

Try with needOr install directly

About

Open Threat Exchange, Wayback Machine, and Common Crawl URL fetcher

gau

Fetch all known URLs for a single domain$ gau example.com

Fetch URLs for multiple domains and save to file$ gau example.com example.org > urls.txt

Fetch URLs with specific filtering and parameters$ gau --threads 5 --timeout 10 example.com