snippetbashTip

waymore — Fetch URLs of a domain from Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, and VirusTotal.

Submitted by: @import:tldr-pages·Mar 2, 2026·

Viewed 0 times

commandurlsfromdomainwaybackclifetchwaymore

Problem

How to use the waymore command: Fetch URLs of a domain from Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, and VirusTotal. Note: Unless specified, output is dumped into the results/ directory where waymore's config.yml resides (by default in ~/.config/waymore/). More information: <https://github.com/xnl-h4ck3r/waymore>.

Solution

waymore — Fetch URLs of a domain from Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, and VirusTotal. Note: Unless specified, output is dumped into the results/ directory where waymore's config.yml resides (by default in ~/.config/waymore/). More information: <https://github.com/xnl-h4ck3r/waymore>.

Search for URLs of a domain (output will typically be in ~/.config/waymore/results/):

waymore {{[-i|--input]}} {{example.com}}

Limit search results to only include a list of URLs for a domain and store outputs to the specified file:

waymore -mode U {{[-oU|--output-urls]}} {{path/to/example.com-urls.txt}} {{[-i|--input]}} {{example.com}}

Only output the content bodies of URLs and store outputs to the specified directory:

waymore -mode R {{[-oR|--output-responses]}} {{path/to/example.com-url-responses}} {{[-i|--input]}} {{example.com}}

Filter the results by specifying date ranges:

waymore -from {{YYYYMMDD|YYYYMM|YYYY}} {{[-to|--to-date]}} {{YYYYMMDD|YYYYMM|YYYY}} {{[-i|--input]}} {{example.com}}

Code Snippets

Search for URLs of a domain (output will typically be in `~/.config/waymore/results/`)

waymore {{[-i|--input]}} {{example.com}}

Limit search results to only include a list of URLs for a domain and store outputs to the specified file

waymore -mode U {{[-oU|--output-urls]}} {{path/to/example.com-urls.txt}} {{[-i|--input]}} {{example.com}}

Only output the content bodies of URLs and store outputs to the specified directory

waymore -mode R {{[-oR|--output-responses]}} {{path/to/example.com-url-responses}} {{[-i|--input]}} {{example.com}}

Filter the results by specifying date ranges

waymore -from {{YYYYMMDD|YYYYMM|YYYY}} {{[-to|--to-date]}} {{YYYYMMDD|YYYYMM|YYYY}} {{[-i|--input]}} {{example.com}}

Context

tldr-pages: common/waymore

Revisions (0)

No revisions yet.