Agent skill · Backend & API

web-archive-scraper

Search the Wayback Machine for archived versions of websites. Extract cached pages, customer lists, testimonials, and partner directories from sites that have changed or gone offline. Uses the free CDX API — no API key needed.

gooseworks-aigithub.com/gooseworks-aiGitHub ↗
claude-codecodexcursorships scriptsMIT
Install
npx skills add gooseworks-ai/goose-skills --skill web-archive-scraper --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 3
SKILL.md size: 4 KB
Bundled scripts: yes
Path: skills/research-tools/capabilities/web-archive-scraper/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 1,091
Language: Python

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Web Archive Scraper Search the Wayback Machine (Internet Archive) for archived snapshots of websites. Fetch cached page content to find customer lists, testimonials, partner directories, and other information from sites that have changed or shut down. ## Quick Start Only dependency is `requests`. No API key needed. ```bash # Find all snapshots of a URL python3 skills/web-archive-scraper/scripts/search_archive.py \ --url "https://botkeeper.com/customers" # Search with date range python3 skills/web-archive-scraper/scripts/search_archive.py \ --url "https://botkeeper.com" --from 2025-01-01 --to 2026-02-01 # Search all pages under a domain (prefix match) python3 skills/web-archive-scraper/scripts/search_archive.py \ --url "https://botkeeper.com" --match prefix --limit 50 # Fetch the actual archived page content python3 skills/web-archive-scraper/scripts/search_archive.py \ --url "https://botkeeper.com/customers" --fetch # Output formats python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output json python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output csv python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output su

What's inside
Steps it walks through
  1. Quick Start
  2. How It Works
  3. CLI Reference
  4. Output Schema
  5. Cost
  6. Common Use Cases
Ships with 2 files
  • scripts/search_archive.py
  • skill.meta.json
Commands it runs
Find all snapshots of a URL
python3 skills/web-archive-scraper/scripts/search_archive.py \
Search with date range
Search all pages under a domain (prefix match)
Fetch the actual archived page content
Output formats
python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output json
python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output csv
python3 skills/web-archive-scraper/scripts/search_archive.py --url URL --output summary
More from goose-skills
All skills →
About this skill
What does the web-archive-scraper skill do?

Search the Wayback Machine for archived versions of websites. Extract cached pages, customer lists, testimonials, and partner directories from sites that have changed or gone offline. Uses the free CDX API — no API key needed.

How do I install it?

Run `npx skills add gooseworks-ai/goose-skills --skill web-archive-scraper --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From gooseworks-ai/goose-skills, a repository with 1,091 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going