fetcher
Fetch web pages, PDFs, and documents with automatic fallbacks and content extraction. Use when user says "fetch this URL", "download this page", "crawl this website", "extract content from", "get the PDF", or provides URLs needing retrieval.
npx skills add majiayu000/claude-skill-registry --skill fetcher-grahama1970-agent-skills-2 --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Fetcher - Web Crawling Fetch web pages and documents with automatic fallbacks, proxy rotation, and content extraction. **Self-contained skill** - auto-installs via `uvx` from git (no pre-installation needed). **Fully automatic** - Playwright browsers are installed on first run for SPA/JS page support. ## Simplest Usage ```bash # Via wrapper (recommended - auto-installs) .agents/skills/fetcher/run.sh get https://example.com # Or directly if fetcher is installed fetcher get https://example.com ``` ## Common Commands ```bash ./run.sh get https://example.com # Fetch single URL ./run.sh get-manifest urls.txt # Fetch list of URLs ./run.sh get-manifest - < urls.txt # Fetch from stdin ``` ## Common Patterns ### Fetch a single URL ```bash fetcher get https://www.nasa.gov --out run/nasa ``` Outputs to `run/nasa/`: - `consumer_summary.json` - structured result - `Walkthrough.md` - human-readable summary - `downloads/` - raw content files ### Fetch multiple URLs ```bash # From file (one URL per line) fetcher get-manifest urls.txt --out run/batch # From stdin echo -e "https://example.com\nhttps://nasa.gov" | fetcher get-manifest - ``` ### ETL mode (full control) ```bash fetcher-etl --inventor
- Simplest Usage
- Common Commands
- Common Patterns
- Fetch a single URL
- Fetch multiple URLs
- ETL mode (full control)
- Check environment
- Output Structure
- Content Extraction
- Enable markdown output
- Rolling windows (for chunking)
- Advanced Features
- HTTP caching
- PDF discovery
Via wrapper (recommended - auto-installs) Or directly if fetcher is installed fetcher get https://example.com fetcher get https://www.nasa.gov --out run/nasa From file (one URL per line) fetcher get-manifest urls.txt --out run/batch From stdin echo -e "https://example.com\nhttps://nasa.gov" | fetcher get-manifest - fetcher-etl --inventory urls.jsonl --out run/etl_batch fetcher-etl --manifest urls.txt --out run/demo
What does the fetcher skill do?
Fetch web pages, PDFs, and documents with automatic fallbacks and content extraction. Use when user says "fetch this URL", "download this page", "crawl this website", "extract content from", "get the PDF", or provides URLs needing retrieval.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill fetcher-grahama1970-agent-skills-2 --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.