web-search
Web search and content extraction skill for AI coding agents. Zero API keys required. Decision tree with fallback chains across 5 tools.
npx skills add majiayu000/claude-skill-registry --skill web-search-buildoak-fieldwork-skills --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Web Search Web search, scraping, and content extraction for AI coding agents. Zero API keys required. Five tools organized in fallback chains: WebSearch and Crawl4AI as primary, Jina as secondary, duckduckgo-search and WebFetch as fallbacks. Use when your agent needs web information -- finding pages, extracting content, or conducting research. Terminology used in this file: - **Playwright:** Browser automation framework used by Crawl4AI for JavaScript-rendered pages. - **SPA:** Single-page application; content is rendered dynamically in JavaScript. - **MCP:** Model Context Protocol, a standard for exposing tool servers to AI agents. ## Setup ```bash python3 -m pip install crawl4ai duckduckgo-search crawl4ai-setup ``` - **Claude Code:** copy this skill folder into `.claude/skills/web-search/` - **Codex CLI:** append this SKILL.md content to your project's root `AGENTS.md` For the full installation walkthrough (prerequisites, verification, troubleshooting), see [references/installation-guide.md](references/installation-guide.md). ## Staying Updated This skill ships with an `UPDATES.md` changelog and `UPDATE-GUIDE.md` for your AI agent. After installing, tell your agent: "Check `UPD
- Setup
- Staying Updated
- Quick Start
- Decision Tree
- Tool Reference
- WebSearch (Built-in) -- Primary Search
- WebFetch (Built-in) -- Fallback URL Extraction
- Crawl4AI -- JS-Rendering Web Scraper
- Jina Reader/Search -- Zero-Install Extraction & Search
- duckduckgo-search -- Emergency Search Fallback
- Core Workflows
- Pattern 1: Quick Web Search
- Pattern 2: URL Content Extraction
- Pattern 3: Deep Research
python3 -m pip install crawl4ai duckduckgo-search
crawl4ai-setup
python3 -c "from duckduckgo_search import DDGS; import json; print(json.dumps(DDGS().text('your query', max_results=5), indent=2))"
curl -s "https://r.jina.ai/http://example.com/article" | head -80
crwl https://example.com/app --f markdown --bypass-cache
CLI (simplest)
crwl https://example.com
crwl https://example.com -o markdown
Python API
from crawl4ai import AsyncWebCrawlerWhat does the web-search skill do?
Web search and content extraction skill for AI coding agents. Zero API keys required. Decision tree with fallback chains across 5 tools.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill web-search-buildoak-fieldwork-skills --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.