Agent skill · Data & Analytics

extract-webpage-data

Extract structured data from web pages using AI

gooseworks-aigithub.com/gooseworks-aiGitHub ↗
claude-codecodexcursorMIT
Install
npx skills add gooseworks-ai/goose-skills --skill extract-webpage-data --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 7 KB
Bundled scripts: none
Path: skills/research-tools/capabilities/extract-webpage-data/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 1,091
Language: Python

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Extract Webpage Data ## Setup Read your credentials from ~/.gooseworks/credentials.json: ```bash export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])") export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))") ``` If ~/.gooseworks/credentials.json does not exist, tell the user to run: `npx gooseworks login` All endpoints use Bearer auth: `-H "Authorization: Bearer $GOOSEWORKS_API_KEY"` Extract structured data from any web page using AI. Turn messy HTML into clean, organized data. ## When to Use - User wants to extract specific data from a website - User asks to scrape information from a page - User needs structured data from unstructured content - User wants to pull product info, contact details, etc. - Converting web content to usable data ## How It Works Uses Olostep, Scrapegraph, or Riveter APIs for AI-powered data extraction. ## Usage ### Simple Scrape with Olostep ```bash curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \ -H "Authorization: Bearer $GOOSEWORKS_API_KEY" \ -H "Content-Type: appli

What's inside
Steps it walks through
  1. Setup
  2. When to Use
  3. How It Works
  4. Usage
  5. Simple Scrape with Olostep
  6. AI-Powered Extraction with Scrapegraph
  7. Schema-Based Extraction with Riveter
  8. Get AI Answer from Web
  9. Crawl Multiple Pages
  10. Parameters
  11. Olostep Scrape
  12. Scrapegraph
  13. Riveter
  14. Olostep Answer
Ships with 1 file
  • skill.meta.json
Commands it runs
export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])")
export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))")
curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
More from goose-skills
All skills →
create-music-elevenlabsGenerate an instrumental music bed via ElevenLabs Music, ROUTED THROUGH THE elevenlabs-proxy so it…Content & Marketingcreate-video-falImage-to-video (or text-to-video) via any FAL video model (Kling, Seedance, Veo), ROUTED THROUGH…Content & Marketingremix-graphic-ad-from-referenceRecreate a static graphic ad (Pinterest pin, IG/FB feed image, poster) from a reference image…Content & Marketingcreate-image-gpt-image-falGenerate a single photoreal or designed image with OpenAI gpt-image via fal.ai. Supports…Design & Presentationcreate-image-falGenerate or edit an image via any FAL image model (nano-banana edit, gpt-image, flux, ...), ROUTED…Content & Marketingcreate-vo-elevenlabsGenerate a voiceover (VO) clip via ElevenLabs text-to-speech, ROUTED THROUGH THE elevenlabs-proxy…Content & Marketing
About this skill
What does the extract-webpage-data skill do?

Extract structured data from web pages using AI

How do I install it?

Run `npx skills add gooseworks-ai/goose-skills --skill extract-webpage-data --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From gooseworks-ai/goose-skills, a repository with 1,091 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going
All skills →
The full catalog, by category and by tool.
Open Source Radar →
The repositories these skills come from, watched daily.
The people behind them →
Makers and builders across the ecosystem.