Agent skill · Data & Analytics

structured-scraping-riveter

Web scraping with structured data extraction - define your output schema

gooseworks-aigithub.com/gooseworks-aiGitHub ↗
claude-codecodexcursorMIT
Install
npx skills add gooseworks-ai/goose-skills --skill structured-scraping-riveter --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 6 KB
Bundled scripts: none
Path: skills/research-tools/capabilities/structured-scraping-riveter/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 1,091
Language: Python

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Riveter - Structured Web Scraping ## Setup Read your credentials from ~/.gooseworks/credentials.json: ```bash export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])") export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))") ``` If ~/.gooseworks/credentials.json does not exist, tell the user to run: `npx gooseworks login` All endpoints use Bearer auth: `-H "Authorization: Bearer $GOOSEWORKS_API_KEY"` Scrape web pages and extract data into your defined structure. ## Capabilities - **Scrape**: Scrape a webpage and return the text content - **Run**: Copy link Define the structure of your output directly in the API request - **Run data**: Retrieve the processed data from a completed project run (free) - **Run status**: Check the current status of a project run (free) - **Stop run**: Stop a currently running project (free) ## Usage ### Scrape Scrape a webpage and return the text content. This endpoint allows you to extract text content from any public webpage. Parameters: - url* (string) - Example: "https://example.c

What's inside
Steps it walks through
  1. Setup
  2. Capabilities
  3. Usage
  4. Scrape
  5. Run
  6. Run data (free)
  7. Run status (free)
  8. Stop run (free)
  9. Use Cases
  10. Discover More
Ships with 1 file
  • skill.meta.json
Commands it runs
export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])")
export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))")
curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/run \
curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/search \
curl -s -X POST $GOOSEWORKS_API_BASE/v1/proxy/orthogonal/details \
More from goose-skills
All skills →
About this skill
What does the structured-scraping-riveter skill do?

Web scraping with structured data extraction - define your output schema

How do I install it?

Run `npx skills add gooseworks-ai/goose-skills --skill structured-scraping-riveter --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From gooseworks-ai/goose-skills, a repository with 1,091 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going