web-reader
Implement web page content extraction capabilities using the z-ai-web-dev-sdk. Use this skill when the user needs to scrape web pages, extract article content, retrieve page metadata, or build applications that process web content. Supports automatic content extraction with title, HTML, and publication time retrieval.
npx skills add jjyaoao/HelloAgents --skill web-reader --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
What it does
Guides implementing web page reading and content extraction functionality using the z-ai-web-dev-sdk to fetch and process web page content, enabling applications to extract content, metadata, and HTML from URLs.
How it works
- Uses the page_reader function to fetch a web page and extract content.
- Returns structured data including title, content HTML, plain text, publish_time, and metadata.
- Provides example implementations and CLI usage for simple tasks and SDK-based pipelines.
- Demonstrates additional utilities: extract article text, read multiple pages, content aggregation, and a web scraping pipeline with processors (links, images, plainText).
- Includes sample code blocks showing how to invoke page_reader, handle results, and process or store extracted data.
When to use it
Use this skill when you need to scrape web pages, extract article content, retrieve page metadata, or build applications that process web content. Use the CLI for quick extractions and the SDK for batch processing or production pipelines.
What it can touch
- Uses the z-ai-web-dev-sdk backend components (e.g., page_reader) to fetch and process pages.
- Demonstrates integration points in JavaScript/TypeScript code that call
zai.functions.invoke('page_reader', { url })and access result fields such asresult.data.title,result.data.html,result.data.publishedTime,result.data.url, andresult.data.usage.tokens.
Caveats
- IMPORTANT: z-ai-web-dev-sdk MUST be used in backend code only. Never use it in client-side code.
- The skill description notes license as MIT and requires the SDK availability; no additional licensing or risk statements are provided within the provided content.
# Web Reader Skill This skill guides the implementation of web page reading and content extraction functionality using the z-ai-web-dev-sdk package, enabling applications to fetch and process web page content programmatically. ## Skills Path **Skill Location**: `{project_path}/skills/web-reader` This skill is located at the above path in your project. **Reference Scripts**: Example test scripts are available in the `{Skill Location}/scripts/` directory for quick testing and reference. See `{Skill Location}/scripts/web-reader.ts` for a working example. ## Overview Web Reader allows you to build applications that can extract content from web pages, retrieve article metadata, and process HTML content. The API automatically handles content extraction, providing clean, structured data from any web URL. **IMPORTANT**: z-ai-web-dev-sdk MUST be used in backend code only. Never use it in client-side code. ## Prerequisites The z-ai-web-dev-sdk package is already installed. Import it as shown in the examples below. ## CLI Usage (For Simple Tasks) For simple web page content extraction, you can use the z-ai CLI instead of writing code. This is ideal for quick content scraping, testing URLs, or
- Skills Path
- Overview
- Prerequisites
- CLI Usage (For Simple Tasks)
- Basic Page Reading
- Save Page Content
- Common Use Cases
- CLI Parameters
- Response Structure
- Example Response
- Processing Multiple URLs
- When to Use CLI vs SDK
- How It Works
- Basic Web Reading Implementation
Extract content from a web page
z-ai function --name "page_reader" --args '{"url": "https://example.com"}'
Using short options
z-ai function -n page_reader -a '{"url": "https://www.example.com/article"}'
Save extracted content to JSON file
z-ai function \
Extract and save blog post
Extract news article
Read documentation page
Scrape blog contentWhat does the web-reader skill do?
Implement web page content extraction capabilities using the z-ai-web-dev-sdk. Use this skill when the user needs to scrape web pages, extract article content, retrieve page metadata, or build applications that process web content. Supports automatic content extraction with title, HTML, and publication time retrieval.
How do I install it?
Run `npx skills add jjyaoao/HelloAgents --skill web-reader --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From jjyaoao/HelloAgents, a repository with 2,615 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.