Agent skill · Data & Analytics

eval-report

Generate evaluation report from session metrics, checkpoint evals, and pass@k data

majiayu000github.com/majiayu000GitHub ↗
claude-codeMIT
Install
npx skills add majiayu000/claude-skill-registry --skill eval-report --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 3 KB
Bundled scripts: none
Path: skills/analysis/eval-report/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 534
Language: HTML

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Eval Report Generate a dashboard of session effectiveness metrics. ## Arguments - `--days N` — look back N days (default: 7) - `--branch <name>` — filter by branch - `--format table|json` — output format (default: table) ## Process ### 1. Read Metrics Read `.claude/agent-memory/session-learnings/metrics.jsonl` > **Guard:** If `metrics.jsonl` does not exist, output "No session metrics recorded yet. Run sessions with `evaluate-session.sh` enabled to populate." and skip to step 2. Calculate: - Total sessions in period - Average commits per session - Average tasks completed per session - Average files changed per session - Error rate (sessions with errors / total sessions) - Average session duration (minutes) ### 2. Read Checkpoint Evals Read `.claude/phases/output/eval-*.json` Calculate: - Phase transition pass rate - Most common failure criteria - Average attempts per transition ### 3. Read pass@k Data Read `.claude/instincts/eval-tracker.jsonl` Calculate: - pass@1: (tasks succeeded on first attempt) / (total tasks) - pass@3: (tasks succeeded within 3 attempts) / (total tasks) - Average attempts to success ### 4. Skill Effectiveness Analysis Read `.claude/instincts/eval-tracker.jso

What's inside
Steps it walks through
  1. Arguments
  2. Process
  3. 1. Read Metrics
  4. 2. Read Checkpoint Evals
  5. 3. Read pass@k Data
  6. 4. Skill Effectiveness Analysis
  7. 5. Output Report
  8. Data File Locations
Ships with 1 file
  • metadata.json
More from claude-skill-registry
All skills →
About this skill
What does the eval-report skill do?

Generate evaluation report from session metrics, checkpoint evals, and pass@k data

How do I install it?

Run `npx skills add majiayu000/claude-skill-registry --skill eval-report --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going