eval-report
Use when the user has run multiple evaluation skills and wants a comprehensive analysis — maturity assessment, cross-skill signals, trends, prioritized actions, and an executive summary. Also use when the user mentions eval health check, evaluation audit, ship readiness, evaluation maturity, or "how good is my evaluation system itself." This is a read-only analysis skill.
Profile →npx skills add agentscope-ai/OpenJudge --skill 04-eval-report --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
<HARD-GATE> NO recommendation WITHOUT statistical evidence backing it. NO "system ready" declaration WITHOUT all calibrated judges passing AND all production gates green. NO trend analysis WITHOUT at least 2 data points in history. </HARD-GATE> # Eval Report Synthesize everything from your evaluation journey into a comprehensive report. This skill is read-only — it analyzes what exists, doesn't create new graders or datasets. ## When to Activate - You've run 2+ evaluation skills and want the big picture - You need to report evaluation status to non-technical stakeholders - You're making a ship/no-ship decision and need evidence - The evaluation system has been running for a while — time for a health check ## Checklist You MUST create a task for each item and complete them in order: 1. **Inventory scan** — catalog everything in eval-design.md + runs/ history 2. **Maturity assessment** — 5 dimensions × 4 levels 3. **Cross-skill signal synthesis** — consistent findings + contradictions 4. **Weakness diagnosis** — failure concentration, correlations, stratum gaps 5. **Root cause classification** — system / metric / data / unclear 6. **Prioritized recommendations** — P0/P1/P2 actions wi
- When to Activate
- Checklist
- Step 1: Inventory Scan
- Step 2: Maturity Assessment
- Step 3: Cross-Skill Signal Synthesis
- Consistent Signals (high confidence)
- Contradictions (needs investigation)
- Coverage Gaps (blind spots)
- Step 4: Weakness Diagnosis
- Failure Concentration
- Failure Correlation
- Per-Stratum Weakness
- Step 5: Root Cause Classification
- Step 6: Prioritized Recommendations
What does the eval-report skill do?
Use when the user has run multiple evaluation skills and wants a comprehensive analysis — maturity assessment, cross-skill signals, trends, prioritized actions, and an executive summary. Also use when the user mentions eval health check, evaluation audit, ship readiness, evaluation maturity, or "how good is my evaluation system itself." This is a read-only analysis skill.
How do I install it?
Run `npx skills add agentscope-ai/OpenJudge --skill 04-eval-report --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From agentscope-ai/OpenJudge, a repository with 764 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.