evaluation
This skill should be used when building agent evaluation systems: deterministic checks, regression suites, multi-dimensional rubrics, quality gates, production monitoring, baseline comparison, and outcome measurement for agent pipelines.
npx skills add guanyang/open-agent-hub --skill evaluation --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Evaluation Methods for Agent Systems Evaluate agent systems differently from traditional software because agents make dynamic decisions, are non-deterministic between runs, and often lack single correct answers. Build evaluation frameworks that account for these characteristics, provide actionable feedback, catch regressions, and validate that context engineering choices achieve intended effects. ## When to Activate Activate this skill when: - Testing agent performance systematically - Validating context engineering choices - Measuring improvements over time - Catching regressions before deployment - Building quality gates for agent pipelines - Comparing different agent configurations - Evaluating production systems continuously Do not activate this skill for adjacent work owned by other skills: - Designing the LLM judge itself, pairwise comparison, judge calibration, or bias mitigation: `advanced-evaluation`. - Designing autonomous control surfaces, novelty gates, rollback, or PR approval boundaries: `harness-engineering`. - Debugging a specific context failure mode before measuring it: `context-degradation`. ## Core Concepts Focus evaluation on outcomes rather than execution pa
- When to Activate
- Core Concepts
- Detailed Topics
- Evaluation Challenges
- Evaluation Rubric Design
- Evaluation Methodologies
- Test Set Design
- Context Engineering Evaluation
- Continuous Evaluation
- Practical Guidance
- Building Evaluation Frameworks
- Avoiding Evaluation Pitfalls
- Examples
- Guidelines
What does the evaluation skill do?
This skill should be used when building agent evaluation systems: deterministic checks, regression suites, multi-dimensional rubrics, quality gates, production monitoring, baseline comparison, and outcome measurement for agent pipelines.
How do I install it?
Run `npx skills add guanyang/open-agent-hub --skill evaluation --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From guanyang/open-agent-hub, a repository with 940 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.