eval-recipes-runner
Run Microsoft's eval-recipes benchmarks to validate amplihack improvements against baseline agents. Activates when testing with eval-recipes, running evals, or benchmarking changes.
npx skills add majiayu000/claude-skill-registry --skill eval-recipes-runner-rysweet-azurehaymaker-2 --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# eval-recipes Runner Skill ## Purpose Run Microsoft's eval-recipes benchmarks to validate amplihack improvements against baseline agents. ## When to Use - User asks to "test with eval-recipes" - User says "run the evals" or "benchmark this change" - User wants to validate improvements against codex/claude_code - Testing a PR branch to prove it improves scores ## Capabilities I can run eval-recipes benchmarks to: 1. Test specific amplihack branches 2. Compare against baseline agents (codex, claude_code) 3. Run specific tasks (linkedin_drafting, email_drafting, etc.) 4. Compare before/after scores for PRs 5. Generate reports with score improvements ## How It Works ### Setup (One-Time) ```bash # Clone eval-recipes from Microsoft git clone https://github.com/microsoft/eval-recipes.git ~/eval-recipes cd ~/eval-recipes # Copy our agent configs cp -r $(pwd)/.claude/agents/eval-recipes/* data/agents/ # Install dependencies uv sync ``` ### Running Benchmarks **Test a specific branch:** ```bash # Update install.dockerfile to use specific branch # Then run benchmark cd ~/eval-recipes uv run eval_recipes/main.py --agent amplihack --task linkedin_drafting --trials 3 ``` **Compare before/after:
- Purpose
- When to Use
- Capabilities
- How It Works
- Setup (One-Time)
- Running Benchmarks
- Available Tasks
- Typical Workflow
- Expected Scores
- Example Usage
- Prerequisites
- Notes
- Automation
Clone eval-recipes from Microsoft git clone https://github.com/microsoft/eval-recipes.git ~/eval-recipes cd ~/eval-recipes Copy our agent configs cp -r $(pwd)/.claude/agents/eval-recipes/* data/agents/ Install dependencies uv sync Update install.dockerfile to use specific branch Then run benchmark uv run eval_recipes/main.py --agent amplihack --task linkedin_drafting --trials 3
What does the eval-recipes-runner skill do?
Run Microsoft's eval-recipes benchmarks to validate amplihack improvements against baseline agents. Activates when testing with eval-recipes, running evals, or benchmarking changes.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill eval-recipes-runner-rysweet-azurehaymaker-2 --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.