skillgrade-setup
Sets up and runs skillgrade evaluation pipelines for Agent Skills. Use when initializing eval configurations, running trials, reviewing results, or integrating with CI. Don't use for writing grader scripts, general test authoring, or non-agentic documentation.
npx skills add mgechev/skillgrade --skill skillgrade-setup --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Skillgrade Evaluation Setup ## Procedures **Step 1: Install Skillgrade** 1. Verify Node.js 20+ and Docker are available. 2. Run `npm i -g skillgrade` to install the CLI globally. **Step 2: Initialize an Eval Configuration** 1. Navigate to the skill directory (must contain a `SKILL.md`). 2. Set the appropriate API key environment variable (`GEMINI_API_KEY`, `ANTHROPIC_API_KEY`, or `OPENAI_API_KEY`). 3. Run `skillgrade init` to generate an `eval.yaml` with AI-powered tasks and graders. 4. If an `eval.yaml` already exists, pass `--force` to overwrite: `skillgrade init --force`. 5. Without an API key, a well-commented template is generated instead. **Step 3: Configure eval.yaml** 1. Read `references/eval-yaml-spec.md` for the full configuration schema. 2. Define one or more tasks under the `tasks:` key. Each task requires: - `name`: unique task identifier - `instruction`: what the agent should accomplish - `workspace`: files to copy into the evaluation container - `graders`: one or more scoring mechanisms (see the `skillgrade-graders` skill) 3. Optionally configure `defaults:` for agent, provider, trials, timeout, and threshold. **Step 4: Run Evaluations** 1. Select an appropriate pr
- Procedures
- Error Handling
What does the skillgrade-setup skill do?
Sets up and runs skillgrade evaluation pipelines for Agent Skills. Use when initializing eval configurations, running trials, reviewing results, or integrating with CI. Don't use for writing grader scripts, general test authoring, or non-agentic documentation.
How do I install it?
Run `npx skills add mgechev/skillgrade --skill skillgrade-setup --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From mgechev/skillgrade, a repository with 658 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.