skillgrade-graders
Authors deterministic and LLM rubric graders for skillgrade evaluations. Use when creating scoring scripts, writing evaluation rubrics, or combining multiple graders with weighted scoring. Don't use for setting up eval pipelines, configuring eval.yaml defaults, or general test writing.
npx skills add mgechev/skillgrade --skill skillgrade-graders --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Skillgrade Grader Authoring ## Procedures **Step 1: Identify the Grading Strategy** 1. Determine whether the task requires objective verification (deterministic) or qualitative assessment (LLM rubric). 2. For most tasks, combine both: deterministic graders verify outcomes (weight 0.7), LLM rubrics assess approach quality (weight 0.3). **Step 2: Write a Deterministic Grader** 1. Create a script in the skill's `graders/` directory (bash or TypeScript). 2. The script must output a JSON object to stdout with the following structure: ```json {"score": 0.67, "details": "2/3 checks passed", "checks": [{"name": "check-name", "passed": true, "message": "Description"}]} ``` 3. `score` (0.0–1.0) and `details` are required. `checks` is optional but recommended. 4. Read `references/grader-output-schema.md` for the full output specification. 5. Use `awk` for arithmetic in bash scripts — `bc` is not available in `node:20-slim`. 6. Reference the grader in eval.yaml: ```yaml - type: deterministic run: bash graders/check.sh weight: 0.7 ``` **Step 3: Write an LLM Rubric Grader** 1. Draft a rubric with explicit scoring criteria and point allocations. 2. Structure the rubric into weighted sections th
- Procedures
- Error Handling
What does the skillgrade-graders skill do?
Authors deterministic and LLM rubric graders for skillgrade evaluations. Use when creating scoring scripts, writing evaluation rubrics, or combining multiple graders with weighted scoring. Don't use for setting up eval pipelines, configuring eval.yaml defaults, or general test writing.
How do I install it?
Run `npx skills add mgechev/skillgrade --skill skillgrade-graders --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From mgechev/skillgrade, a repository with 658 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.