eval-rubric-designer
Design a scoring rubric and LLM-as-judge prompt to evaluate the quality of an AI feature's output. Use when asked to create an eval rubric, define quality dimensions, build an LLM judge, or decide how to measure whether AI output is good. Produces a rubric with weighted dimensions and concrete 1–5 anchors, a ready-to-run judge prompt, a labelling guide, and notes on judge reliability.
npx skills add mohitagw15856/pm-claude-skills --skill eval-rubric-designer --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Eval Rubric Designer Skill You can't improve what you can't score. The hard part of evaluating AI output isn't running the judge — it's defining dimensions that are **specific, observable, and independent**, with anchors concrete enough that two people (or two judge runs) agree. This skill turns "is the output good?" into a rubric and a judge prompt you can run today. ## Working from a brief Given just "I need to eval my summariser", **produce the full rubric anyway** — infer the task, the output type, and the dimensions that matter for it, and label inferred choices. Never hand back a list of dimension names with no anchors; the anchors are where the rubric earns its keep. ## Required Inputs Ask for these only if they aren't already provided (else infer and label): - **The task** — what the AI is supposed to produce, and for whom. - **A sample output (or two)** — ideally one good and one weak, to calibrate anchors. - **What "good" means here** — the quality bar and any non-negotiables (e.g. must be grounded, must follow format). - **How it'll be scored** — human review, LLM-as-judge, or both; and whether you need a single score or per-dimension. ## Output Format ### Eval Rubric:
- Working from a brief
- Required Inputs
- Output Format
- Eval Rubric: [task]
- Quality Checks
- Anti-Patterns
- Based On
What does the eval-rubric-designer skill do?
Design a scoring rubric and LLM-as-judge prompt to evaluate the quality of an AI feature's output. Use when asked to create an eval rubric, define quality dimensions, build an LLM judge, or decide how to measure whether AI output is good. Produces a rubric with weighted dimensions and concrete 1–5 anchors, a ready-to-run judge prompt, a labelling guide, and notes on judge reliability.
How do I install it?
Run `npx skills add mohitagw15856/pm-claude-skills --skill eval-rubric-designer --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From mohitagw15856/pm-claude-skills, a repository with 1,255 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.