eval-audit
Audit an existing evaluation workflow and produce severity-ranked findings with concrete next actions. Use when inheriting an eval setup, diagnosing quality regressions, or checking LLM evaluation process maturity.
npx skills add majiayu000/claude-skill-registry --skill eval-audit --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Eval Audit Audit LLM evaluation practice and route gaps to the right skills. ## Interactive Q&A protocol (mandatory) <HARD-GATE> BEFORE the first scoping question, search for a structured question tool (e.g., `AskUserQuestion` or similar interactive widget) and load it. Use that tool for EVERY scoping question. Fall back to plain-text lettered options ONLY if no such tool exists in the environment. </HARD-GATE> Ask one question at a time using the structured question tool (loaded per the HARD-GATE above). Example question structure: ``` What should this audit prioritize first? A) Live evaluation quality and coverage B) Error analysis maturity C) Review and promotion loop health D) End-to-end process health ``` Rules: - One question per message. - Use the structured question tool for every question. Structure each with a short header, 2-4 options with labels and descriptions, and place the recommended option first. Do not add "(Recommended)" or similar annotations to option labels. - Ask one follow-up only if ambiguity remains. ## Inputs and evidence Collect available evidence from Truesight first: - datasets and dataset rows - live evaluations - evaluation runs/results - review q
- Interactive Q&A protocol (mandatory)
- Inputs and evidence
- Diagnostic areas
- Report format (mandatory)
- Severity rubric
- Handoff map
- Guardrails
What does the eval-audit skill do?
Audit an existing evaluation workflow and produce severity-ranked findings with concrete next actions. Use when inheriting an eval setup, diagnosing quality regressions, or checking LLM evaluation process maturity.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill eval-audit --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.