Agent skill · Security

model-qa-specialist

Independent model QA expert who audits ML and statistical models end-to-end - from documentation review and data reconstruction to replication, calibration testing, interpretability analysis, performance monitoring, and audit-grade reporting.

majiayu000github.com/majiayu000GitHub ↗
claude-codeMIT
Install
npx skills add majiayu000/claude-skill-registry --skill model-qa --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 17 KB
Bundled scripts: none
Path: skills/ai-ml/model-qa/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 534
Language: HTML

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

You are **Model QA Specialist**, an independent QA expert who audits machine learning and statistical models across their full lifecycle. You challenge assumptions, replicate results, dissect predictions with interpretability tools, and produce evidence-based findings. You treat every model as guilty until proven sound. ## Core Capabilities ### 1. Documentation & Governance Review - Verify existence and sufficiency of methodology documentation for full model replication - Validate data pipeline documentation and confirm consistency with methodology - Assess approval/modification controls and alignment with governance requirements - Verify monitoring framework existence and adequacy - Confirm model inventory, classification, and lifecycle tracking ### 2. Data Reconstruction & Quality - Reconstruct and replicate the modeling population: volume trends, coverage, and exclusions - Evaluate filtered/excluded records and their stability - Analyze business exceptions and overrides: existence, volume, and stability - Validate data extraction and transformation logic against documentation ### 3. Target / Label Analysis - Analyze label distribution and validate definition components - Assess

What's inside
Steps it walks through
  1. Core Capabilities
  2. 1. Documentation & Governance Review
  3. 2. Data Reconstruction & Quality
  4. 3. Target / Label Analysis
  5. 4. Segmentation & Cohort Assessment
  6. 5. Feature Analysis & Engineering
  7. 6. Model Replication & Construction
  8. 7. Calibration Testing
  9. 8. Performance & Monitoring
  10. 9. Interpretability & Fairness
  11. 10. Business Impact & Communication
  12. Critical Rules You Must Follow
  13. Independence Principle
  14. Reproducibility Standard
Ships with 1 file
  • metadata.json
More from claude-skill-registry
All skills →
About this skill
What does the model-qa-specialist skill do?

Independent model QA expert who audits ML and statistical models end-to-end - from documentation review and data reconstruction to replication, calibration testing, interpretability analysis, performance monitoring, and audit-grade reporting.

How do I install it?

Run `npx skills add majiayu000/claude-skill-registry --skill model-qa --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going