00-build-evaluation-skill

npx skills add majiayu000/claude-skill-registry --skill 00-build-evaluation-skill --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

# Build Your Evaluation Skill Before learning about model evaluation, you will build the skill that captures that knowledge. This skill-first approach means every concept you learn gets encoded into a reusable asset that becomes part of your Digital FTE toolkit. When you fine-tune a model, how do you know it actually improved? A model might generate fluent text that completely misses the point. Evaluation frameworks provide systematic methods to measure what matters: accuracy, format compliance, reasoning quality, and safety. By the end of this chapter, you will have a skill that guides evaluation decisions for any fine-tuned model. ## Step 1: Clone Skills Lab Fresh Every chapter starts with a clean environment. This prevents state pollution from previous work and ensures reproducible results. ```bash # Navigate to your workspace cd ~/workspace # Clone fresh skills-lab (or reset if exists) if [ -d "skills-lab-llmops" ]; then rm -rf skills-lab-llmops fi git clone https://github.com/panaversity/skills-lab.git skills-lab-llmops cd skills-lab-llmops # Create chapter directory mkdir -p llmops-evaluation cd llmops-evaluation ``` **Output:** ``` Cloning into 'skills-lab-llmops'... remote:

Navigate to your workspace
cd ~/workspace
Clone fresh skills-lab (or reset if exists)
if [ -d "skills-lab-llmops" ]; then
rm -rf skills-lab-llmops
fi
git clone https://github.com/panaversity/skills-lab.git skills-lab-llmops
cd skills-lab-llmops
Create chapter directory
mkdir -p llmops-evaluation