libeval
libeval - RAG evaluation system. Evaluator orchestrates quality assessment using LLM-as-judge patterns. CriteriaEvaluator scores responses against rubrics. RecallEvaluator measures retrieval performance. TraceEvaluator analyzes execution traces. EvalStore persists results. Use for automated quality testing, RAG pipeline evaluation, and agent performance testing
npx skills add majiayu000/claude-skill-registry --skill libeval-copilot-ld-copilot-ld-2 --agent copilot
Same command for any agent — swap --agent for claude-code, codex, cursor.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# libeval Skill ## When to Use - Evaluating RAG agent response quality - Measuring retrieval recall and precision - Running automated quality assessments - Benchmarking agent performance over time ## Key Concepts **Evaluator**: Main orchestrator that runs test cases through the agent and collects metrics. **CriteriaEvaluator**: Uses LLM-as-judge to score responses against defined criteria and rubrics. **RecallEvaluator**: Measures how well the retrieval system returns relevant documents. **TraceEvaluator**: Analyzes execution traces for performance and correctness. ## Usage Patterns ### Pattern 1: Run evaluation suite ```javascript import { Evaluator } from "@copilot-ld/libeval"; const evaluator = new Evaluator(config); const results = await evaluator.run(testCases); console.log(results.summary); ``` ### Pattern 2: Criteria-based evaluation ```javascript import { CriteriaEvaluator } from "@copilot-ld/libeval"; const criteria = new CriteriaEvaluator(llmClient); const score = await criteria.evaluate(response, rubric); ``` ## Integration Configured via config/eval.yml. Run via `make eval`. Uses libllm for LLM-as-judge.
- When to Use
- Key Concepts
- Usage Patterns
- Pattern 1: Run evaluation suite
- Pattern 2: Criteria-based evaluation
- Integration
What does the libeval skill do?
libeval - RAG evaluation system. Evaluator orchestrates quality assessment using LLM-as-judge patterns. CriteriaEvaluator scores responses against rubrics. RecallEvaluator measures retrieval performance. TraceEvaluator analyzes execution traces. EvalStore persists results. Use for automated quality testing, RAG pipeline evaluation, and agent performance testing
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill libeval-copilot-ld-copilot-ld-2 --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.