llm-evaluation
LLM testing and evaluation tools including promptfoo, trulens, and evals frameworks
npx skills add majiayu000/claude-skill-registry --skill llm-evaluation-flexnetos-ripple-env --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# LLM Evaluation Skills ## Overview This skill provides expertise in testing, evaluating, and monitoring LLM-based systems for robotics agents and AI assistants. ## promptfoo - LLM Testing Framework promptfoo is a CLI tool for testing and evaluating LLM prompts systematically. ### Installation ```bash # Via npm npm install -g promptfoo # Or via npx (no install) npx promptfoo@latest # Via Nix nix profile install nixpkgs#promptfoo ``` ### Basic Configuration ```yaml # promptfooconfig.yaml description: "Robot command parser evaluation" providers: - openai:gpt-4 - anthropic:claude-3-sonnet-20240229 - ollama:llama2 prompts: - file://prompts/robot_command.txt - | Parse the following user command into a structured robot action: Command: {{command}} Output JSON with: action, target, parameters tests: - vars: command: "Move forward 2 meters" assert: - type: contains-json - type: javascript value: output.action === 'move' - vars: command: "Pick up the red box" assert: - type: contains-json - type: javascript value: output.action === 'pick' && output.target === 'red box' - vars: command: "Navigate to the charging station" assert: - type: llm-rubric value: "The output should identify navigatio
- Overview
- promptfoo - LLM Testing Framework
- Installation
- Basic Configuration
- Test Assertions
- Running Tests
- CI/CD Integration
- Robot Command Parser Example
- TruLens - LLM App Evaluation
- Basic Usage
- Custom Feedback Functions
- RAG Evaluation
- Evaluation Metrics
- Standard Metrics
Via npm npm install -g promptfoo Or via npx (no install) npx promptfoo@latest Via Nix nix profile install nixpkgs#promptfoo Run evaluation promptfoo eval With specific config promptfoo eval -c promptfooconfig.yaml
What does the llm-evaluation skill do?
LLM testing and evaluation tools including promptfoo, trulens, and evals frameworks
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill llm-evaluation-flexnetos-ripple-env --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.