Agent skill · Code Review & Quality

rag-eval

Filesystem RAG benchmarks: corpus/, train.json, evaluate_rag.py (RAGAS quality). Not for prod monitoring, latency/throughput benchmarking (use rag-perf), or evals outside this repo layout.

NVIDIAgithub.com/NVIDIAGitHub ↗
claude-codecodexcan modify filesApache-2.0
Install
npx skills add NVIDIA/skills --skill rag-eval --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 10
SKILL.md size: 9 KB
Bundled scripts: none
Version: 2.6.0
Declared author: NVIDIA RAG <foundational-rag-dev@exchange.nvidia.com>
Allowed tools: ReadGrepGlobBash(ls*)Bash(python3*)Bash(uv*)WriteEdit
Requires: Repository checkout with uv; Python 3.11+; run from repo root; uv sync --project scripts/eval (eval deps live in…
Path: skills/rag-eval/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 2,789
Language: Python
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# On-disk RAG evaluation (`corpus/` + `train.json`) ## Purpose Guide agents through NVIDIA RAG Blueprint **filesystem** benchmarks: preparing `corpus/` and `train.json`, running `scripts/eval/evaluate_rag.py`, tuning retrieval and generation flags for **quality** comparisons, interpreting RAGAS JSON outputs, and triaging failures (HTTP/stream errors, empty contexts, collection mismatch, judge API)

More from skills
All skills →
About this skill
What does the rag-eval skill do?

Filesystem RAG benchmarks: corpus/, train.json, evaluate_rag.py (RAGAS quality). Not for prod monitoring, latency/throughput benchmarking (use rag-perf), or evals outside this repo layout.

How do I install it?

Run `npx skills add NVIDIA/skills --skill rag-eval --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From NVIDIA/skills, a repository with 2,789 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going