langsmith-testing-skill
CRITICAL for RAG: Every RAG query MUST be traced in LangSmith for observability. Silent failures (bad retrieval, hallucinations) are only detectable through tracing.'
npx skills add majiayu000/claude-skill-registry --skill langsmith-testing-skill --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
--- name: langsmith-testing version: 1.0 last_updated: 2025-12-04 description: LangSmith trace validation for RAG observability - every query must be traced license: MIT priority: critical triggers: - "LangSmith", "trace", "evaluation", "tracking", "observability" - RAG query execution - Evaluation tasks dependencies: - rag-accuracy-SKILL.md compatibility: - langchain: ">=0.1.0" - langsmith: ">=0.1.0" changelog: - version: 1.0 date: 2025-12-04 changes: - Initial release for RAG demo - LangSmith API integration - Trace collection and validation --- # 📊 LangSmith Testing SKILL ## Purpose **CRITICAL for RAG:** Every RAG query MUST be traced in LangSmith for observability. Silent failures (bad retrieval, hallucinations) are only detectable through tracing. --- ## Auto-Trigger Conditions **Activate when:** - User mentions: "LangSmith", "trace", "evaluation", "tracking" - RAG query execution - Evaluation tasks - Performance debugging --- ## LangSmith Setup ### 1. Installation ```bash # Python pip install langsmith langchain # Environment variables export LANGSMITH_API_KEY="your-api-key" export LANGCHAIN_TRACING_V2=true export LANGCHAIN_PROJECT="rag-demo" ``` ### 2. Basic Integration ```
- Purpose
- Auto-Trigger Conditions
- LangSmith Setup
- 1. Installation
- 2. Basic Integration
- Trace Collection
- 1. Automatic Tracing (Recommended)
- 2. Manual Tracing
- 3. Trace Metadata
- Metrics Collection
- 1. Core RAG Metrics
- 2. Custom Metrics (Faithfulness, Relevance)
- Trace Validation
- 1. Query Trace
Python pip install langsmith langchain Environment variables export LANGSMITH_API_KEY="your-api-key" export LANGCHAIN_TRACING_V2=true export LANGCHAIN_PROJECT="rag-demo"
What does the langsmith-testing-skill skill do?
CRITICAL for RAG: Every RAG query MUST be traced in LangSmith for observability. Silent failures (bad retrieval, hallucinations) are only detectable through tracing.'
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill langsmith-testing-skill --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.