langsmith-dataset
INVOKE THIS SKILL when creating evaluation datasets, uploading datasets to LangSmith, or managing existing datasets. Covers dataset types (final_response, single_step, trajectory, RAG), CLI management commands, SDK-based creation, and example management. Uses the langsmith CLI tool.
npx skills add majiayu000/claude-skill-registry --skill langsmith-dataset --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
<oneliner> Create, manage, and upload evaluation datasets to LangSmith for testing and validation. </oneliner> <setup> Environment Variables ```bash LANGSMITH_API_KEY=lsv2_pt_your_api_key_here # Required LANGSMITH_PROJECT=your-project-name # Check this to know which project has traces LANGSMITH_WORKSPACE_ID=your-workspace-id # Optional: for org-scoped keys ``` **IMPORTANT:** Always check the environment variables or `.env` file for `LANGSMITH_PROJECT` before querying or interacting with LangSmith. This tells you which project contains the relevant traces and data. If the LangSmith project is not available, use your best judgement to identify the right one. Python Dependencies ```bash pip install langsmith ``` JavaScript Dependencies ```bash npm install langsmith ``` CLI Tool ```bash curl -sSL https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.sh | sh ``` </setup> <usage> Use the `langsmith` CLI to manage datasets and examples. ### Dataset Commands - `langsmith dataset list` - List datasets in LangSmith - `langsmith dataset get <name-or-id>` - View dataset details - `langsmith dataset create --name <name>` - Create a new empty dataset - `langsmith data
- Dataset Commands
- Example Commands
- Experiment Commands
- Common Flags
- Creating Datasets
- From Exported Traces (Programmatic)
- Upload to LangSmith
- Using the SDK Directly
- Dataset Structures by Type
- Final Response
- Single Step
- Trajectory
- RAG
- CLI Usage
pip install langsmith npm install langsmith curl -sSL https://raw.githubusercontent.com/langchain-ai/langsmith-cli/main/scripts/install.sh | sh langsmith trace export ./traces --project my-project --limit 20 --full Upload local JSON file as a dataset langsmith dataset upload /tmp/dataset.json --name "My Evaluation Dataset" List all datasets langsmith dataset list Get dataset details langsmith dataset get "My Dataset"
What does the langsmith-dataset skill do?
INVOKE THIS SKILL when creating evaluation datasets, uploading datasets to LangSmith, or managing existing datasets. Covers dataset types (final_response, single_step, trajectory, RAG), CLI management commands, SDK-based creation, and example management. Uses the langsmith CLI tool.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill langsmith-dataset --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.