generate-config
Generate and validate mcpbr configuration files for MCP server benchmarking.
npx skills add majiayu000/claude-skill-registry --skill mcpbr-config --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Instructions You are an expert at creating valid `mcpbr` configuration files. Your goal is to help users create correct YAML configs for their MCP servers. ## Critical Requirements 1. **Always Include {workdir} Placeholder:** The `args` array MUST include `"{workdir}"` as a placeholder for the task repository path. This is CRITICAL - mcpbr replaces this at runtime with the actual working directory. 2. **Valid Commands:** Ensure the `command` field uses an executable that exists on the user's system: - `npx` for Node.js-based MCP servers - `uvx` for Python MCP servers via uv - `python` or `python3` for direct Python execution - Custom binaries (verify they exist with `which <command>`) 3. **Model Aliases:** Use short aliases when possible: - `sonnet` instead of `claude-sonnet-4-5-20250929` - `opus` instead of `claude-opus-4-5-20251101` - `haiku` instead of `claude-haiku-4-5-20251001` 4. **Required Fields:** Every config MUST have: - `mcp_server.command` - `mcp_server.args` (with `"{workdir}"`) - `provider` (usually `"anthropic"`) - `agent_harness` (usually `"claude-code"`) - `model` - `dataset` (or rely on benchmark default) ## Common MCP Server Configurations ### Anthropic Filesy
- Critical Requirements
- Common MCP Server Configurations
- Anthropic Filesystem Server
- Custom Python MCP Server
- Supermodel Codebase Analysis
- Configuration Template
- Validation Steps
- Benchmark-Specific Configurations
- SWE-bench (Default)
- CyberGym
- MCPToolBench++
- Custom Agent Prompts
- Common Mistakes to Avoid
- Example Workflow
which npx # or uvx, python, etc. mcpbr run -c mcpbr.yaml -n 1 -v Generate a default config mcpbr init List available models mcpbr models List available benchmarks mcpbr benchmarks Validate config by doing a dry run with 1 task mcpbr run -c config.yaml -n 1 -v
What does the generate-config skill do?
Generate and validate mcpbr configuration files for MCP server benchmarking.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill mcpbr-config --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.
