Agent skill · Testing & QA

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

CherryHQgithub.com/CherryHQGitHub ↗
claude-codecodexships scriptsAGPL-3.0
Install
npx skills add CherryHQ/cherry-studio --skill skill-creator --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 18
SKILL.md size: 34 KB
Bundled scripts: yes
Version: 1.0.0
Path: resources/skills/skill-creator/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 49,400
Language: TypeScript
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

## Cherry Studio workflow (READ FIRST — overrides packaging / install steps below) You are running inside Cherry Studio. Skills live in a managed registry that Cherry keeps in sync with the filesystem automatically — there is **no** install or register tool to call, and you should **ignore** any `package_skill.py` / `.skill` packaging steps mentioned later in this file (they apply to Claude Code / Claude.ai, not here). **To create a new skill, write it straight into Cherry's managed skills directory:** 1. Resolve the directory once by running `echo "$CHERRY_STUDIO_SKILLS_DIR"` in Bash. That folder is Cherry's managed skill library. 2. Create `$CHERRY_STUDIO_SKILLS_DIR/<skill-folder-name>/` and write `SKILL.md` plus any supporting files (`scripts/`, `references/`, `assets/`) into it with your normal file tools. 3. That's it. Cherry's skill sync detects the new directory, registers it in the catalog, and lists it in the app — no register step. You can re-edit the files in place at any time and the changes are picked up on the next sync. Use a lowercase, hyphenated `<skill-folder-name>` (e.g. `my-cool-skill`). The `name:` field inside your `SKILL.md` frontmatter is the display name an

What's inside
Steps it walks through
  1. Cherry Studio workflow (READ FIRST — overrides packaging / install steps below)
  2. Communicating with the user
  3. Creating a skill
  4. Capture Intent
  5. Interview and Research
  6. Write the SKILL.md
  7. Skill Writing Guide
  8. Writing Style
  9. Test Cases
  10. Running and evaluating test cases
  11. Step 1: Spawn all runs (with-skill AND baseline) in the same turn
  12. Step 2: While runs are in progress, draft assertions
  13. Step 3: As runs complete, capture timing data
  14. Step 4: Grade, aggregate, and launch the viewer
Ships with 17 files
  • LICENSE.txt
  • agents/analyzer.md
  • agents/comparator.md
  • agents/grader.md
  • assets/eval_review.html
  • eval-viewer/generate_review.py
  • eval-viewer/viewer.html
  • references/schemas.md
  • scripts/__init__.py
  • scripts/aggregate_benchmark.py
  • scripts/generate_report.py
  • scripts/improve_description.py
  • scripts/package_skill.py
  • scripts/quick_validate.py
  • scripts/run_eval.py
  • scripts/run_loop.py
  • scripts/utils.py
Commands it runs
python -m scripts.aggregate_benchmark <workspace>/iteration-N --skill-name <name>
nohup python <skill-creator-path>/eval-viewer/generate_review.py \
kill $VIEWER_PID 2>/dev/null
python -m scripts.run_loop \
python -m scripts.package_skill <path/to/skill-folder>
More from cherry-studio
All skills →
About this skill
What does the skill-creator skill do?

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggering accuracy.

How do I install it?

Run `npx skills add CherryHQ/cherry-studio --skill skill-creator --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From CherryHQ/cherry-studio, a repository with 49,400 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going