Agent skill · Security

codex-ab

Run an A/B codex review experiment — holistic codex review vs 3 focused dimension passes (security, ecto, liveview) on the branch diff, classify findings, report a panel-value verdict. Use when the branch is fresh, before any codex review runs.

oliver-kriskagithub.com/oliver-kriskaGitHub ↗
claude-codecodexships scriptsMIT
Install
npx skills add oliver-kriska/claude-elixir-phoenix --skill codex-ab --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 3
SKILL.md size: 4 KB
Bundled scripts: yes
Path: .claude/skills/codex-ab/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 515
Language: Python

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Codex Panel A/B (contributor instrument — verdict decided) Answer one question with evidence: **do dimension-focused codex passes find real issues that one holistic `codex exec review` misses?** Runs both on the same diff, then classifies every focused finding against the holistic pass. > **DECIDED 2026-07-10 after 4 runs (2 fresh): panel KILLED.** Fresh-only > 1 real miss / 1 false positive plus one zero-value run at 4× cost — > real misses did not outnumber FPs. Kept as contributor tooling (NOT > distributed) for one possible retest: a UI-heavy diff with a single > extra liveview-focused pass (2× cost). Scoreboard: > `.claude/research/2026-07-03-codex-review-integration.md` §7. ## Usage ``` /codex-ab # A/B against main (~5 min, 4 codex runs) /codex-ab develop # explicit base branch ``` ## Iron Laws 1. **FRESH DIFF ONLY** — ask the user to confirm this branch has NOT been codex-reviewed yet (cloud or `/phx:codex-loop`). A drained diff returns NO FINDINGS everywhere and proves nothing — wasted quota 2. **Verify every REAL MISS in the code before counting it** — a focused finding only scores if the issue actually exists at that file:line 3. **Read ONLY the findings `.md` files** —

What's inside
Steps it walks through
  1. Usage
  2. Iron Laws
  3. Workflow
  4. Step 1: Preflight
  5. Step 2: Run the A/B (background, ~5 min)
  6. Step 3: Classify
  7. Step 4: Verdict
  8. Integration
  9. References
Ships with 2 files
  • scripts/codex-panel-ab.sh
  • triggers.json
Commands it runs
bash ${CLAUDE_SKILL_DIR}/scripts/codex-panel-ab.sh {base} \
More from claude-elixir-phoenix
All skills →
About this skill
What does the codex-ab skill do?

Run an A/B codex review experiment — holistic codex review vs 3 focused dimension passes (security, ecto, liveview) on the branch diff, classify findings, report a panel-value verdict. Use when the branch is fresh, before any codex review runs.

How do I install it?

Run `npx skills add oliver-kriska/claude-elixir-phoenix --skill codex-ab --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From oliver-kriska/claude-elixir-phoenix, a repository with 515 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going