Agent skill · Testing & QA

A/B Test Statistical Analyzer

Performs statistical analysis for A/B testing experiments

a5c-aigithub.com/a5c-aiGitHub ↗
claude-codecodexcan modify filesMIT
Install
npx skills add a5c-ai/babysitter --skill ab-test-statistical-analyzer --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 2 KB
Bundled scripts: none
Version: 1.0.0
Allowed tools: -Read-Write-Edit-Glob-Grep-Bash
Path: library/specializations/data-engineering-analytics/skills/ab-test-statistical-analyzer/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 1,642
Language: JavaScript

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# A/B Test Statistical Analyzer ## Overview Performs statistical analysis for A/B testing experiments. This skill provides rigorous statistical methods to determine experiment validity and significance. ## Capabilities - Sample size calculation - Statistical significance testing - Bayesian analysis - Sequential testing - Multi-armed bandit analysis - Segment analysis - Novelty/primacy effect detection - SRM (Sample Ratio Mismatch) detection - Confidence interval calculation - Power analysis ## Input Schema ```json { "experimentData": { "control": "object", "variants": ["object"] }, "metrics": [{ "name": "string", "type": "conversion|continuous|ratio" }], "analysisType": "frequentist|bayesian|sequential" } ``` ## Output Schema ```json { "results": [{ "metric": "string", "controlValue": "number", "variantValues": ["number"], "pValue": "number", "confidenceInterval": "object", "significant": "boolean" }], "srmCheck": "object", "recommendation": "string" } ``` ## Target Processes - A/B Testing Pipeline - Feature Store Setup ## Usage Guidelines 1. Provide complete experiment data for control and variants 2. Define metrics with appropriate types 3. Select analysis methodology based on re

What's inside
Steps it walks through
  1. Overview
  2. Capabilities
  3. Input Schema
  4. Output Schema
  5. Target Processes
  6. Usage Guidelines
  7. Best Practices
Ships with 1 file
  • README.md
More from babysitter
All skills →
About this skill
What does the A/B Test Statistical Analyzer skill do?

Performs statistical analysis for A/B testing experiments

How do I install it?

Run `npx skills add a5c-ai/babysitter --skill ab-test-statistical-analyzer --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From a5c-ai/babysitter, a repository with 1,642 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going