sigmod-artifact-evaluation
Use when preparing a SIGMOD paper's code and data for the Availability & Reproducibility Initiative (ARI), covering the post-acceptance opt-in, HotCRP artifact registration, the Artifacts Available / Artifacts Evaluated / Results Reproduced badges, evaluator criteria, and the Best Artifact award path.
Profile →npx skills add brycewang-stanford/Awesome-Journal-Skills --skill sigmod-artifact-evaluation --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# SIGMOD Artifact Evaluation SIGMOD runs a named, long-standing artifact program: the **Availability & Reproducibility Initiative (ARI)** at `reproducibility.sigmod.org`. It is optional, happens **after acceptance**, and is decoupled from the accept/ reject decision — but its badges are embedded into the paper's PDF in the ACM Digital Library, so the payoff is permanent and public. Recent editions registered artifacts through a dedicated HotCRP site (e.g., `sigmod25ari.hotcrp.com`); confirm the current edition's site and dates before promising a timeline. ## The badge ladder | Badge | What evaluators must confirm | Typical blocker | |---|---|---| | Artifacts Available | Code, data, scripts, notebooks reachable at a stable public location | Link rot; "email us for the dataset" | | Artifacts Evaluated | Package is exercisable and well documented | Undocumented cluster assumptions | | Results Reproduced | Key results of the paper independently regenerated | Figures that need hand-tuned steps | Aim explicitly at one rung. A package engineered for Results Reproduced looks different from one that merely publishes source: it names which figures and tables constitute the "key results" and
- The badge ladder
- What ARI evaluators grade
- Hardware honesty
- Packaging pattern that passes
- Incentives beyond the badge
- Questions evaluators ask that READMEs rarely answer
- Sequencing with the paper lifecycle
- Output format
What does the sigmod-artifact-evaluation skill do?
Use when preparing a SIGMOD paper's code and data for the Availability & Reproducibility Initiative (ARI), covering the post-acceptance opt-in, HotCRP artifact registration, the Artifacts Available / Artifacts Evaluated / Results Reproduced badges, evaluator criteria, and the Best Artifact award path.
How do I install it?
Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill sigmod-artifact-evaluation --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From brycewang-stanford/Awesome-Journal-Skills, a repository with 909 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.