eacl-reproducibility
Use when running the Responsible NLP checklist as a claims audit for an EACL paper, covering hyperparameter and compute disclosure, verbatim prompt and decoding reporting, data-contamination stance, variance and significance reporting, multilingual coverage claims, and consistency between the checklist answers and what the paper actually contains.
Profile →npx skills add brycewang-stanford/Awesome-Journal-Skills --skill eacl-reproducibility --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# EACL Reproducibility Use this to audit an EACL paper against the **Responsible NLP checklist**, which ARR files at submission and which the action editor and reviewers read alongside the PDF. The checklist is not paperwork: **misleading answers are desk-rejection grounds**, and inconsistencies between the checklist and the paper are what careful EACL reviewers hunt for. Reopen the current checklist at `aclrollingreview.org/responsibleNLPresearch` before auditing. ## Treat the checklist as a claims audit Every "yes" in the checklist implies a location in the paper. Walk the paper claim by claim and confirm each is backed: | Claim type | Must disclose | Common EACL failure | |---|---|---| | Model results | Hyperparameters, tuning, model size | "Default settings" with no numbers | | Compute | Hardware, run time, total budget | Silent on cost of large runs | | LLM prompts | Verbatim prompts + decoding params | Paraphrased or omitted prompts | | Data | Source, license, splits, preprocessing | Undocumented or "on request" data | | Metrics | Variance over seeds / significance test | Single-run deltas reported as wins | | Multilingual | Languages, resource levels, per-language results |
- Treat the checklist as a claims audit
- Contamination stance (LLM era)
- Variance and significance floor
- Multilingual coverage honesty
- Checklist-to-paper consistency sweep
- Output format
What does the eacl-reproducibility skill do?
Use when running the Responsible NLP checklist as a claims audit for an EACL paper, covering hyperparameter and compute disclosure, verbatim prompt and decoding reporting, data-contamination stance, variance and significance reporting, multilingual coverage claims, and consistency between the checklist answers and what the paper actually contains.
How do I install it?
Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill eacl-reproducibility --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From brycewang-stanford/Awesome-Journal-Skills, a repository with 909 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.