Agent skill · Data & Analytics

eacl-experiments

Use when designing or auditing the empirical evidence for an EACL paper, covering tuned and LLM baselines, multilingual breadth matched to the claim, significance and variance floors, human-evaluation agreement, data-contamination controls, ablations, and error taxonomies, so that every stated result is measured rather than asserted.

brycew6m878★ · +32/wk · 1 repos on radarProfile →
claude-codeMIT
Install
npx skills add brycewang-stanford/Awesome-Journal-Skills --skill eacl-experiments --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 1
SKILL.md size: 3 KB
Bundled scripts: none
Path: EACL-Skills/skills/eacl-experiments/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 909 · +31 this week
Language: Stata
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# EACL Experiments Use this to make an EACL paper's evidence hold up under NLP review. EACL rewards **well-scoped questions answered with careful controls** over leaderboard maximalism — its best papers include analyses and critiques, not only state-of-the-art systems (see `../../resources/exemplars/library.md`). Design the evidence to match the claim exactly, no broader. ## Baselines that make a comparison fair - Include a **tuned** baseline, not a strawman: an under-tuned competitor makes a win meaningless. State the search space for both your method and the baselines. - For LLM-based work, include the **obvious prompt/few-shot baseline** and report its prompts and decoding settings; a gain over an unreported baseline is not credible. ## Match breadth to the claim | Claim | Required breadth | |---|---| | "Works for language L" | Solid results on L, honestly scoped | | "Cross-lingual / multilingual" | Enough languages across resource levels; per-language results | | "General method" | Multiple tasks/datasets, not one convenient benchmark | | "Robust" | Stress tests / shifts, not just in-distribution | A multilingual claim backed by two high-resource languages is the classic EACL o

What's inside
Steps it walks through
  1. Baselines that make a comparison fair
  2. Match breadth to the claim
  3. Significance and variance floor
  4. Contamination controls
  5. Human evaluation done properly
  6. Error analysis as a first-class result
  7. Audit checklist
  8. Output format
More from Awesome-Journal-Skills
All skills →
About this skill
What does the eacl-experiments skill do?

Use when designing or auditing the empirical evidence for an EACL paper, covering tuned and LLM baselines, multilingual breadth matched to the claim, significance and variance floors, human-evaluation agreement, data-contamination controls, ablations, and error taxonomies, so that every stated result is measured rather than asserted.

How do I install it?

Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill eacl-experiments --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From brycewang-stanford/Awesome-Journal-Skills, a repository with 909 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going