usenixsec-experiments
Use when designing or auditing the evaluation of a USENIX Security Symposium paper — building threat-model-faithful experiments, adaptive-attacker analysis for defenses, false-positive and vantage-point rigor for detection and measurement, ethical experimentation on live systems, and honest baselines.
Profile →npx skills add brycewang-stanford/Awesome-Journal-Skills --skill usenixsec-experiments --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# USENIX Security Experiments The evaluation is where USENIX Security papers are won or lost, and the committee reads it as an adversary would: looking for the experiment you did not run because it would have hurt. This skill audits security evaluations against the venue's specific rigor bars. It pairs with `usenixsec-reproducibility` (making runs regenerable) and `usenixsec-writing-style` (reporting them). ## Match the experiment to the claim type | Claim type | The experiment reviewers demand | The usual gap | |---|---|---| | Attack | End-to-end demonstration on a realistic target, success rate over trials | Works only in a toy setup; success rate is one lucky run | | Defense | **Adaptive** attacker who knows the defense, plus overhead | Evaluated only against the original, non-adaptive attack | | Detection | Detection rate **and** false-positive rate on realistic base rates | FPR measured on a clean dataset, not deployment traffic | | Measurement | Cross-vantage / cross-time validity of the finding | Single vantage, single snapshot, over-generalized | | System/protocol | Correctness + performance vs a credible baseline | Baseline is a strawman or an unoptimized reimplementation
- Match the experiment to the claim type
- The base-rate discipline for detection
- Statistical honesty for stochastic security results
- Experimenting on live systems, ethically
- Baselines and ablations that hold up
- Pre-submission evaluation audit
- Reverify each cycle
- Output format
What does the usenixsec-experiments skill do?
Use when designing or auditing the evaluation of a USENIX Security Symposium paper — building threat-model-faithful experiments, adaptive-attacker analysis for defenses, false-positive and vantage-point rigor for detection and measurement, ethical experimentation on live systems, and honest baselines.
How do I install it?
Run `npx skills add brycewang-stanford/Awesome-Journal-Skills --skill usenixsec-experiments --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From brycewang-stanford/Awesome-Journal-Skills, a repository with 909 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.