Agent skill · Code Review & Quality

paper-review

Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.

AgentScope-AI33,120★ · +381/wk · 2 repos on radarProfile →
claude-codeApache-2.0
Install
npx skills add agentscope-ai/OpenJudge --skill paper-review --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 2
SKILL.md size: 9 KB
Bundled scripts: none
Path: skills/paper-review/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 764
Language: Python

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Paper Review Skill Multi-stage academic paper review using the OpenJudge `PaperReviewPipeline`: 1. **Safety check** — jailbreak detection + format validation 2. **Correctness** — objective errors (math, logic, data inconsistencies) 3. **Review** — quality, novelty, significance (score 1–6) 4. **Criticality** — severity of correctness issues 5. **BibTeX verification** — cross-checks references against CrossRef/arXiv/DBLP ## Prerequisites ```bash # Install OpenJudge pip install py-openjudge # Extra dependency for paper_review pip install litellm pip install pypdfium2 # only if using vision mode (use_vision_for_pdf=True) ``` ## Gather from user before running | Info | Required? | Notes | |------|-----------|-------| | Paper file path | Yes | PDF or .tar.gz/.zip TeX package | | API key | Yes | Env var preferred: `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, etc. | | Model name | No | `gpt-5.2`, `anthropic/claude-opus-4-6`, `dashscope/qwen-vl-plus`. See **Model selection** below | | Discipline | No | If not given, uses general CS/ML-oriented prompts | | Venue | No | e.g. `"NeurIPS 2025"`, `"The Lancet"` | | Instructions | No | Free-form reviewer guidance, e.g. `"Focus on experimental design"

What's inside
Steps it walks through
  1. Prerequisites
  2. Gather from user before running
  3. Quick start
  4. All options
  5. Interpreting results
  6. Model selection
  7. Additional resources
  8. Troubleshooting API errors
  9. AuthenticationError / 401
  10. NotFoundError / 404 — model not found
  11. BadRequestError / 400
  12. Connection error / endpoint not reachable
  13. Timeout
  14. After fixing, always re-run the full pipeline command.
Ships with 1 file
  • reference.md
Commands it runs
Install OpenJudge
pip install py-openjudge
Extra dependency for paper_review
pip install litellm
pip install pypdfium2  # only if using vision mode (use_vision_for_pdf=True)
Basic PDF review
python -m cookbooks.paper_review paper.pdf
With discipline and venue
python -m cookbooks.paper_review paper.pdf \
Chinese output
More from OpenJudge
All skills →
About this skill
What does the paper-review skill do?

Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.

How do I install it?

Run `npx skills add agentscope-ai/OpenJudge --skill paper-review --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From agentscope-ai/OpenJudge, a repository with 764 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going