paper-review
Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.
npx skills add agentscope-ai/OpenJudge --skill paper-review --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Paper Review Skill Multi-stage academic paper review using the OpenJudge `PaperReviewPipeline`: 1. **Safety check** — jailbreak detection + format validation 2. **Correctness** — objective errors (math, logic, data inconsistencies) 3. **Review** — quality, novelty, significance (score 1–6) 4. **Criticality** — severity of correctness issues 5. **BibTeX verification** — cross-checks references against CrossRef/arXiv/DBLP ## Prerequisites ```bash # Install OpenJudge pip install py-openjudge # Extra dependency for paper_review pip install litellm pip install pypdfium2 # only if using vision mode (use_vision_for_pdf=True) ``` ## Gather from user before running | Info | Required? | Notes | |------|-----------|-------| | Paper file path | Yes | PDF or .tar.gz/.zip TeX package | | API key | Yes | Env var preferred: `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, etc. | | Model name | No | `gpt-5.2`, `anthropic/claude-opus-4-6`, `dashscope/qwen-vl-plus`. See **Model selection** below | | Discipline | No | If not given, uses general CS/ML-oriented prompts | | Venue | No | e.g. `"NeurIPS 2025"`, `"The Lancet"` | | Instructions | No | Free-form reviewer guidance, e.g. `"Focus on experimental design"
- Prerequisites
- Gather from user before running
- Quick start
- All options
- Interpreting results
- Model selection
- Additional resources
- Troubleshooting API errors
- AuthenticationError / 401
- NotFoundError / 404 — model not found
- BadRequestError / 400
- Connection error / endpoint not reachable
- Timeout
- After fixing, always re-run the full pipeline command.
Install OpenJudge pip install py-openjudge Extra dependency for paper_review pip install litellm pip install pypdfium2 # only if using vision mode (use_vision_for_pdf=True) Basic PDF review python -m cookbooks.paper_review paper.pdf With discipline and venue python -m cookbooks.paper_review paper.pdf \ Chinese output
What does the paper-review skill do?
Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.
How do I install it?
Run `npx skills add agentscope-ai/OpenJudge --skill paper-review --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From agentscope-ai/OpenJudge, a repository with 764 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.