paper-review

Solid

Review academic papers for correctness, quality, and novelty using OpenJudge's multi-stage pipeline. Supports PDF files and LaTeX source packages (.tar.gz/.zip). Covers 10 disciplines: cs, medicine, physics, chemistry, biology, economics, psychology, environmental_science, mathematics, social_sciences. Use when the user asks to review, evaluate, critique, or assess a research paper, check references, or verify a BibTeX file.

Data & Documents 633 stars 54 forks Updated 3 days ago Apache-2.0

Install

View on GitHub

Quality Score: 92/100

Stars 20%
93
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Paper Review Skill Multi-stage academic paper review using the OpenJudge `PaperReviewPipeline`: 1. **Safety check** — jailbreak detection + format validation 2. **Correctness** — objective errors (math, logic, data inconsistencies) 3. **Review** — quality, novelty, significance (score 1–6) 4. **Criticality** — severity of correctness issues 5. **BibTeX verification** — cross-checks references against CrossRef/arXiv/DBLP ## Prerequisites ```bash # Install OpenJudge pip install py-openjudge # Extra dependency for paper_review pip install litellm pip install pypdfium2 # only if using vision mode (use_vision_for_pdf=True) ``` ## Gather from user before running | Info | Required? | Notes | |------|-----------|-------| | Paper file path | Yes | PDF or .tar.gz/.zip TeX package | | API key | Yes | Env var preferred: `OPENAI_API_KEY`, `ANTHROPIC_API_KEY`, etc. | | Model name | No | `gpt-5.2`, `anthropic/claude-opus-4-6`, `dashscope/qwen-vl-plus`. See **Model selection** below | | Discipline | No | If not given, uses general CS/ML-oriented prompts | | Venue | No | e.g. `"NeurIPS 2025"`, `"The Lancet"` | | Instructions | No | Free-form reviewer guidance, e.g. `"Focus on experimental design"` | | Language | No | `"en"` (default) or `"zh"` for Simplified Chinese output | | BibTeX file | No | Required only for reference verification | | CrossRef email | No | Improves API rate limits for BibTeX verification | ## Quick start File type is auto-detected: `.pdf` → PDF review, `.tar....

Details

Author
agentscope-ai
Repository
agentscope-ai/OpenJudge
Created
10 months ago
Last Updated
3 days ago
Language
Python
License
Apache-2.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

academic-paper-reviewer

Multi-perspective academic paper review with dynamic reviewer personas. Simulates 5 independent reviewers (EIC + 3 peer reviewers + Devil's Advocate) with field-specific expertise. Supports full review, re-review (verification), quick assessment, methodology focus, Socratic guided, and calibration modes. Triggers on: review paper, peer review, manuscript review, referee report, review my paper, critique paper, simulate review, editorial review, calibrate reviewer, reviewer calibration, measure reviewer accuracy.

0 Updated 2 days ago
fabioc-aloha
Code & Development Solid

academic-paper-reviewer

Multi-perspective academic paper review with dynamic reviewer personas. Simulates 5 independent reviewers (EIC + 3 peer reviewers + Devil's Advocate) with field-specific expertise. Supports full review, re-review (verification), quick assessment, methodology focus, Socratic guided, and calibration modes. Triggers on: review paper, peer review, manuscript review, referee report, review my paper, critique paper, simulate review, editorial review, calibrate reviewer, reviewer calibration, measure reviewer accuracy.

25,522 Updated today
Imbad0202
AI & Automation Listed

paper-review

Use this skill when the user wants to simulate a review of their paper, check it before submission, or understand how reviewers might perceive it. Triggers include: "review my paper", "simulate review", "check before submit", "reviewer perspective", "will this get accepted". Also use before submission to catch weaknesses that reviewers would find.

2 Updated 4 days ago
charlotte-12s
Code & Development Solid

paper-self-review

This skill should be used when the user asks to "review paper quality", "check paper completeness", "validate paper structure", "self-review before submission", or mentions systematic paper quality checking. Provides comprehensive quality assurance checklist for academic papers.

4,135 Updated today
Galaxy-Dawn
AI & Automation Listed

paper-reviewer

Conduct a formal peer review of a scientific paper Heath did NOT author — for a journal he is reviewing for, or as a pre-submission read for a collaborator. Six-phase workflow with a Coordinator (segments paper + routes), 6 parallel specialist subagents (Methods Auditor, Logic Checker, Presentation, Journal Fit, Adversarial Reader, Citation Verifier), a Synthesizer, and a Refiner that applies the structural rubric (blocking vs advisory tags, 3:1 minor:major cap, action-oriented minor comments). Output is a markdown review tuned to Heath's voice via the bundled voice.md. Bundle reference content lives at `Shared drives/Blackmon Lab/ Projects/paper-reviewer/` (agents/, references/, checklists/, voice.md). TRIGGER on: "review this paper", "peer review", "referee for <journal>", "what do I think of this manuscript", a directory of review materials, mention of revision/rebuttal/response-to-reviewers. Distinct from `pre_submission_review` (which is for Heath's OWN drafts heading to submission, not papers he is revi

0 Updated yesterday
coleoguy