bib-verify

Solid

Verify a BibTeX file for hallucinated or fabricated references by cross-checking every entry against CrossRef, arXiv, and DBLP. Reports each reference as verified, suspect, or not found, with field-level mismatch details (title, authors, year, DOI). Use when the user wants to check a .bib file for fake citations, validate references in a paper, or audit bibliography entries for accuracy.

AI & Automation 633 stars 54 forks Updated 3 days ago Apache-2.0

Install

View on GitHub

Quality Score: 92/100

Stars 20%
93
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# BibTeX Verification Skill Check every entry in a `.bib` file against real academic databases using the OpenJudge `PaperReviewPipeline` in BibTeX-only mode: 1. **Parse** — extract all entries from the `.bib` file 2. **Lookup** — query CrossRef, arXiv, and DBLP for each reference 3. **Match** — compare title, authors, year, and DOI 4. **Report** — flag each entry as `verified`, `suspect`, or `not_found` ## Prerequisites ```bash pip install py-openjudge litellm ``` ## Gather from user before running | Info | Required? | Notes | |------|-----------|-------| | BibTeX file path | Yes | `.bib` file to verify | | CrossRef email | No | Improves CrossRef API rate limits | ## Quick start ```bash # Verify a standalone .bib file python -m cookbooks.paper_review --bib_only references.bib # With CrossRef email for better rate limits python -m cookbooks.paper_review --bib_only references.bib --email your@email.com # Save report to a custom path python -m cookbooks.paper_review --bib_only references.bib \ --email your@email.com --output bib_report.md ``` ## Relevant options | Flag | Default | Description | |------|---------|-------------| | `--bib_only` | — | Path to `.bib` file (required for standalone verification) | | `--email` | — | CrossRef mailto — improves rate limits, recommended | | `--output` | auto | Output `.md` report path | | `--language` | `en` | Report language: `en` or `zh` | ## Interpreting results Each reference entry is assigned one of three statuses: | ...

Details

Author
agentscope-ai
Repository
agentscope-ai/OpenJudge
Created
10 months ago
Last Updated
3 days ago
Language
Python
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category

Data & Documents Listed

verify-refs

Audit-only verification of manuscript references against PubMed and CrossRef. Detects fabricated or mismatched citations and writes qc/reference_audit.json. Does not modify references/ or refs.bib.

126 Updated today
Aperivue
Data & Documents Listed

reference-verifier

Comprehensive academic reference auditor that performs four levels of verification on citations in uploaded manuscripts (.pdf, .docx). Level 1 checks if references actually exist. Level 2 verifies metadata accuracy (authors, year, journal, volume, pages). Level 3 checks whether the cited paper actually covers the topic it is cited for. Level 4 analyzes whether each citation is used correctly in context — confirming if the cited source truly supports, contradicts, or is neutral toward the claim being made. Saves a BibTeX file (.bib) and a markdown audit report (HTML optional) in the current working directory. Use whenever the user uploads a manuscript and asks to check, verify, validate, or audit references, citations, or bibliography, generate a .bib file, detect fake or hallucinated references, check citation accuracy, verify citation context, or audit a reference list. Especially tuned for biomedical/PubMed-indexed literature but works for any discipline.

0 Updated today
sbalci
Data & Documents Listed

reference-verifier

Comprehensive academic reference auditor that performs four levels of verification on citations in uploaded manuscripts (.pdf, .docx). Level 1 checks if references actually exist. Level 2 verifies metadata accuracy (authors, year, journal, volume, pages). Level 3 checks whether the cited paper actually covers the topic it is cited for. Level 4 analyzes whether each citation is used correctly in context — confirming if the cited source truly supports, contradicts, or is neutral toward the claim being made. Saves a BibTeX file (.bib) and a markdown audit report (HTML optional) in the current working directory. Use whenever the user uploads a manuscript and asks to check, verify, validate, or audit references, citations, or bibliography, generate a .bib file, detect fake or hallucinated references, check citation accuracy, verify citation context, or audit a reference list. Especially tuned for biomedical/PubMed-indexed literature but works for any discipline.

0 Updated today
patolojiAI
AI & Automation Solid

ref-hallucination-arena

Benchmark LLM reference recommendation capabilities by verifying every cited paper against Crossref, PubMed, arXiv, and DBLP. Measures hallucination rate, per-field accuracy (title/author/year/DOI), discipline breakdown, and year constraint compliance. Supports tool-augmented (ReAct + web search) mode. Use when the user asks to evaluate, benchmark, or compare models on academic reference hallucination, literature recommendation quality, or citation accuracy.

633 Updated 3 days ago
agentscope-ai
AI & Automation Solid

citation-audit

Zero-context verification that every bibliographic entry in the paper is real, correctly attributed, and used in a context the cited paper actually supports. Uses a fresh cross-model reviewer with web/DBLP/arXiv lookup to catch hallucinated authors, wrong years, fabricated venues, version mismatches, and wrong-context citations (cite present but the cited paper does not establish the claim). Use when user says "审查引用", "check citations", "citation audit", "verify references", "引用核对", or before submission to ensure bibliography integrity.

11,152 Updated today
wanshuiyin