fulltext-retrieval

# Fulltext Retrieval Skill Batch download open-access full-text PDFs from a DOI list using legitimate OA APIs only. ## Pipeline ``` DOI → arXiv (10.48550/arXiv.* DOIs) → Unpaywall → PMC (Europe PMC / OA FTP / web) → OpenAlex → Crossref → landing page ``` Each DOI goes through these sources in order until a valid PDF (≥10 KB, `%PDF-` header) is found. arXiv DOIs (`10.48550/arXiv.2401.01234`, version suffixes, old-style `hep-th/9901001`, or a bare `arXiv:` id) resolve directly to the arXiv PDF first. ## Quick Start ```bash # Prepare a DOI list (one per line) cat > dois.txt << 'EOF' 10.1007/s00330-010-1783-x 10.1002/mp.12524 10.1148/radiol.13131265 EOF # Run python fetch_oa.py dois.txt --output pdfs/ --email your@email.com # Verbose mode for debugging python fetch_oa.py dois.txt -o pdfs/ -e your@email.com --verbose ``` ## Input Formats **Plain text** — one DOI per line: ``` 10.1007/s00330-010-1783-x 10.1002/mp.12524 ``` **TSV / CSV with header** — must contain a `DOI` column; optional `PMID` and `Title` columns: ```tsv ID Title DOI PMID Year 1 Some paper 10.1007/s00330-010-1783-x 20628747 2010 ``` **Markdown table** — a pipe table with a `DOI` column also works: ```markdown | DOI | PMID | Title | |-----|------|-------| | 10.1007/s00330-010-1783-x | 20628747 | Some paper | ``` When a PMID is available, the PMC lookup is more reliable (PMID → PMCID conversion). When a `Title` column is present, downloaded PDFs get a best-effort title cross-check (see *Retrieval report...