arxiv-search

Solid

Retrieve arXiv paper metadata with keyword queries or import an offline arXiv export, and save results as JSONL (`papers/papers_raw.jsonl`).

Data & Documents 506 stars 39 forks Updated today

Install

View on GitHub

Quality Score: 81/100

Stars 20%
90
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
0
Description 5%
100

Skill Content

# arXiv Search (metadata-first) ## Triggers & routing - **Trigger**: arXiv, arxiv, paper search, metadata retrieval, 文献检索, 论文检索, 拉取元数据, 离线导入. - **Use when**: 需要一个初始论文集合(survey/snapshot 的 Stage C1),来源为 arXiv(在线检索或离线导入 export)。 Collect an initial paper set with enough metadata to support downstream ranking, taxonomy building, and citation generation. When online, prefer rich arXiv metadata (categories, arxiv_id, pdf_url, published/updated, etc.). When offline, accept an export and convert it cleanly. ## Load Order Always read: - `references/domain_pack_overview.md` — how domain packs drive topic-specific behavior Domain packs (loaded by topic match): - `assets/domain_packs/llm_agents.json` — pinned IDs, query rewrite rules for LLM agent topics ## Script Boundary Use `scripts/run.py` only for: - arXiv API retrieval and XML parsing - offline export conversion (CSV/JSON/JSONL normalization) - metadata enrichment via `id_list` backfill Do not treat `run.py` as the place for: - hardcoded topic detection or query rewriting (use domain packs) - domain-specific pinned paper lists (externalize to `assets/domain_packs/`) ## Contract-driven behavior - Domain-pack query rewriting is the default for broad discovery Workflows. - A focused Workflow may set `quality_contract.retrieval_policy.domain_pack_query_mode: explicit`; in that mode, the query list in `queries.md` remains authoritative and the domain pack must not replace its topic focus. - `quality_contract.retrieval_...

Details

Author
WILLOSCAR
Repository
WILLOSCAR/research-units-pipeline-skills
Created
8 months ago
Last Updated
today
Language
Python
License
None

Similar Skills

Semantically similar based on skill content — not just same category