arxiv.org scrapers compared

Search 250M+ scholarly works on OpenAlex: title, authors, venue, year, citation count, open-access status. Most-cited first, with year and citation filters.

• crossref_metadata (crossref_metadata)
• search_preprints (search_preprints)
• citation_graph (citation_graph)
• search_pubmed (search_pubmed)
• literature_report (literature_report)
• Partial literature report (partial_literature_report)
• Literature report section (pay-per-use) (literature_report_section)

Per-tool invocation via MCP Standby

Charged per preprint paper record retrieved from ArXiv.

Event description unavailable.

One arXiv paper: title, authors, abstract, categories, PDF/abstract URLs, DOI, and dates.

Charged per paper returned.

One scraped record. No start fee, no minimum; failed or empty runs charge nothing.

Event description unavailable.

• arXiv paper extracted (paper_extracted)

One research paper with arXiv ID, title, full abstract, authors, primary and cross-list categories, submitted and updated dates, PDF link, DOI, and journal reference. First 2 rows per run are free so you can validate output.

Charged for each arXiv paper returned.

One successful arXiv paper record saved to the dataset.

Charged per paper scraped successfully returned

One result delivered by Open Knowledge Search for AI Agents.

One scholarly paper (after cross-source de-duplication) pushed to the dataset.

One arXiv paper's metadata (title, abstract, authors, categories, dates, DOI, links) from the official arXiv API.

One de-duplicated paper with metadata (title, authors, year, venue, IDs, abstract, citations, licence, links). Empty searches are free.

• Open-access full text (full-text)

One successful API request.

One unique paper record written. Empty searches and DOIs not found are free.

Paper (one scholarly work returned)

Charged per paper returned.

Charged once for every result row saved to the dataset.

One preprint row from arXiv, bioRxiv or medRxiv returned in the results, including an identifier that matched no preprint.

Charged for each item written to the dataset.

• Actor start (actor-start)

One papers scraped delivered. Failed items are recorded and not charged.

One arXiv paper returned from the official arXiv API: arXiv ID and version, title, abstract, authors, affiliations when arXiv has them, primary and all categories, first-submission and last-update dates, DOI, journal reference, comment, and links to the abstract page and PDF (the PDF itself is never downloaded). Rows that only explain a refused input, a search with no results, an ID arXiv does not have, an ID that was not looked up, or a request that could not be read are never charged.

Charged for each processed research query that is processed and delivered as a useful dataset row.

A data record returned by the scraper.

• ai_summary (ai_summary)
• ai_keywords (ai_keywords)
• ai_field (ai_field)

Charged for every item successfully extracted.

Event description unavailable.

One arXiv paper row with metadata and links

One arXiv paper with full metadata (title, abstract, authors, categories, PDF, DOI).

• Citation metrics (OpenAlex) (paper-metrics)
• Citing paper (citation-record)
• Reference (reference-record)

One scholarly paper (metadata record) returned in the dataset. Duplicates removed by deduplication and failed DOI lookups are free.

Search arXiv papers by keyword, author, or category

• Paper Details (get_paper_details)
• Author Profile (get_author_profile)
• Track Citations (track_citations)
• Trending Papers (get_trending_papers)

One watch monitored for one UTC day. The first day of a new watch is free, extra runs the same day are free, and a watch that fails that day is not charged.

Each result item pushed to the dataset

Charged for every batch of 10 AI research papers extracted from arXiv.

Per arXiv paper saved to the dataset

• Run started (start)