S2ORC: The Semantic Scholar Open Research Corpus

Dan S. Weld; Kyle Lo; Lucy Lu Wang; Mark Neumann; Rodney Kinney

S2ORC: The Semantic Scholar Open Research Corpus

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1911.02782 v3 pith:JD3F7SA7 submitted 2019-11-07 cs.CL cs.DL

Kyle Lo , Lucy Lu Wang , Mark Neumann , Rodney Kinney , Dan S. Weld This is my paper · ORCID

classification cs.CLcs.DL

keywords academictextcorpuss2orcfullopenresearchabstracts

verification ladder T0 review T1 audit T2 compute T3 formal

0 comments

read the original abstract

We introduce S2ORC, a large corpus of 81.1M English-language academic papers spanning many academic disciplines. The corpus consists of rich metadata, paper abstracts, resolved bibliographic references, as well as structured full text for 8.1M open access papers. Full text is annotated with automatically-detected inline mentions of citations, figures, and tables, each linked to their corresponding paper objects. In S2ORC, we aggregate papers from hundreds of academic publishers and digital archives into a unified source, and create the largest publicly-available collection of machine-readable academic text to date. We hope this resource will facilitate research and development of tools and tasks for text mining over academic text.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. OpenAlex reports about 6 citations worldwide. Full citation record

Diagnosing our datasets: How does my language model learn clinical information?
cs.CL 2025-05 conditional novelty 6.0 of 10

The frequency of clinical jargon in pretraining corpora predicts how well open-source LLMs interpret that jargon, but hospital notes use abbreviations that appear only rarely online.

Pith tools