Pith. sign in

Paper Citation Record · LEDGER

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora

As of 13 August 2026, this Paper Citation Record lists 97 of 97 outbound references and 0 inbound Pith citation observations for arXiv:2608.09093.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.09093 v1

Coverage vector

measured 97 of 97 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T23:46:08.884591Z

measured 97 of 97 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

97 of 97 outbound references displayed

  • verified exact16
  • verified fuzzy28
  • unresolved50
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7d80d665-7783-47b8-b398-985c485bc325 · outbound

This paper cites OLMo-core: src/scripts/official/OLMo3/.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OLMo-core: src/scripts/official/OLMo3/

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.516340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.516340Z digest=sha256:585e22a28db1e858d27593332fca3730f37e2fe883f069209651b408b13c5590

Observation 7b1702d0-a405-4401-b8c6-294d43e24ab5 · outbound

This paper cites Physics of Language Models: Part 3.1, Knowledge Storage and Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.520788Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.520788Z digest=sha256:7a0cecd5417b369d066737b6db1d5a6ab9816bdc03e1e013f63b4676a6433d5a

Observation 08c41e25-757f-40c0-b855-2fd6185ed4d1 · outbound

This paper cites Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.525122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.525122Z digest=sha256:dd03f74c962dbf5fa0c29b569fb34f51a4a43848989bfa6988598d1d5dc24531

Observation 2ca7b3bd-3eec-4f70-879a-c680a63efbe1 · outbound

This paper cites Álvarez-Lacalle, B.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Álvarez-Lacalle, B

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.529259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.529259Z digest=sha256:31657a99c6a9557356d4bc6b290824bcdb06b39f5456f9677e4d6a12913fa63d

Observation a7e1a1d5-c899-4e67-8e42-2ff258354cfc · outbound

This paper cites Predicting the Emergence of Induction Heads in Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.533454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.533454Z digest=sha256:b7e161501e70d1458f33a52201ec10ec1839e37a015557a01ffffcd971b655db

Observation 4b526753-8d16-4b72-9684-f05e771197f8 · outbound

This paper cites Docling Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Docling Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.537942Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.537942Z digest=sha256:01727355d1cfb11b08f1bab7207195f5d97e03e328df309461f0491508f0aa38

Observation 3ee3c7b5-e28b-4441-98da-1e15113f6aae · outbound

This paper cites Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.988195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.542506Z digest=sha256:dfd83b83c5f8ea3be011b61e79f05151b61df4c27eed169309e86326666b5d6e

Observation 281a80ca-56a9-4770-bf0d-cf4a8498a064 · outbound

This paper cites One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.972459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.546573Z digest=sha256:88843a66081968e9783d00ecd0f9cf55f0603d57c2c415836585ded3182557f2

Observation 41bcf5ad-13c7-433a-a79e-24192c9b15cb · outbound

This paper cites trafilatura: trafilatura/xml.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora trafilatura: trafilatura/xml.py

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.550671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.550671Z digest=sha256:756b603e887893f44d2d0db11435960c994da040611f57db02ee6c6dae6ff304

Observation fe866f33-5d83-4152-a709-23cb068733a7 · outbound

This paper cites so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.554957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.554957Z digest=sha256:9c49d888c9ca189ff0b3b53c562f68b912a9a5c3ce68e5520a4ed156d4145fe6

Observation 2f9d920d-da0f-464f-9bd6-bbb8cda7e9ab · outbound

This paper cites Datasheet for the Pile.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheet for the Pile

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.558757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.558757Z digest=sha256:3b41860c767f1cfd334f875e7232aa3d36fa336afab211094488b88484ad3f8e

Observation f461e1e9-fc02-44e2-8ec1-199119b99b6c · outbound

This paper cites Document structure in long document transformers.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Document structure in long document transformers

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.562683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.562683Z digest=sha256:77967b96e7412395ee90ddafc388c13ff45cf611db11f4ab8122fc9408d49e15

Observation 8de5518a-bc11-4239-b640-0938ff3c83a7 · outbound

This paper cites Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.566283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.566283Z digest=sha256:b906cb8f1a9fece794b3b0ad79844391bb818835f917df3afbc83e9ef86f9a76

Observation 43aa3385-dc1c-4f16-b758-417d27f747bb · outbound

This paper cites The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.570096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.570096Z digest=sha256:a87631ff7fbb48abc46a49fed4b5a0861ac7636932ef63bbdc49e920a19ab772

Observation 156cc986-1daa-496c-8fe1-8c5cc669b1fc · outbound

This paper cites LADM: Long-context training data selection with attention-based dependency measurement for LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LADM: Long-context training data selection with attention-based dependency measurement for LLMs

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.573675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.573675Z digest=sha256:203b61e2c7b7a6e9fe6c1dcdae707300d5cbfb04ff2bf3c520590b6db475b020

Observation 4d1abd8a-90fd-4fb2-a152-b747d8e0faf0 · outbound

This paper cites Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining

Reference 16

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.934456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.577429Z digest=sha256:fdd45091bbc3414ada4dcce81c10e1dcbd27341d91db2385bc8af3a713e5e367

Observation d160b479-63d7-48c9-9ddb-34bcb237ebf9 · outbound

This paper cites Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.581164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.581164Z digest=sha256:3314a46af86f902c8bab98ea2c0ea5f7c76d0e744b998909f5e0518e1307edc0

Observation 1e9d02fe-702a-4a6d-9bd9-36f582b86f14 · outbound

This paper cites BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.585204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.585204Z digest=sha256:e5f2d62947d06d9c459111a2dd004955d4efa510fa53b3ed0ed009bc20f18e74

Observation 0027d995-38f6-4114-be5c-b034cb9789c5 · outbound

This paper cites DeepSeek-V3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DeepSeek-V3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.589022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.589022Z digest=sha256:45562944e184038129ac11c39a9b2b9d517ed9325b3f1a4d3179747c7d0eb59e

Observation d17b519e-7057-4453-a0ee-27e1357acfee · outbound

This paper cites Beyond length: Quantifying long-range information for long-context LLM pretraining data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond length: Quantifying long-range information for long-context LLM pretraining data

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.592974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.592974Z digest=sha256:8f3ed7557eddc115c4fbec5cffa8a17cd002c1613971f8d76f62ded6a0c60a5a

Observation dc48d7d6-ec33-42c2-a612-f06bfed0e0b9 · outbound

This paper cites Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.596787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.596787Z digest=sha256:8425df46db8c5de79ab1d6cade41f86f659bf1a151b529a8503bb7f257ae492b

Observation 60dba6c3-a6b3-4fb0-b134-fa4678e33448 · outbound

This paper cites Smith, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Smith, and Jesse Dodge

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.600442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.600442Z digest=sha256:e6f53aa3bd1da179fb1af89c99db4c6c4a256d0a64188de79d051a15d989eb09

Observation 2f086de1-d48e-434e-9b24-b4b1eb57ce2e · outbound

This paper cites DoGE: Domain Reweighting with Generalization Estimation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DoGE: Domain Reweighting with Generalization Estimation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.603929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.603929Z digest=sha256:1cccf55515576a5e493f34d76ed0a15a306eafc39d2868a43df14d59b598e618

Observation a3e7197c-7b1b-46bc-a46d-1c4d09f3ff21 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 24

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.886029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.607893Z digest=sha256:412a99429adab3d94d3721ba7bf58ad226a2e34a0842a9d697b0efcfb2ca8407

Observation 3e9aba69-4f7d-463e-95a0-eb3bf5b0e4bf · outbound

This paper cites NExtLong: Toward effective long-context training without long documents.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora NExtLong: Toward effective long-context training without long documents

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.611346Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.611346Z digest=sha256:02dcae0d996428ebced04fcb56b77269c2dac2e4f73d7f2230d6c9e44ab159f5

Observation 780f5689-7f57-44f5-ba34-548b09c5bf5b · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.615026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.615026Z digest=sha256:567b998dd522ee37fe93b15bfa5af64fec5007fcb3645df506687209dc95b902

Observation 752ff431-3dd6-4c6f-a132-661c6eab5275 · outbound

This paper cites Wichmann.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Wichmann

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.618858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.618858Z digest=sha256:c56e075d9017ed03f8e34a2dd61d9b38bace876bd8b5bf4d181886cd7e045f12

Observation fbbda0e3-3cdd-4758-98c2-c72dd6e775a1 · outbound

This paper cites Hermann, Hossein Mobahi, Thomas Fel, and Michael C.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hermann, Hossein Mobahi, Thomas Fel, and Michael C

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.622436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.622436Z digest=sha256:1e96b1d3af6317ac504db2c2f14a9e019bd88ee3aecb5b62ff7d186766605d27

Observation b64d7edb-c0ac-44e5-85ea-1cc7665e7609 · outbound

This paper cites The curious case of neural text degeneration.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The curious case of neural text degeneration

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.626015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.626015Z digest=sha256:3dac09774f284aea80ace49d32e8ec9457804f83dd276ff0cc90956b8c1daea8

Observation aa679acf-0007-439e-b231-fad4420d4a08 · outbound

This paper cites FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.629298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.629298Z digest=sha256:7c3b6a072d158d396dceb7f06721bdab3e59dba4cadbc3f79d893578e9105b76

Observation 3c955657-891e-4f49-84d4-8db2aa5e1140 · outbound

This paper cites SmolLM3: smol, multilingual, long-context reasoner.https://huggingface.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora SmolLM3: smol, multilingual, long-context reasoner.https://huggingface

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.632840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.632840Z digest=sha256:5349aeec077a647c3286e4c59022e3ec7d9b1340626cfd47ce20b054b1e2c683

Observation 862abf38-3a6a-40c5-93b0-a12c7dca6b4e · outbound

This paper cites datatrove: src/datatrove/pipeline/extractors/trafilatura.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora datatrove: src/datatrove/pipeline/extractors/trafilatura.py

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.636370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.636370Z digest=sha256:8c53a63ee048a205f9f6b8f5215c6bf97e058e16878f1311f23576aa9716163a

Observation 26f2f108-79da-4d13-9933-880d8f48d324 · outbound

This paper cites propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,

Reference 33

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.797822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.640149Z digest=sha256:9f4c42e75474b3037e4b7e1c2a4adace9f7d4d3fc7b6c655c381ac540f43ce5d

Observation 8fd8c20a-b9e8-4d63-8eb5-69148ae621eb · outbound

This paper cites ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.372740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.648169Z digest=sha256:edb3619c1ca5d01b167d197fa59e03d29bc7772c3d1688cd2c24abb23fd40567

Observation 20791109-1ad6-4676-8a88-0b2e79946650 · outbound

This paper cites EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.651907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.651907Z digest=sha256:c1cd7d823c4eb06926a17e4ba8a193539a4733d404a18f3acbead5bc0d8d0cdc

Observation 8d9332d1-f141-423a-b1ca-9e2f33cbea40 · outbound

This paper cites Characterizing Narrative Content in Web-scale LLM Pretraining Data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Characterizing Narrative Content in Web-scale LLM Pretraining Data

Reference 36

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.650579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.655949Z digest=sha256:ce2754699367f509dd6a24e77597de3bc4e84bafc53219143a7a82fe005f5864

Observation b3db8665-93de-423c-ab03-44d3c2ed960e · outbound

This paper cites The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.659888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.659888Z digest=sha256:0efd2470f84e21c329ca08e56c56f042126509c4843a9069a5f08921a9625b37

Observation 8770db68-bc35-41c0-a8bd-1816e6f2bbc5 · outbound

This paper cites Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.663478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.663478Z digest=sha256:b27561a0155f2e16817d9a621bce2b05e3d63083f3748032cff620cdfa9e0866

Observation 063ebcf7-a380-4951-96a6-57115306b83a · outbound

This paper cites Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.361337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.667449Z digest=sha256:55e07b00c352f4313a18d363bcf380d3e886213402287853ba7d5bf29cdbbe5c

Observation 0898c310-284c-4ae5-a459-5fe06675fb02 · outbound

This paper cites Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.349832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.670936Z digest=sha256:aa411825c76cb3510da3c02ebde022b9478fb3e4b3ba60e069974eaf1e87db78

Observation f27ed3ec-bb4c-46b4-ae4d-2a9b886c6118 · outbound

This paper cites The Format Tax.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Format Tax

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.674823Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.674823Z digest=sha256:2c3a869fa368c86cc770010834e83d960d246671d185c59fb836a4c236a4dbad

Observation 04a49aa9-d9a4-4fad-9e93-22da0bd35bbf · outbound

This paper cites DataComp-LM: In search of the next generation of training sets for language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DataComp-LM: In search of the next generation of training sets for language models

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.338832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.678804Z digest=sha256:aba2b22458c93a3e94e79c7c33533e4f6f6012ec3bfe73b5fe4035ca7963ac69

Observation aa88155a-04b1-45bd-afa0-d5877de7cee9 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.328421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.682276Z digest=sha256:85e2e56f0b08a1f1458c459faf516737784233838406555793a133e75219e9ff

Observation 6aa3bdc4-83d8-4685-9b83-2bf562688710 · outbound

This paper cites Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction

Reference 44

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.604854Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.689681Z digest=sha256:3644cedd44e11e945636d9d749834066c981a98ba4dc9456a849afcf83b240a1

Observation 401910f7-8ab2-4722-a830-9af0d7ee73e4 · outbound

This paper cites URLhttps://aclanthology.org/2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora URLhttps://aclanthology.org/2026

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.317293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.685954Z digest=sha256:48036e03f1c21a3d07ea48445680c5393e557395524f3aacf3a6d9ad686d28a1

Observation 961851e4-9ba4-43ca-8d08-4eca71cb8af8 · outbound

This paper cites Improving Cross-Format Robustness in Language Models with Multi-Format Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Improving Cross-Format Robustness in Language Models with Multi-Format Training

Reference 46

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.589660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.697003Z digest=sha256:cecca84eafb92055b8a2b0081414087617df9490961c19881c8fa30866f3b9a0

Observation 25f795c0-df9c-40f4-9f66-2c55d3361661 · outbound

This paper cites Lin and Max Tegmark.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Lin and Max Tegmark

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.306962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.693474Z digest=sha256:c7d1943a14c2181e32a46d9581bb50c5b037cb4d6212e8884e8fe7adc220ed98

Observation 7d56fd29-a374-40ca-90a0-4d17fc40d3bb · outbound

This paper cites RegMix: Data mixture as regression for language model pre-training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RegMix: Data mixture as regression for language model pre-training

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.295866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.704493Z digest=sha256:b0f3b10fec2e622592753a31d8f6e2f06341c2dbd490b7cab9dfedbd9b140f09

Observation 870ff3b3-931c-4fa5-a01d-ef7c61816860 · outbound

This paper cites Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.700743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.700743Z digest=sha256:6e0f0469c87834567cb3b547960b183efbae70f65eda8bd6eb0f6aba676d7268

Observation 3ad61780-a039-46e8-8f0e-eb7cfe61e40d · outbound

This paper cites The Llama 3 Herd of Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Llama 3 Herd of Models

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.712036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.712036Z digest=sha256:09d82d74b3e8a09b68e4b36843f4fc852abb3f42ae074aa4a034e8b26d32a07e

Observation caddb278-c690-4090-852b-6567f647e123 · outbound

This paper cites Sentence-Level Contextual Entrainment in Large Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Sentence-Level Contextual Entrainment in Large Language Models

Reference 51

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.507694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.708161Z digest=sha256:5d889d58091973d973f7ff61fefd7d58462885f7a769f177ea5251f51cc56aba

Observation b5137b5c-cf5d-47a5-84ea-9e466309a633 · outbound

This paper cites AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025

Reference 52

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.481795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.719503Z digest=sha256:494a717db68a9636ec6eef8c89cf55075dc99574433b6ffef95ba9f762ebf83f

Observation 93ae5958-d8be-46eb-85f4-3c175b4b06f0 · outbound

This paper cites Klein, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Klein, and Jesse Dodge

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.284672Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.715836Z digest=sha256:365e907d36c1f48d8ad27c5eb118ce51c0b7d8c53f4acab3de7001d65db4f017

Observation 10e8715e-bef4-4679-b9da-9eb126cf768c · outbound

This paper cites Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.273034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.726933Z digest=sha256:4a80d0633ea7807cfbbdaf5616b49799ae15c4fef5887698cd057b4f75b613a6

Observation 444cfb4f-cdf9-472d-976a-a057fb97ee46 · outbound

This paper cites Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.722972Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.722972Z digest=sha256:19172c311b570ed66c4d5c33f32520da21ca5ea14ff98853a840a29eb62eeabf

Observation aa540b93-f654-4ab3-84f3-d1e757d5e802 · outbound

This paper cites Register always matters: Analysis of LLM pretraining data through the lens of language variation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Register always matters: Analysis of LLM pretraining data through the lens of language variation

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.249473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.734114Z digest=sha256:34d95ce62b138edb4d2aea6b263a5b29fcd2872f6b4130da11062447002240c5

Observation 97697682-5627-4c5a-a214-f2ee8e11b7c1 · outbound

This paper cites Autocorrelations decay in texts and applicability limits of language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Autocorrelations decay in texts and applicability limits of language models

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.261287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.730477Z digest=sha256:3104c247d8980c05bdcd147df9b7cd73e9cadb3f489643f597f8d63df3de236c

Observation b557be46-2c86-42f9-b7f5-81062df62b81 · outbound

This paper cites OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling

Reference 58

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.381154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.741761Z digest=sha256:89375ed93798c56c4c5ccfbbbed227a152da99a01bc77170eaf11debd492fc14

Observation 51c0e49c-0dc6-42b7-bf33-b9b0d4c9e571 · outbound

This paper cites How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.237160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.738014Z digest=sha256:035871d1e47dcc34ef466b8f5464d37e785acb112655778e310bd889c05b279f

Observation c942c904-4efd-4d69-986e-b685988a64f1 · outbound

This paper cites Chapter captor: Text segmentation in novels.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Chapter captor: Text segmentation in novels

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.212033Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.749302Z digest=sha256:a5ca7ad5f9fa948913a8cc375fd4dfba2baa868aff32d7ef0af3f1f13603f350

Observation f850bd65-f37e-43a8-aa69-76b26ee8073d · outbound

This paper cites The FineWeb datasets: Decanting the web for the finest text data at scale.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The FineWeb datasets: Decanting the web for the finest text data at scale

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.224614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.745705Z digest=sha256:6fb992f82b4be9fea2b524ab08e0b80addf4dae938a153f9acbe071431c22c20

Observation 5621d9f2-4963-4970-9a38-b58d6e7f334c · outbound

This paper cites epub2txt-all (the Books3 converter).

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora epub2txt-all (the Books3 converter)

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.199905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.756470Z digest=sha256:a25c259515267137c36380a5a18c77014c6da70fbfa738282018439b4dc0d394

Observation 4d9838a3-5ba8-4b88-9e4c-f7158e283ada · outbound

This paper cites olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.752778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.752778Z digest=sha256:732c05de941c25f54a51553cfec6682ba6498c75bd425fa6ad4209f64b97e4d3

Observation 446a9c39-3345-49e4-9aef-f56c30b97526 · outbound

This paper cites Compressive Transformers for Long-Range Sequence Modelling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Compressive Transformers for Long-Range Sequence Modelling

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.767917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.767917Z digest=sha256:1bc2254b6d7e21497a0c98725c4bc2fef5c811662a18ab2fcd554a913dde110a

Observation a7ceff82-8002-4e0a-be0d-3efb1465cc9e · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.772122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.772122Z digest=sha256:7192b4ce58016ce616930ee4bb24f4e58241cb8c365adf81d88a43eed3e76dce

Observation a0bb3eb7-1ceb-47b6-bf73-1ed42815cf9c · outbound

This paper cites Qwen3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Qwen3 Technical Report

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.764228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.764228Z digest=sha256:b925bcc6739363382178601271bed5dec6a0972977c5148897fb9d0bcbe40e03

Observation 36d60be1-2d4a-48ba-8dda-7d2d8d797a99 · outbound

This paper cites From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026

Reference 67

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.276678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.779814Z digest=sha256:01fee3c1b98b50cb8291445429eb955d75d3595f76a311ca57984569e775c91c

Observation 750a02df-cc2a-49d0-a0b3-b44af8141697 · outbound

This paper cites Scale-dependent Relationships in Natural Language.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scale-dependent Relationships in Natural Language

Reference 68

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.126130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.783358Z digest=sha256:74839f036cb7fd79c7b4a8a7de9b66cc9079f4ecb10cc0e124f0385bfa5963c9

Observation b128d4cb-385d-4b47-b6b6-327a3051d027 · outbound

This paper cites RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.171029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.775948Z digest=sha256:ac6c0c2ad53aa1377a0325a9561abb5e34d11814822ee66a5707d35b6a4e0644

Observation a1587bca-a466-47c0-b32e-464756d736b5 · outbound

This paper cites Dolma: an open corpus of three trillion tokens for language model pretraining research.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dolma: an open corpus of three trillion tokens for language model pretraining research

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.160064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.791038Z digest=sha256:45506c675ed3c7930badbe85d6fd8b411bbfdf677b2a2e1db41bc47a3d17f458

Observation 29167a1b-8011-4c3f-900d-5dc057727d6c · outbound

This paper cites Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.149510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.794756Z digest=sha256:b62cc78db6627b8959908286fb3c2cf02025a7b2d69ae3d054e4d0da37d8b0a8

Observation 62b3ba69-8815-4713-bb09-6d9e2ed0ef23 · outbound

This paper cites Mutual Information Scaling and Expressive Power of Sequence Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Mutual Information Scaling and Expressive Power of Sequence Models

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.787163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.787163Z digest=sha256:944e8aa8365fa9655b8eebaca7fbafce174be8844b5d09eef1d1bf413dbb1f4d

Observation da602af8-0010-4589-8474-d649bc5a0871 · outbound

This paper cites ChapterBreak: A challenge dataset for long-range language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ChapterBreak: A challenge dataset for long-range language models

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.126803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.801750Z digest=sha256:4d573b8ed8da683408ef7dcbb9bb354c1369221574d8f6d4a86addf72e0af4dc

Observation 76e0f288-a66c-47b6-a6e8-09f72bfec00d · outbound

This paper cites Accessed 2026-08-09.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Accessed 2026-08-09

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.115418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.805338Z digest=sha256:7d1e1139e49ac96ec857eb871cc0b7a4103eaa3b9bcc8544e4f6b3ada9fe576b

Observation a4994bef-5a84-4127-a17e-4746bbf90d83 · outbound

This paper cites Zico Kolter, and Zhuang Liu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zico Kolter, and Zhuang Liu

Reference 75

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.137800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.798336Z digest=sha256:45eaba6b44ba6d16f0cd683d3a44702461c91d7a75d474ab853c82703b80f893

Observation 5550b4f1-6a93-4bcb-b9a6-2ca0d227321a · outbound

This paper cites Olmo 3.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Olmo 3

Reference 76

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.812864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.812864Z digest=sha256:48b358478603910a05ef93dc49227738e77bbf02e8b2bdc921c3d3d918801b7e

Observation 289ede77-7263-4f8d-a5f7-ef76910dc4c5 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LLaMA: Open and Efficient Foundation Language Models

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.816699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.816699Z digest=sha256:db7566f028f74152777a6b736dbc4a9053f1508aa2eb0f6c5f010523c6c10a76

Observation d8d3ea3d-4234-465e-a029-1c2afa2026c7 · outbound

This paper cites Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training

Reference 78

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.099133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.808708Z digest=sha256:75d32b5bbb4a588341ef901822f35e8b008bdf653aaa62d79a751c7feb4dfe3b

Observation 0e46ee02-9ea8-4e60-90cc-bbb5544db8d6 · outbound

This paper cites MinerU: An Open-Source Solution for Precise Document Content Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora MinerU: An Open-Source Solution for Precise Document Content Extraction

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.824450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.824450Z digest=sha256:d69a19dc6e19f8d8669b51f09690acfdb15fedb3890ab09bdad0977dd275e3e1

Observation ea6d276c-610c-4bd9-a5b5-32e35470cdcd · outbound

This paper cites PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

Reference 80

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.034640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.828474Z digest=sha256:2551e88080287237fc43660e26d6f36ccc3b36c933a363929b6880b238fe435d

Observation 919507d1-adee-44a2-83b1-faa97958128e · outbound

This paper cites Right Reset: Chunking by Prefix Removal.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Right Reset: Chunking by Prefix Removal

Reference 81

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.062126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.820342Z digest=sha256:3977cced8fc6be0f2595df9f8e675e4eb663d39dbc5bac67f6d74ad5b1c6df61

Observation 98108d02-c141-47d1-b782-01ac336a211b · outbound

This paper cites LongAttn: Selecting Long-context Training Data via Token-level Attention.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LongAttn: Selecting Long-context Training Data via Token-level Attention

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.837385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.837385Z digest=sha256:3a289427ddf47023f5aabb984645742642f56c1eff454054d6a570328512268f

Observation bf2ba5af-8693-43c8-be69-52a84b441af7 · outbound

This paper cites Morris, and Lionel Levine.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Morris, and Lionel Levine

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.104141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.841338Z digest=sha256:7b5e2173305eb32d547d53e92ee6acbea232923d0e974c357fe69bc1b82630fb

Observation f755bad9-c5f7-4fd5-aac2-ad53e0bfc3d9 · outbound

This paper cites Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability

Reference 84

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.832563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.832563Z digest=sha256:851486be6a22593a80b7228e48da4af86de24ad32547d29df514ae93a5579009

Observation 2f060d25-0c30-40be-b921-38c88aca8d45 · outbound

This paper cites Learning to break the loop: Analyzing and mitigating repetitions for neural text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Learning to break the loop: Analyzing and mitigating repetitions for neural text generation

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.081092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.848523Z digest=sha256:69ed3fd2d06ecd5c6edd33d4197c2490963dce0b3865c9978338516e1e49a8ab

Observation ab284549-a24a-4633-b8d2-26b4f68c11b5 · outbound

This paper cites Data mixing laws: Optimizing data mixtures by predicting language modeling performance.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing laws: Optimizing data mixtures by predicting language modeling performance

Reference 86

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.069815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.852100Z digest=sha256:927cfe0d881335164fffa80a272fc0d544aee10b1e97d5661dad2550537e9f87

Observation 3478cf59-34f1-41c0-aec3-6735908add7d · outbound

This paper cites Le, Tengyu Ma, and Adams Wei Yu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Le, Tengyu Ma, and Adams Wei Yu

Reference 87

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.093107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.844966Z digest=sha256:c0b928ab7d54a53cecc44f52bd85558ca42aca22d5443fc2ed7bb05d66aaed16

Observation 9f9598ca-fc52-4c51-a957-b418b878adba · outbound

This paper cites Zacks, Nicole K.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zacks, Nicole K

Reference 88

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.058298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.860828Z digest=sha256:b84a12d0dd4914a908646627a27b2d8ccb86804979d8e37c11d658e06fc32faf

Observation 85c2b94d-26cb-436d-9add-963dc6f821d8 · outbound

This paper cites From lists to emojis: How format bias affects model alignment.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From lists to emojis: How format bias affects model alignment

Reference 89

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.046021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.864257Z digest=sha256:06094290c7323d2fde991e88a7bb5f8b0038887041d68f82d7aa012454f92d62

Observation 55707357-ff8e-4d89-a41d-509c1a44cd00 · outbound

This paper cites The Price of Format: Diversity Collapse in LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Price of Format: Diversity Collapse in LLMs

Reference 90

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.856924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.856924Z digest=sha256:46d0fa5ab48435f894bb63b6f3a3d0b134935f5203378466d7c776bb43a5300b

Observation 6e68ee45-f4ca-422f-b1fa-1e001cbd6add · outbound

This paper cites The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content

Reference 91

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.971210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.871727Z digest=sha256:7211a3937697d88f1c8969d8a21255b09d01ef9210425aef4fb7373fbc715234

Observation 84df4455-b9e6-4dd6-a651-dabc1196f62e · outbound

This paper cites Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing

Reference 92

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.954229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.875599Z digest=sha256:695e3020c98cec26385969e38bf9c96a20d190391d69779d33a7ae8de000dcab

Observation 9619982f-93a7-474e-989e-ae8073391783 · outbound

This paper cites Scalable Visual Pretraining for Language Intelligence.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scalable Visual Pretraining for Language Intelligence

Reference 93

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.987020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.868091Z digest=sha256:badd551bc00f78e70e59592dc79d7a5fadca174782b7b3e3e4620b2e100cd23e

Observation 58d6a4af-29c9-4e81-8567-412d9a7bc57c · outbound

This paper cites Zwaan and Gabriel A.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zwaan and Gabriel A

Reference 94

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.034224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.884591Z digest=sha256:5c844af6c7cfe3bda301ba8a79863dc12ee7c66879ab9997a75243343e65f266

Observation 075984c6-1b52-438d-be3c-70502615977e · outbound

This paper cites Enhancing LLM Knowledge Learning through Generalization.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Enhancing LLM Knowledge Learning through Generalization

Reference 96

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.879720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.879720Z digest=sha256:400a09e80de5c263a71c9ba96d4c98ad75336b488a7329a1dc614fbac7801de3

Observation 812918f9-4bb3-4ae1-b781-fff4d2ae9688 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2020

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.188682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.760319Z digest=sha256:7c66812aa77c35922af56a0228b469c3d7300a83ba2ec3e10063b9b1c577b07b

Observation 769428fc-d8fc-4600-8193-4babf0e61a92 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.644369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.644369Z digest=sha256:f9fcc302036553ca8b787f2499c3670e61772272248d4f871390beb3cde19edc

Pith citing papers

No inbound Pith citation observations are available.