Pith. sign in

Paper Citation Record · LEDGER

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora

As of 13 August 2026, this Paper Citation Record lists 97 of 97 outbound references and 0 inbound Pith citation observations for arXiv:2608.09093.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.09093 v1

Coverage vector

measured 97 of 97 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T23:46:08.884591Z

measured 97 of 97 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

97 of 97 outbound references displayed

  • verified exact16
  • verified fuzzy28
  • unresolved50
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7d80d665-7783-47b8-b398-985c485bc325 · outbound

This paper cites OLMo-core: src/scripts/official/OLMo3/.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OLMo-core: src/scripts/official/OLMo3/

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.516340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.516340Z digest=sha256:eccc7bb91c0ea2b15f33a600177697a83208a391ceace58e6542d83fc360f682

Observation 7b1702d0-a405-4401-b8c6-294d43e24ab5 · outbound

This paper cites Physics of Language Models: Part 3.1, Knowledge Storage and Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.520788Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.520788Z digest=sha256:0c422015c5690a6ccd007db145959787a965a1cc0ca73bbd6aa04fe60b0ceac7

Observation 08c41e25-757f-40c0-b855-2fd6185ed4d1 · outbound

This paper cites Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.525122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.525122Z digest=sha256:d5cfa7a6b5f46a0545537d8ca5fe0f734943589ac7e028f031077e7a63594343

Observation 2ca7b3bd-3eec-4f70-879a-c680a63efbe1 · outbound

This paper cites Álvarez-Lacalle, B.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Álvarez-Lacalle, B

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.529259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.529259Z digest=sha256:4eaa278fb56c1b5b0b4638b76d5dad36e7edec31d25d91a6488cf9c0d7eacdec

Observation a7e1a1d5-c899-4e67-8e42-2ff258354cfc · outbound

This paper cites Predicting the Emergence of Induction Heads in Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.533454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.533454Z digest=sha256:b633c8c5d600f7fa660ce07813278e48d4d70ebe08f8f3b5a0adba3b205ec7a2

Observation 4b526753-8d16-4b72-9684-f05e771197f8 · outbound

This paper cites Docling Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Docling Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.537942Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.537942Z digest=sha256:ccd5cff2a9cbc6236f79383a5e7f574493e5a368336697d42f2c5a8326e32413

Observation 3ee3c7b5-e28b-4441-98da-1e15113f6aae · outbound

This paper cites Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.988195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.542506Z digest=sha256:dedd2de026b3d43b6b2e46aad6dd8ef9ea860fa85ab35493958321f4c8acba60

Observation 281a80ca-56a9-4770-bf0d-cf4a8498a064 · outbound

This paper cites One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.972459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.546573Z digest=sha256:36a13fdccc6263868cee283aa7c7eff0d55782ce1a94bbf0741083a2107ee54f

Observation 41bcf5ad-13c7-433a-a79e-24192c9b15cb · outbound

This paper cites trafilatura: trafilatura/xml.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora trafilatura: trafilatura/xml.py

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.550671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.550671Z digest=sha256:5c040a24b5efebabe5d0d97293c8d46148695975b77d9e16a8df57134b22f9df

Observation fe866f33-5d83-4152-a709-23cb068733a7 · outbound

This paper cites so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.554957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.554957Z digest=sha256:177b52d4d9c280edf4e5bc8d6304e68ebd11f5941aa7911ef2049efb5813dd7b

Observation 2f9d920d-da0f-464f-9bd6-bbb8cda7e9ab · outbound

This paper cites Datasheet for the Pile.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheet for the Pile

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.558757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.558757Z digest=sha256:536ee9b1b00895ec38d37ab21175884bffe266bd433e3ea5e64f6c9be4205315

Observation f461e1e9-fc02-44e2-8ec1-199119b99b6c · outbound

This paper cites Document structure in long document transformers.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Document structure in long document transformers

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.562683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.562683Z digest=sha256:d2b22c5eda377d91556a927bc4d5f9538d68eb8d0483ab5bd5b493a164222d1c

Observation 8de5518a-bc11-4239-b640-0938ff3c83a7 · outbound

This paper cites Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.566283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.566283Z digest=sha256:e2e6fff791b9aa0359b0eb372faf443ec2efeac22fc6e6616a0ba5c27dd80905

Observation 43aa3385-dc1c-4f16-b758-417d27f747bb · outbound

This paper cites The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.570096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.570096Z digest=sha256:1ff0530a0f7701df31210cb5af8254652405b5408774638f028d174fa83f148d

Observation 156cc986-1daa-496c-8fe1-8c5cc669b1fc · outbound

This paper cites LADM: Long-context training data selection with attention-based dependency measurement for LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LADM: Long-context training data selection with attention-based dependency measurement for LLMs

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.573675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.573675Z digest=sha256:489934ae2117bc2bb913b63dc0268a29f2f24d185790558b2d73fbda3098569f

Observation 4d1abd8a-90fd-4fb2-a152-b747d8e0faf0 · outbound

This paper cites Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining

Reference 16

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.934456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.577429Z digest=sha256:04f8d848aa78735153df37d682d5556266095353075708e78f2bf2e167d4fe5c

Observation d160b479-63d7-48c9-9ddb-34bcb237ebf9 · outbound

This paper cites Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.581164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.581164Z digest=sha256:7d34845c5a230dbfe1f99294816d3327f46eb69fa975ba270028d0ba1977e5b5

Observation 1e9d02fe-702a-4a6d-9bd9-36f582b86f14 · outbound

This paper cites BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.585204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.585204Z digest=sha256:0612a2f2cbe503040392eef5db60ab2a6ea044d24bfc3e994649ace323c6a769

Observation 0027d995-38f6-4114-be5c-b034cb9789c5 · outbound

This paper cites DeepSeek-V3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DeepSeek-V3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.589022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.589022Z digest=sha256:b8102e6fd52015b52f7e02975d65aefeb5f4e420134bb57b44a91d301bb3e3b7

Observation d17b519e-7057-4453-a0ee-27e1357acfee · outbound

This paper cites Beyond length: Quantifying long-range information for long-context LLM pretraining data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond length: Quantifying long-range information for long-context LLM pretraining data

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.592974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.592974Z digest=sha256:045cc99986ec0bb86d3e0844da23c3e723c159b494193ca755f7f3a79cbb09f5

Observation dc48d7d6-ec33-42c2-a612-f06bfed0e0b9 · outbound

This paper cites Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.596787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.596787Z digest=sha256:f6b5934d6657c75aad27473d55b3c3259cbd792a5d5e321b04af8af0dffbac76

Observation 60dba6c3-a6b3-4fb0-b134-fa4678e33448 · outbound

This paper cites Smith, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Smith, and Jesse Dodge

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.600442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.600442Z digest=sha256:0e9239a08ee7e21db1c16d7167af4d9ca671c2fd192bea39b65c93c42a1cbdf0

Observation 2f086de1-d48e-434e-9b24-b4b1eb57ce2e · outbound

This paper cites DoGE: Domain Reweighting with Generalization Estimation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DoGE: Domain Reweighting with Generalization Estimation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.603929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.603929Z digest=sha256:9855b0baa80d473b4682dc42429a00253040c9a288150501347fb475934c7a72

Observation a3e7197c-7b1b-46bc-a46d-1c4d09f3ff21 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 24

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.886029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.607893Z digest=sha256:66b8b5fd73498fbf23b634c99817cf74bbdabb7a7fae7b6e424aab31bd3a011a

Observation 3e9aba69-4f7d-463e-95a0-eb3bf5b0e4bf · outbound

This paper cites NExtLong: Toward effective long-context training without long documents.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora NExtLong: Toward effective long-context training without long documents

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.611346Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.611346Z digest=sha256:a4f391753d4f5337ca69c19c745ed4916694f3adbf95090577c6bea22f9eb43a

Observation 780f5689-7f57-44f5-ba34-548b09c5bf5b · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.615026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.615026Z digest=sha256:db906262bf743640be1bef5ee4b7d27888daf9633dacfe7dbd770ec8e0a01bee

Observation 752ff431-3dd6-4c6f-a132-661c6eab5275 · outbound

This paper cites Wichmann.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Wichmann

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.618858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.618858Z digest=sha256:58861c61b82560237c826b2a69a6a2849e174aa6d2cf26c5ec410816fd6574b2

Observation fbbda0e3-3cdd-4758-98c2-c72dd6e775a1 · outbound

This paper cites Hermann, Hossein Mobahi, Thomas Fel, and Michael C.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hermann, Hossein Mobahi, Thomas Fel, and Michael C

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.622436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.622436Z digest=sha256:b3041172858550d0ded148631a4873182908e445c1b8c749657f25bf2da156d7

Observation b64d7edb-c0ac-44e5-85ea-1cc7665e7609 · outbound

This paper cites The curious case of neural text degeneration.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The curious case of neural text degeneration

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.626015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.626015Z digest=sha256:e79a1acb58a0928ccba2f6c276a8bed91e3f0b53facfa91d615aa584a5dbc98c

Observation aa679acf-0007-439e-b231-fad4420d4a08 · outbound

This paper cites FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.629298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.629298Z digest=sha256:e67325bba64406bfa04c182f1675aef373b905bc7f501845d077b59ec9e7c450

Observation 3c955657-891e-4f49-84d4-8db2aa5e1140 · outbound

This paper cites SmolLM3: smol, multilingual, long-context reasoner.https://huggingface.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora SmolLM3: smol, multilingual, long-context reasoner.https://huggingface

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.632840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.632840Z digest=sha256:3908028a2a380b5e587d0f33e1daca27ebf3e4f8b6bcbe5dc044e152eb3876be

Observation 862abf38-3a6a-40c5-93b0-a12c7dca6b4e · outbound

This paper cites datatrove: src/datatrove/pipeline/extractors/trafilatura.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora datatrove: src/datatrove/pipeline/extractors/trafilatura.py

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.636370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.636370Z digest=sha256:c6c5fb34253284d6b559e51f242f6cd163bdaff167ab3541547a9078b8407413

Observation 26f2f108-79da-4d13-9933-880d8f48d324 · outbound

This paper cites propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,

Reference 33

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.797822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.640149Z digest=sha256:1a68d1febac20e399006da5a6e1f1998349527baa39ff0dc3156ede87fa5d294

Observation 8fd8c20a-b9e8-4d63-8eb5-69148ae621eb · outbound

This paper cites ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.372740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.648169Z digest=sha256:f916badaf7250ac1c844576d9ecc7abdabc32702582fe47014bcfccff77319ad

Observation 20791109-1ad6-4676-8a88-0b2e79946650 · outbound

This paper cites EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.651907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.651907Z digest=sha256:a9d9677eaedd6986dd83139ec9fa95ecdd58d1d0d01ddd4098f574f598d1e0ab

Observation 8d9332d1-f141-423a-b1ca-9e2f33cbea40 · outbound

This paper cites Characterizing Narrative Content in Web-scale LLM Pretraining Data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Characterizing Narrative Content in Web-scale LLM Pretraining Data

Reference 36

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.650579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.655949Z digest=sha256:11bef0ee0ca5423d74c7aedfa2216466791f1f68757580ccf1313ffbd84ba1b4

Observation b3db8665-93de-423c-ab03-44d3c2ed960e · outbound

This paper cites The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.659888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.659888Z digest=sha256:764c4add6750c473d4b318dba27dc4556b1ef47a9d467955bff8263659d43c79

Observation 8770db68-bc35-41c0-a8bd-1816e6f2bbc5 · outbound

This paper cites Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.663478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.663478Z digest=sha256:7eafc4e7be485b13eca8346d256c5a83ab9f7a26dc4758e0ac8f9772398a5f65

Observation 063ebcf7-a380-4951-96a6-57115306b83a · outbound

This paper cites Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.361337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.667449Z digest=sha256:8c18efe4e3bde9efa47264cb073e5cc604def293dede81b18f8d88759f884633

Observation 0898c310-284c-4ae5-a459-5fe06675fb02 · outbound

This paper cites Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.349832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.670936Z digest=sha256:8a1a22547e8123c32ba80f3be3e0b9b5e1d5ee56fa6beee474005d30cb555149

Observation f27ed3ec-bb4c-46b4-ae4d-2a9b886c6118 · outbound

This paper cites The Format Tax.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Format Tax

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.674823Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.674823Z digest=sha256:91fa60098f96966966bf039552afd8d2196f0a2b6913c59b4e1fdf8ad2cb0356

Observation 04a49aa9-d9a4-4fad-9e93-22da0bd35bbf · outbound

This paper cites DataComp-LM: In search of the next generation of training sets for language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DataComp-LM: In search of the next generation of training sets for language models

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.338832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.678804Z digest=sha256:15b60abd57535a6ac72141fc0a9e094291fbcfa353cb980c0fd483889f6f33c4

Observation aa88155a-04b1-45bd-afa0-d5877de7cee9 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.328421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.682276Z digest=sha256:ee13d361c034955084d61e80600a46364ee157616ecd49cae52c983375b4aee1

Observation 6aa3bdc4-83d8-4685-9b83-2bf562688710 · outbound

This paper cites Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction

Reference 44

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.604854Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.689681Z digest=sha256:cd005b34888c2a7f52cff7092678ade4ecd914e7a7e5245ed22f508e883fb970

Observation 401910f7-8ab2-4722-a830-9af0d7ee73e4 · outbound

This paper cites URLhttps://aclanthology.org/2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora URLhttps://aclanthology.org/2026

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.317293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.685954Z digest=sha256:9dbeefcae70653307432e6606e7be8208b38c5033fa53f581e99e6dccdab850e

Observation 961851e4-9ba4-43ca-8d08-4eca71cb8af8 · outbound

This paper cites Improving Cross-Format Robustness in Language Models with Multi-Format Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Improving Cross-Format Robustness in Language Models with Multi-Format Training

Reference 46

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.589660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.697003Z digest=sha256:90620481160f082179b7e14372b0dc08af30a332635cabcb2734b28aa908ee24

Observation 25f795c0-df9c-40f4-9f66-2c55d3361661 · outbound

This paper cites Lin and Max Tegmark.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Lin and Max Tegmark

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.306962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.693474Z digest=sha256:a34c80b1477645a13fff553dbff9a3f86b79e707f10bb5e2203bd6bb7968cff0

Observation 7d56fd29-a374-40ca-90a0-4d17fc40d3bb · outbound

This paper cites RegMix: Data mixture as regression for language model pre-training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RegMix: Data mixture as regression for language model pre-training

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.295866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.704493Z digest=sha256:e480371ff1bdfc0a6c35544940c084686ac0be29454e49310204792d35afc78d

Observation 870ff3b3-931c-4fa5-a01d-ef7c61816860 · outbound

This paper cites Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.700743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.700743Z digest=sha256:4bebea3f2c31427795877624db55abedcdfa5852e004fdc729f4c6a0ce1b56fb

Observation 3ad61780-a039-46e8-8f0e-eb7cfe61e40d · outbound

This paper cites The Llama 3 Herd of Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Llama 3 Herd of Models

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.712036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.712036Z digest=sha256:a3feefc20e601eb53259b2f894de7ac8c5678bb74c50b09ef9ef0619a33a59b5

Observation caddb278-c690-4090-852b-6567f647e123 · outbound

This paper cites Sentence-Level Contextual Entrainment in Large Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Sentence-Level Contextual Entrainment in Large Language Models

Reference 51

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.507694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.708161Z digest=sha256:2c164df24d18a7a4d48426065feed06dd9ae6c85cc510c6407c666fcf5669717

Observation b5137b5c-cf5d-47a5-84ea-9e466309a633 · outbound

This paper cites AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025

Reference 52

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.481795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.719503Z digest=sha256:d74e9ecac2bd08f2de1a2362d628117cd57c3140c6d22f4486da24acafa6b2ad

Observation 93ae5958-d8be-46eb-85f4-3c175b4b06f0 · outbound

This paper cites Klein, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Klein, and Jesse Dodge

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.284672Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.715836Z digest=sha256:0be7b4fd55dbb6c7b9b363c3397ac239d75f0b38f8f1d9ab2cad9eebf24c69ca

Observation 10e8715e-bef4-4679-b9da-9eb126cf768c · outbound

This paper cites Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.273034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.726933Z digest=sha256:f5109fa3996b97a6224d70d3142b59d3700b91002018997e2fe7d4f87a66e1b4

Observation 444cfb4f-cdf9-472d-976a-a057fb97ee46 · outbound

This paper cites Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.722972Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.722972Z digest=sha256:48e5e534257af3f295ccfe51dd486a505bd5a3d840b14b962e145b03d9723271

Observation aa540b93-f654-4ab3-84f3-d1e757d5e802 · outbound

This paper cites Register always matters: Analysis of LLM pretraining data through the lens of language variation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Register always matters: Analysis of LLM pretraining data through the lens of language variation

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.249473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.734114Z digest=sha256:16b6820fe51f01e8d02a8589ae6a32e735e09faee8eec4c59784273c1bfd6178

Observation 97697682-5627-4c5a-a214-f2ee8e11b7c1 · outbound

This paper cites Autocorrelations decay in texts and applicability limits of language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Autocorrelations decay in texts and applicability limits of language models

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.261287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.730477Z digest=sha256:652491fdd2f67d86cc3040ba37a0cfbec5769796d9f4e6933df0e2ca5b241fd5

Observation b557be46-2c86-42f9-b7f5-81062df62b81 · outbound

This paper cites OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling

Reference 58

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.381154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.741761Z digest=sha256:ac205d7d99832f77b4a69a5a858684a1b98d0de690ee9eeaa170f0fa87b1e0dd

Observation 51c0e49c-0dc6-42b7-bf33-b9b0d4c9e571 · outbound

This paper cites How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.237160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.738014Z digest=sha256:f2137e378738c9f57d987e399d453ad7428125d48b4ab2ad232cd9772f3c4416

Observation c942c904-4efd-4d69-986e-b685988a64f1 · outbound

This paper cites Chapter captor: Text segmentation in novels.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Chapter captor: Text segmentation in novels

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.212033Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.749302Z digest=sha256:b79541c2170de0c04b3c8a62f40051210a6bb0d903a2dcc238d3cf69662f6263

Observation f850bd65-f37e-43a8-aa69-76b26ee8073d · outbound

This paper cites The FineWeb datasets: Decanting the web for the finest text data at scale.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The FineWeb datasets: Decanting the web for the finest text data at scale

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.224614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.745705Z digest=sha256:b76c4ef1eacff7b6b9ecbb505d062155cc8f0216b14c810870197549c111fdb8

Observation 5621d9f2-4963-4970-9a38-b58d6e7f334c · outbound

This paper cites epub2txt-all (the Books3 converter).

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora epub2txt-all (the Books3 converter)

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.199905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.756470Z digest=sha256:748fa0ee1b2d4b2f93273842e1d36b9807a2c7a2d0a44ad47ea6722e54aeee0c

Observation 4d9838a3-5ba8-4b88-9e4c-f7158e283ada · outbound

This paper cites olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.752778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.752778Z digest=sha256:6b201ac4a7d00b8ec81be4f85b8fab3822ff0d8ba6ce27435af90cd4174f85f5

Observation 446a9c39-3345-49e4-9aef-f56c30b97526 · outbound

This paper cites Compressive Transformers for Long-Range Sequence Modelling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Compressive Transformers for Long-Range Sequence Modelling

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.767917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.767917Z digest=sha256:5c86232dcba52b2b8f2a15c8098eff1cedbd17e81ee6a4c97c4db10404aa8957

Observation a7ceff82-8002-4e0a-be0d-3efb1465cc9e · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.772122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.772122Z digest=sha256:7661f1429bc7433beeb0b921b84c862727bf924f99269ef07510f02ae7029dff

Observation a0bb3eb7-1ceb-47b6-bf73-1ed42815cf9c · outbound

This paper cites Qwen3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Qwen3 Technical Report

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.764228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.764228Z digest=sha256:8a15399d2eef228a74f33945fce9fd64514647bd1895cf6d55e2d70a53884751

Observation 36d60be1-2d4a-48ba-8dda-7d2d8d797a99 · outbound

This paper cites From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026

Reference 67

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.276678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.779814Z digest=sha256:4cf79c12195a64ce33162e3829e01f81d5197b7617c5e37b378c1aa89280d35c

Observation 750a02df-cc2a-49d0-a0b3-b44af8141697 · outbound

This paper cites Scale-dependent Relationships in Natural Language.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scale-dependent Relationships in Natural Language

Reference 68

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.126130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.783358Z digest=sha256:ad64002ac4a2df64622f09be7733cc6058c29af7ed9c3b5a4ffe6daa522fdedb

Observation b128d4cb-385d-4b47-b6b6-327a3051d027 · outbound

This paper cites RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.171029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.775948Z digest=sha256:343e17fd8a74bdf3c4e25127f906586d8d1a11e5b0b05fbcc9cf43282a167414

Observation a1587bca-a466-47c0-b32e-464756d736b5 · outbound

This paper cites Dolma: an open corpus of three trillion tokens for language model pretraining research.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dolma: an open corpus of three trillion tokens for language model pretraining research

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.160064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.791038Z digest=sha256:952c4d7d8bbacef668a0a3176d1cb3c1b26ec24e8011d8638a2c5f379bfdd7a2

Observation 29167a1b-8011-4c3f-900d-5dc057727d6c · outbound

This paper cites Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.149510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.794756Z digest=sha256:b4cd6185c1fe6db4f782482daf1232d116a63c3174f7981589d720933bdb4dda

Observation 62b3ba69-8815-4713-bb09-6d9e2ed0ef23 · outbound

This paper cites Mutual Information Scaling and Expressive Power of Sequence Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Mutual Information Scaling and Expressive Power of Sequence Models

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.787163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.787163Z digest=sha256:416b08a1f798aab6dba5c6fdd21ad94751b03f440eea9c49aa8a056d4865482e

Observation da602af8-0010-4589-8474-d649bc5a0871 · outbound

This paper cites ChapterBreak: A challenge dataset for long-range language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ChapterBreak: A challenge dataset for long-range language models

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.126803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.801750Z digest=sha256:d2f1170db023c8ac1f73751e587750c4da2ca76f8d3f7d38dc82a6b8ef84940a

Observation 76e0f288-a66c-47b6-a6e8-09f72bfec00d · outbound

This paper cites Accessed 2026-08-09.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Accessed 2026-08-09

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.115418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.805338Z digest=sha256:c732875dd4e9a484bd7be8e6370576afc2e48991887011b35c32a325696a7c19

Observation a4994bef-5a84-4127-a17e-4746bbf90d83 · outbound

This paper cites Zico Kolter, and Zhuang Liu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zico Kolter, and Zhuang Liu

Reference 75

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.137800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.798336Z digest=sha256:1ec1d2fafd2b408fa3deaa212a8233dc385c71499529454167b42eb35b2f0ac2

Observation 5550b4f1-6a93-4bcb-b9a6-2ca0d227321a · outbound

This paper cites Olmo 3.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Olmo 3

Reference 76

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.812864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.812864Z digest=sha256:55a0f63ca1465b6a8835cee8d5cbcd36f1f0ed2899ce705fe3bdfe0f502742b1

Observation 289ede77-7263-4f8d-a5f7-ef76910dc4c5 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LLaMA: Open and Efficient Foundation Language Models

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.816699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.816699Z digest=sha256:7b5840ecf4be17fe779f7c5304418cecda4fc21307c2f73948143b6727fe54df

Observation d8d3ea3d-4234-465e-a029-1c2afa2026c7 · outbound

This paper cites Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training

Reference 78

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.099133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.808708Z digest=sha256:11bb231e8d019f541f7c05a3178171128f4f2f7724a2c55c8a964dd9fc47a23b

Observation 0e46ee02-9ea8-4e60-90cc-bbb5544db8d6 · outbound

This paper cites MinerU: An Open-Source Solution for Precise Document Content Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora MinerU: An Open-Source Solution for Precise Document Content Extraction

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.824450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.824450Z digest=sha256:d6f8361da15a69664b64f2f9d7d9c4bc82466d23f6c45f7c13a57a87f8047a30

Observation ea6d276c-610c-4bd9-a5b5-32e35470cdcd · outbound

This paper cites PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

Reference 80

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.034640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.828474Z digest=sha256:a4791bc035c82a872caa0ed7e6b74918164b3c0701a9b07ac37a14b69fad1214

Observation 919507d1-adee-44a2-83b1-faa97958128e · outbound

This paper cites Right Reset: Chunking by Prefix Removal.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Right Reset: Chunking by Prefix Removal

Reference 81

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.062126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.820342Z digest=sha256:7eb6aa52de833c7b879e77d9a49edcd18b0f6dcb5ffe7b28826e9d8c307b915c

Observation 98108d02-c141-47d1-b782-01ac336a211b · outbound

This paper cites LongAttn: Selecting Long-context Training Data via Token-level Attention.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LongAttn: Selecting Long-context Training Data via Token-level Attention

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.837385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.837385Z digest=sha256:f7f4833cc95a6476ffcde73311b27e0cd45dacccb5bc9533515b6203fed63ae6

Observation bf2ba5af-8693-43c8-be69-52a84b441af7 · outbound

This paper cites Morris, and Lionel Levine.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Morris, and Lionel Levine

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.104141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.841338Z digest=sha256:e6509e18881543bbeaea6c0cc47f21f4fa51e782c98f0fdfc3a6cc8b082a84ce

Observation f755bad9-c5f7-4fd5-aac2-ad53e0bfc3d9 · outbound

This paper cites Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability

Reference 84

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.832563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.832563Z digest=sha256:ba908964e819b07068369071be1e2262bd6a2cdb1f9a3b1acd34384a9030e557

Observation 2f060d25-0c30-40be-b921-38c88aca8d45 · outbound

This paper cites Learning to break the loop: Analyzing and mitigating repetitions for neural text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Learning to break the loop: Analyzing and mitigating repetitions for neural text generation

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.081092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.848523Z digest=sha256:7b7d7eadf1d95692fb3e3522fb1109fcad37631b60ddf9728727f39b07cbe3d5

Observation ab284549-a24a-4633-b8d2-26b4f68c11b5 · outbound

This paper cites Data mixing laws: Optimizing data mixtures by predicting language modeling performance.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing laws: Optimizing data mixtures by predicting language modeling performance

Reference 86

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.069815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.852100Z digest=sha256:6e7fc0f2f7968d885a8f98e91d503f981c81ed9d637d6b7cf1426f4dad3c7728

Observation 3478cf59-34f1-41c0-aec3-6735908add7d · outbound

This paper cites Le, Tengyu Ma, and Adams Wei Yu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Le, Tengyu Ma, and Adams Wei Yu

Reference 87

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.093107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.844966Z digest=sha256:e8a4ee4982c3152ea68aecbe72ff7495722cc29b2e5b7de3952f203c9df3fb2f

Observation 9f9598ca-fc52-4c51-a957-b418b878adba · outbound

This paper cites Zacks, Nicole K.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zacks, Nicole K

Reference 88

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.058298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.860828Z digest=sha256:4b891bed1bb717b0ded1349cd703b397d9e6adca2f33e44400f7ca8ea82c56e1

Observation 85c2b94d-26cb-436d-9add-963dc6f821d8 · outbound

This paper cites From lists to emojis: How format bias affects model alignment.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From lists to emojis: How format bias affects model alignment

Reference 89

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.046021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.864257Z digest=sha256:d724ea3311b61468df2640f89a67ce45fa08374ce87618014266190aa3844a0f

Observation 55707357-ff8e-4d89-a41d-509c1a44cd00 · outbound

This paper cites The Price of Format: Diversity Collapse in LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Price of Format: Diversity Collapse in LLMs

Reference 90

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.856924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.856924Z digest=sha256:e43bbdad0110a94db00a8f37f04ab288b164e9552f4513df55fe6ed0562e18ef

Observation 6e68ee45-f4ca-422f-b1fa-1e001cbd6add · outbound

This paper cites The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content

Reference 91

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.971210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.871727Z digest=sha256:cbe906810dbd8a721fa2c83d382b02a8ebfb70fde85d6068cec53b94f7557cc5

Observation 84df4455-b9e6-4dd6-a651-dabc1196f62e · outbound

This paper cites Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing

Reference 92

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.954229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.875599Z digest=sha256:b2ee9b281e89d9efd351de91e750147e52caf03573ec6f24a363567711e5c3b9

Observation 9619982f-93a7-474e-989e-ae8073391783 · outbound

This paper cites Scalable Visual Pretraining for Language Intelligence.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scalable Visual Pretraining for Language Intelligence

Reference 93

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.987020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.868091Z digest=sha256:e2ce7ec5571bfbc9f7760628bf991dd9644e1044e932dbd9dd1d31687492a648

Observation 58d6a4af-29c9-4e81-8567-412d9a7bc57c · outbound

This paper cites Zwaan and Gabriel A.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zwaan and Gabriel A

Reference 94

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.034224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.884591Z digest=sha256:52a714ae731815a1af0a315c021c8cb79cb01071c0147b896e2abbe62731844f

Observation 075984c6-1b52-438d-be3c-70502615977e · outbound

This paper cites Enhancing LLM Knowledge Learning through Generalization.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Enhancing LLM Knowledge Learning through Generalization

Reference 96

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.879720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.879720Z digest=sha256:4e2924e9b4ad8b0408cfeef2867fd19db775e1115e1d2da796a25887604886bf

Observation 812918f9-4bb3-4ae1-b781-fff4d2ae9688 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2020

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.188682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-11T23:46:08.760319Z digest=sha256:51133058c3c03ae675c70d06ce664c45be8c4369275b2994b334d0f6c9c345dc

Observation 769428fc-d8fc-4600-8193-4babf0e61a92 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.644369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.644369Z digest=sha256:2c6d99091d1cab8f9e7170bcedcf3ff6a57ebae80e24e7cd2b2d17e32d595f65

Pith citing papers

No inbound Pith citation observations are available.