Paper Citation Record · LEDGER

Predicting the Emergence of Induction Heads in Language Model Pretraining

As of 19 August 2026, this Paper Citation Record lists 19 of 19 outbound references and 4 inbound Pith citation observations for arXiv:2511.16893.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2511.16893 v3

Coverage vector

measured 19 of 19 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-03T21:06:40.995944Z

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-11T23:46:08.533454Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T13:18:13.088871Z

Reference resolution

19 of 19 outbound references displayed

verified exact0
verified fuzzy0
unresolved19
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 742b60f9-0d32-401c-bc77-9c58a9f97b5b · outbound

This paper cites Language models grow less humanlike beyond phase transition.

Predicting the Emergence of Induction Heads in Language Model Pretraining Language models grow less humanlike beyond phase transition

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:38.665206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 077ff1f1-71c1-42bd-80a0-5134499e5ee1 · outbound

This paper cites Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling.

Predicting the Emergence of Induction Heads in Language Model Pretraining Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:38.799079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cb03c670-dfa0-445a-a0b3-4fcc7f7561ec · outbound

This paper cites Chan, Adam Santoro, Andrew Kyle Lampinen, Jane X Wang, Aaditya K Singh, Pierre Harvey Richemond, James McClelland, and Felix Hill.

Predicting the Emergence of Induction Heads in Language Model Pretraining Chan, Adam Santoro, Andrew Kyle Lampinen, Jane X Wang, Aaditya K Singh, Pierre Harvey Richemond, James McClelland, and Felix Hill

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:38.926882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d7a8889e-09a4-4285-b5d1-6681c9cf6f66 · outbound

This paper cites Sudden drops in the loss: Syntax acquisition, phase transitions, and simplicity bias in MLMs.

Predicting the Emergence of Induction Heads in Language Model Pretraining Sudden drops in the loss: Syntax acquisition, phase transitions, and simplicity bias in MLMs

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.304051Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d36ab45c-229f-4784-a48d-b87764f9fe34 · outbound

This paper cites Unsupervised cross-lingual representation learning at scale.

Predicting the Emergence of Induction Heads in Language Model Pretraining Unsupervised cross-lingual representation learning at scale

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.476817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 434f61ae-7b15-4c63-9477-1623b654d1c3 · outbound

This paper cites Edelman, eran malach, and Surbhi Goel.

Predicting the Emergence of Induction Heads in Language Model Pretraining Edelman, eran malach, and Surbhi Goel

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.652329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c7837a1-d8ef-4a6c-8c74-dbc33489a621 · outbound

This paper cites A mathematical framework for transformer circuits.Transformer Circuits Thread,.

Predicting the Emergence of Induction Heads in Language Model Pretraining A mathematical framework for transformer circuits.Transformer Circuits Thread,

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.800405Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d809221-863c-4128-9677-beffcf791b38 · outbound

This paper cites Scaling Laws for Neural Language Models.

Predicting the Emergence of Induction Heads in Language Model Pretraining Scaling Laws for Neural Language Models

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.071712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6ddb9f4e-97c2-4ea8-9f01-6fbb87ae338b · outbound

This paper cites Transformerlens.

Predicting the Emergence of Induction Heads in Language Model Pretraining Transformerlens

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.261749Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf041a6c-87b1-4541-8609-ba263f862b3f · outbound

This paper cites an unresolved cited work.

Predicting the Emergence of Induction Heads in Language Model Pretraining Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.405490Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2b524ca-5c34-4e68-b88a-3ea3d4c83bba · outbound

This paper cites In-context learning and induction heads.

Predicting the Emergence of Induction Heads in Language Model Pretraining In-context learning and induction heads

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.535784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 706d1fba-5c3a-4000-aa67-e1a968a992bd · outbound

This paper cites Language models are unsupervised multitask learners.OpenAI blog, 1(8): 9, 2019.

Predicting the Emergence of Induction Heads in Language Model Pretraining Language models are unsupervised multitask learners.OpenAI blog, 1(8): 9, 2019

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.639604Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 09685149-81a3-4df1-9871-f691f323a9ec · outbound

This paper cites CCNet: Extracting high quality monolingual datasets from web crawl data.

Predicting the Emergence of Induction Heads in Language Model Pretraining CCNet: Extracting high quality monolingual datasets from web crawl data

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.710687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d809bcde-34d1-4bb7-b29e-f18189d11027 · outbound

This paper cites An explanation of in-context learning as implicit bayesian inference.

Predicting the Emergence of Induction Heads in Language Model Pretraining An explanation of in-context learning as implicit bayesian inference

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.759222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 027fbc6e-dc89-4746-bcf1-e574d0b49cbf · outbound

This paper cites Which Attention Heads Matter for In-Context Learning?.

Predicting the Emergence of Induction Heads in Language Model Pretraining Which Attention Heads Matter for In-Context Learning?

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.820193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c956fe18-4edf-4f53-80be-cc79e0f0faaf · outbound

This paper cites ,A⟩sequence, 2 of them are followed by B, hence 2 4 = 1.

Predicting the Emergence of Induction Heads in Language Model Pretraining ,A⟩sequence, 2 of them are followed by B, hence 2 4 = 1

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.937637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7b17b68-45c2-46ea-ba4c-9cdc244752e7 · outbound

This paper cites frequency.

Predicting the Emergence of Induction Heads in Language Model Pretraining frequency

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:40.995944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f305f92-1932-4056-b1a0-ad74f75db167 · outbound

This paper cites an unresolved cited work.

Predicting the Emergence of Induction Heads in Language Model Pretraining Unresolved cited work

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.934203Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0aae1b8-20ed-4512-baf6-cff7344d2e34 · outbound

This paper cites an unresolved cited work.

Predicting the Emergence of Induction Heads in Language Model Pretraining Unresolved cited work

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-03T21:06:39.092557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation f1a0c231-b745-4c02-8f07-d4e2aa445f5e · inbound

Features have life history. And we should care cites this paper.

Features have life history. And we should care Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-07-07T03:18:10.668247Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation a2332822-7258-4021-9131-eb4dd89409f9 · inbound

Phase Transitions in Attention: A Bayesian Theory of Copy Head Emergence cites this paper.

Phase Transitions in Attention: A Bayesian Theory of Copy Head Emergence Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-07-07T03:18:10.668247Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 09a139ba-4662-4a24-b488-ed055f61c83b · inbound

The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models cites this paper.

The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-01T10:34:44.033479Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7e1a1d5-c899-4e67-8e42-2ff258354cfc · inbound

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora cites this paper.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-11T23:46:08.533454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.