Pith. sign in

Paper Citation Record · LEDGER

Stabilizing Transformer Training by Preventing Attention Entropy Collapse

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 6 inbound Pith citation observations for arXiv:2303.06296.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2303.06296 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 6 of 6 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 6 of 6 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T20:41:55.705061Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-22T02:44:32.162242Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation b725bc71-ddfd-448e-8073-f15e4217fe87 · inbound

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation cites this paper.

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-22T02:44:32.165690Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-22T02:42:34.938163Z digest=sha256:f059908908a19b6bf4c7896d61f60753f02f5c9936f02826552ad5f57189a364

Observation baa9a4d6-6462-48ae-86d5-143f7089f0ff · inbound

On the Mathematical Impossibility of Safe Universal Approximators cites this paper.

On the Mathematical Impossibility of Safe Universal Approximators Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T20:41:55.705061Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T20:41:55.705061Z digest=sha256:5a0cdfce6daded3b8503ac345a95ab5188ecc68aa207bb375b925cae6ce2f25b

Observation 8df23637-84c2-469c-9c99-74379c48e3b2 · inbound

Better Models, Faster Training: Sigmoid Attention for single-cell Foundation Models cites this paper.

Better Models, Faster Training: Sigmoid Attention for single-cell Foundation Models Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 22

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T09:46:27.691301Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-07T09:14:43.547868Z digest=sha256:0ff82afc7c101984a990df157d933989a5cbc6473025fec621360ded71a23466

Observation 207a9276-95fd-46a8-b724-536c01db841b · inbound

Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining cites this paper.

Learning Less Is More: Premature Upper-Layer Attention Specialization Hurts Language Model Pretraining Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 18

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T06:31:27.833373Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-12T04:12:20.784347Z digest=sha256:c13bd9f3252c8c63705fdbc9dafe68fc29ee0914be283918d921537dbd202c1d

Observation a3f1361b-574b-488f-aa13-093ccf56b6b2 · inbound

Chaos in reason: How chain-of-thought LLMs can look for an answer cites this paper.

Chaos in reason: How chain-of-thought LLMs can look for an answer Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T01:11:34.656927Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T01:11:34.656927Z digest=sha256:0d5999de574475133c22f6e94afe83a0bf7ca08117e217bd3fba777336a3d161

Observation d331f88d-c31b-4697-9ccd-0521c2c5989c · inbound

One QK Channel, Many Sources: Guarding Low-Precision Attention Collapse cites this paper.

One QK Channel, Many Sources: Guarding Low-Precision Attention Collapse Stabilizing Transformer Training by Preventing Attention Entropy Collapse

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-04T15:20:16.222454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T15:20:16.222454Z digest=sha256:a84827000b86e721bbba4fa29604d1f0ab10241b0b0bc953ff0e150e045550ea