Pith. sign in

Paper Citation Record · LEDGER

TRACE for Tracking the Emergence of Semantic Representations in Transformers

As of 8 August 2026, this Paper Citation Record lists 58 of 58 outbound references and 1 inbound Pith citation observation for arXiv:2505.17998.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.17998 v1

Coverage vector

measured 58 of 58 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:42:13.959881Z

measured 59 of 59 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T00:50:49.134622Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T00:54:48.765802Z

Reference resolution

58 of 58 outbound references displayed

  • verified exact1
  • verified fuzzy29
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 54f9f796-dc94-44e3-bdfa-8935561b6600 · outbound

This paper cites Intrinsic dimensionality explains the effectiveness of language model fine-tuning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Intrinsic dimensionality explains the effectiveness of language model fine-tuning

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.689558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:09.519913Z digest=sha256:74273285c33aa363e429341769e2f55ed03e90c3da09d38418cc88948f62db29

Observation 3dfaa656-3a0c-4931-aa98-3a8e1b81c8f8 · outbound

This paper cites How to escape sharp minima with random perturbations.

TRACE for Tracking the Emergence of Semantic Representations in Transformers How to escape sharp minima with random perturbations

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.527583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:09.587864Z digest=sha256:fc313b6b80c5d72dc13f0e339cbbd2bb01c921a1a92f3c1b0486b01611ecba7d

Observation 7033f00e-c35d-4c06-8285-009e92155297 · outbound

This paper cites CARMA: Enhanced Compositionality in LLMs via Advanced Regularisation and Mutual Information Alignment.

TRACE for Tracking the Emergence of Semantic Representations in Transformers CARMA: Enhanced Compositionality in LLMs via Advanced Regularisation and Mutual Information Alignment

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.671639Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.671639Z digest=sha256:56dc014f14cdf1ffa3c81641962c31ce6ba5afb7a1c08e05e4b649a154d63186

Observation 305c588a-0f63-4b28-85ac-9dcb6e6e3a06 · outbound

This paper cites Intrinsic dimension of data representations in deep neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Intrinsic dimension of data representations in deep neural networks

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.733269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.733269Z digest=sha256:e1e2bcee3141f47a5336f4b9b5986988f87c627f3cf55f672de13c6505bd8813

Observation 881781b3-0aea-4e6c-b148-87df5a54abf6 · outbound

This paper cites Baker, Charles J.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Baker, Charles J

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:09.836733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:09.836733Z digest=sha256:ad937337556692283484260c2fbc286380ec7cc788ec621356e08bc98c74a5a7

Observation 40d9a486-8b2f-4393-8357-ec7e9a7e6e0f · outbound

This paper cites Mutual information neural estimation.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Mutual information neural estimation

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.339470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:09.905580Z digest=sha256:6ba05e4ecc7c4f197da5a253d799d85616911f3f184a53882389e6f5a0055ecb

Observation f3d00bd0-af7a-4ae3-8b41-1b45d978c945 · outbound

This paper cites Visualizing high-dimensional loss landscapes with hessian directions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Visualizing high-dimensional loss landscapes with hessian directions

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:18.160650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:09.977358Z digest=sha256:8641a9a80577c1e7914a58656b546c06b667b561a28bde3190cdeb2be5c14645

Observation fa8b2097-3db1-40a7-be6d-faec3b87d122 · outbound

This paper cites Algorithms for manifold learning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Algorithms for manifold learning

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.924828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.032756Z digest=sha256:9420cca6be9512883676385e15664f420d1f019377c95b2183fc4d892c2abf70

Observation d62fb9fa-6478-4d26-8251-47775b016c44 · outbound

This paper cites Bridging information-theoretic and geometric compression in language models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Bridging information-theoretic and geometric compression in language models

Reference 9

Resolution
verified exact
doi, observed 2026-08-07T14:42:14.111642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.096373Z digest=sha256:c95979824e0ce0d049f79310cb7f040bf7dbd1c057654274e33439ddd03f2316

Observation 333f5674-2172-4247-814b-e2876f2a23e7 · outbound

This paper cites Emergence of a high-dimensional abstraction phase in language transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Emergence of a high-dimensional abstraction phase in language transformers

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.691396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.217727Z digest=sha256:5bd9fd56b366fb80f344897ccbd3c98eb866db39c9432ee9258b853d42eece2c

Observation 89bd24da-afbe-4f92-8a42-d52ef315f4e9 · outbound

This paper cites Information-theoretic progress measures reveal grokking is an emergent phase transition.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Information-theoretic progress measures reveal grokking is an emergent phase transition

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.576368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.316512Z digest=sha256:fbe09b6039bf367ac7971400379eec6de2467f13fa8483e3288ec132bd32b3d3

Observation 86db478a-b96e-42f5-a5dd-a1be703e2546 · outbound

This paper cites The devil is in the detail: Simple tricks improve systematic generalization of transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The devil is in the detail: Simple tricks improve systematic generalization of transformers

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.429375Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.358035Z digest=sha256:dff5bb418feb10cb02458c8a0bfb14611f84e231449525732066e07ff3088df6

Observation 88972c94-ef66-4087-be9b-2c9fd136f58b · outbound

This paper cites Sparse Autoencoders Find Highly Interpretable Features in Language Models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Sparse Autoencoders Find Highly Interpretable Features in Language Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.467741Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.467741Z digest=sha256:919fbba097929ceae749ba978dafe84b45e1be01ec3e2e0a75efa45deb7be4c0

Observation b277f457-bf29-4123-a67d-9a56eab948d0 · outbound

This paper cites Knowledge Neurons in Pretrained Transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Knowledge Neurons in Pretrained Transformers

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.581513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.581513Z digest=sha256:4a1c6410bac171c2b53a8730fa39f553e02149ed95bb3ee9bd709f4bc2003cc4

Observation eab9e30a-c869-4828-a8f1-99353d4c46d9 · outbound

This paper cites The generalized ratios intrinsic dimension estimator.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The generalized ratios intrinsic dimension estimator

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.226864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.689459Z digest=sha256:1735a4bd89e60b3351851ba2d601e0633c0a0beceea858c0502fcd98b2447ecb

Observation 23f784e0-5248-430b-8c29-cf48d0cb68f6 · outbound

This paper cites A Complexity-Based Theory of Compositionality.

TRACE for Tracking the Emergence of Semantic Representations in Transformers A Complexity-Based Theory of Compositionality

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.760023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.760023Z digest=sha256:a12ac3b2e1097c00be7f76820e9dd2b79c7f543dcd903c2c264be07e4697762e

Observation 4205720b-396e-49f5-ac59-7ca5a8ecd6e9 · outbound

This paper cites Estimating the intrinsic dimension of datasets by a minimal neighborhood information.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Estimating the intrinsic dimension of datasets by a minimal neighborhood information

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.831423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.831423Z digest=sha256:9e6a2065317f23c12d7e734180dfe2cc614213201c774aef0faa4c466d5cfb65

Observation 06a79309-8851-411c-b92e-49e741f4e1eb · outbound

This paper cites Not All Layers of LLMs Are Necessary During Inference.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Not All Layers of LLMs Are Necessary During Inference

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:10.919440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:10.919440Z digest=sha256:80e00eca0783121c891dedb5b13882f30635f912f1fab5d1c1cde754e4f53281

Observation c87277f1-00bd-4cbe-9005-e08d89bdd060 · outbound

This paper cites Fillmore.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Fillmore

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.133858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:10.963321Z digest=sha256:5a4f68de7173c07d90c396f23838e32d41cac4619f7dabdb44d5238bdb70a54b

Observation 198ee351-fda7-43a3-ad2e-8a013737af29 · outbound

This paper cites Studying large language model generalization with influence functions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Studying large language model generalization with influence functions

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:17.077514Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.056985Z digest=sha256:5bbb03c22f3839149bd9dde839fe230ca8ed8270e1a9a84cb2fe3a3b71fd18c1

Observation 5eb52840-a66f-4899-afa5-db4569a7ee96 · outbound

This paper cites Visualizing and Understanding the Effectiveness of BERT.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Visualizing and Understanding the Effectiveness of BERT

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.209841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.209841Z digest=sha256:9f1d507cdd0b5fbea0829fe682e113532c1184d403ae662e7dbb3bd4de1fd0b2

Observation 96505720-da93-41be-ad6a-6367f2009d8c · outbound

This paper cites An empirical analysis of compute-optimal large language model training.

TRACE for Tracking the Emergence of Semantic Representations in Transformers An empirical analysis of compute-optimal large language model training

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.892462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.280231Z digest=sha256:caccd47d40969855cddd7c9a9d0f3daa95f16fd5dacf8dfaf55a7c90d50cb4f8

Observation 36d38018-c528-49ad-8d71-e2bdae93d9fa · outbound

This paper cites Loss Landscape Degeneracy and Stagewise Development in Transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Loss Landscape Degeneracy and Stagewise Development in Transformers

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.363810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.363810Z digest=sha256:953b8e6a77c08aa5235335e3ed25f763b812dabbb639adf2805ae5e4dbbadf75

Observation 874e74ec-647d-4688-bda9-819497f7c57d · outbound

This paper cites Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67:757–795, 2020.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Compositionality decomposed: How do neural networks generalise? Journal of Artificial Intelligence Research, 67:757–795, 2020

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.438531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.438531Z digest=sha256:698ba5c21bb37aa45898d67c19cfd2996d08ab23b013fec72f08e3ceba73267c

Observation a7b3033b-cf0f-4785-b843-37bdeb121de3 · outbound

This paper cites Are Sparse Autoencoders Useful? A Case Study in Sparse Probing.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Are Sparse Autoencoders Useful? A Case Study in Sparse Probing

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.515244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.515244Z digest=sha256:10415c0a79dd0c9a52fd1febe5f7a16a17a7f0f92a843095bacb5aaf60747f94

Observation 5f94e3bf-ee16-4919-9738-8ec136c7e6b7 · outbound

This paper cites On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima.

TRACE for Tracking the Emergence of Semantic Representations in Transformers On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.576632Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.576632Z digest=sha256:92fa519f08aa8ffa3280c6683bb4966529c065a00c243847d16d0ce9ff2d44cc

Observation 31c4a7cb-99ff-4176-8501-8a7731b70e39 · outbound

This paper cites Flow of information in feed- forward denoising neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Flow of information in feed- forward denoising neural networks

Reference 27

Resolution
metadata mismatch
raw_fallback, observed 2026-08-07T14:42:14.469302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.646556Z digest=sha256:4b141e6151b4bf8e93693cef68ed8f317b202d8af2ce7836ea0a687d06776626

Observation b677f69b-6412-49d9-96d9-6ea98207608f · outbound

This paper cites Adam: A Method for Stochastic Optimization.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Adam: A Method for Stochastic Optimization

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.757633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.757633Z digest=sha256:1ba23051d9e97cd92c33441f42843c1274d7429e4e833dace6c995ae36504275

Observation 146740e2-e296-4078-b8df-c4eb80430911 · outbound

This paper cites Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Generalization without systematicity: On the compositional skills of sequence-to-sequence recurrent networks

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.788122Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.846769Z digest=sha256:5f6b03428a55748930650b9a921f83e998a38c6c474bdc6729a2777021fabb66

Observation 67b0c5ea-cef1-4bcd-a9de-d67d49b0c7ec · outbound

This paper cites An iteration method for the solution of the eigenvalue problem of linear differential and integral operators.

TRACE for Tracking the Emergence of Semantic Representations in Transformers An iteration method for the solution of the eigenvalue problem of linear differential and integral operators

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.677497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.903547Z digest=sha256:fa0614fd8361cb7fccf686ad466221adfb3c61051e727176f06af0f34a296b08

Observation 14b76094-7a1a-4fc4-8358-4a0693261c70 · outbound

This paper cites Geometric Signatures of Compositionality Across a Language Model's Lifetime.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Geometric Signatures of Compositionality Across a Language Model's Lifetime

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:11.962777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:11.962777Z digest=sha256:9e756784fda7eb780799b29e2387482fc2785e144b44ad5bc0808f5e12ba36fd

Observation c35ce934-db6b-4a40-a329-08db86ed596c · outbound

This paper cites Break it down: Evidence for structural compositionality in neural networks.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Break it down: Evidence for structural compositionality in neural networks

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.543976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.994318Z digest=sha256:849a0797d08fed2d8d2f819e285e6a1944fc29aac8a15aa290fbfe283d048c07

Observation 4513ccb3-e580-4b04-a255-c5cfd495d3ff · outbound

This paper cites Systematic generalization and emergent structures in transformers trained on structured tasks, 2023.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Systematic generalization and emergent structures in transformers trained on structured tasks, 2023

Reference 33

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.415779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.076497Z digest=sha256:2fade78a871f0ab582745bbbfd556a262a806b872b82692adfb40a861d88da80

Observation 7996c54d-93ca-419b-8947-3ba9f2c917b4 · outbound

This paper cites Multiscale geometric methods for data sets i: Multiscale svd, noise and curvature.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Multiscale geometric methods for data sets i: Multiscale svd, noise and curvature

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.236157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.139766Z digest=sha256:ef2d3fc5621a3ee869901f720e283a176eaf487c97a1f6d5f5a2cbbf7feeec73

Observation ebaca91c-368d-4c05-9a66-f5ea048dd20e · outbound

This paper cites Deep double descent: Where bigger models and more data hurt.Journal of Statistical Mechanics: Theory and Experiment, 2021(12):124003, 2021.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Deep double descent: Where bigger models and more data hurt.Journal of Statistical Mechanics: Theory and Experiment, 2021(12):124003, 2021

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.191247Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.191247Z digest=sha256:caa92bf1184cac03d53b8265dcccb74e6bd1cdd2fb7aa58a67ff420c638e1743

Observation 15fc1d8c-bf23-4caa-b093-53bf2cf48cfe · outbound

This paper cites Progress mea- sures for grokking via mechanistic interpretability.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Progress mea- sures for grokking via mechanistic interpretability

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:16.097272Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.263314Z digest=sha256:fe6d2d6705d997ae919222ff9fbd0ef46d135622e476d6b476d6b8ea7c5bf5f7

Observation 7c3a5340-ae92-410f-b65a-fe4eb9a0e841 · outbound

This paper cites In-context Learning and Induction Heads.

TRACE for Tracking the Emergence of Semantic Representations in Transformers In-context Learning and Induction Heads

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.352469Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.352469Z digest=sha256:340d133fce5156b2dd969400339b770ae9a932161d67423d35aeea2387148740

Observation aa574f1f-36db-4587-8b82-cb8a29e1fb72 · outbound

This paper cites Lisa: Layerwise importance sampling for memory-efficient large language model fine-tuning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Lisa: Layerwise importance sampling for memory-efficient large language model fine-tuning

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.436982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.436982Z digest=sha256:2da0a31325de13e5204d726b76b6e51ccf0c77fa23441bd96b4a00aaca93a8a7

Observation 7e689f40-08ba-4431-bf17-258a1205f9f5 · outbound

This paper cites The geometry of categorical and hierarchical concepts in large language models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The geometry of categorical and hierarchical concepts in large language models

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.995645Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.501820Z digest=sha256:f954c7de7811def151030294470ab589c0690d09d4d039a7b073d1ecb3aa9702

Observation 80f4fa42-1a0b-4e61-96e4-5058de3aa99a · outbound

This paper cites Zipf’s word frequency law in natural language: A critical review and future directions.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Zipf’s word frequency law in natural language: A critical review and future directions

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.547150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.547150Z digest=sha256:0987673988a6ae0fe8da3129278d5a53841b841b76a63c1d00c1dcb38450d151

Observation eea18095-1869-4a43-9f65-819b6555e8aa · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.616903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.616903Z digest=sha256:233e9b080015173074c6ca40b13c6cf69ca52f5316778db1700bf83e860da221

Observation 7ecc17e4-e366-49ff-b57f-ec5f6d294456 · outbound

This paper cites The shape of learning: Anisotropy and intrinsic dimen- sions in transformer-based models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The shape of learning: Anisotropy and intrinsic dimen- sions in transformer-based models

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.931711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.704795Z digest=sha256:0924ca6f125868e1895b73ed6a47a111d69a355b073f35d28c6ed7d937b16bf1

Observation 4ac94895-f962-4946-9816-dbedb7605b46 · outbound

This paper cites The effective rank: A measure of effective dimensionality.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The effective rank: A measure of effective dimensionality

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:12.765119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:12.765119Z digest=sha256:5efec3a0c8c2ffada6b796274f9c6afdcfa30bc3b97e75c2e08384de5960b43c

Observation 745dfc1e-f9e1-474b-899f-a2e5f2b741dc · outbound

This paper cites A deeper look at the hessian eigenspectrum of deep neural networks and its applications to regularization.

TRACE for Tracking the Emergence of Semantic Representations in Transformers A deeper look at the hessian eigenspectrum of deep neural networks and its applications to regularization

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.802883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.869529Z digest=sha256:6a18cd7d00ac2321849031a7c49235e7c82af780d163f43995d546789697a094

Observation 4b56f033-2846-4659-aa97-2cca2b620443 · outbound

This paper cites Analysing mathematical reasoning abilities of neural models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Analysing mathematical reasoning abilities of neural models

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.727679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:12.959945Z digest=sha256:e862c2bd9c0c5986b8cd77d9d4afd2c85248a0fea0063e77752b68635672fe91

Observation ecbbe8e1-dcf4-42ef-b93e-837d5c879434 · outbound

This paper cites Analytic insights into structure and rank of neural network hessian maps.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Analytic insights into structure and rank of neural network hessian maps

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.493617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.087043Z digest=sha256:dd8d17b8be304e84808eb7e1e920098702024260dda8cfe1b5cbc08f4e118c28

Observation d324e018-af54-4058-b8c0-3f9035691025 · outbound

This paper cites Layer by Layer: Uncovering Hidden Representations in Language Models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Layer by Layer: Uncovering Hidden Representations in Language Models

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.180944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.180944Z digest=sha256:24f081832b96b493983ccf6c2e48c22a22dbea48640034afcce08ef608b57d4d

Observation 63958d1e-82cc-4f90-a625-ca31dca3a88a · outbound

This paper cites Negative results for saes on downstream tasks and deprioritising sae research (gdm mech interp team progress up- date #2), March 2025.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Negative results for saes on downstream tasks and deprioritising sae research (gdm mech interp team progress up- date #2), March 2025

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.409779Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.262213Z digest=sha256:842ed2853b675bca78e6d6fe339b65b95e87792d7c3f71a8524c5312adf4c08b

Observation 285c6b45-8d1c-4b61-929d-c7825db2a158 · outbound

This paper cites The geometry of hidden representations of large transformer models.

TRACE for Tracking the Emergence of Semantic Representations in Transformers The geometry of hidden representations of large transformer models

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.361811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.361811Z digest=sha256:9914ba553d82bf658d1c3872bc1e9869d6c02c10494e09d2a39cd5a21770b7a8

Observation e39d421b-cdf9-4308-bce5-7bb3400a8eb5 · outbound

This paper cites Attention is all you need.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Attention is all you need

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T14:42:13.445174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:42:13.445174Z digest=sha256:8f211ef4eca5905e1022698e5f3a35d58733af6fae6225fabc09851593f5206f

Observation 87ab987c-cfef-4b33-87d0-835ce5fa48b8 · outbound

This paper cites Loss landscape geometry reveals stagewise development of transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Loss landscape geometry reveals stagewise development of transformers

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.261792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.523403Z digest=sha256:10acf4b23cfd6c69aa610380d1a787530b34d7975e3e82192fe60748e34e6342

Observation a7ab022a-cea0-4cd2-9bb2-4c938f269b36 · outbound

This paper cites Penalizing gradient norm for efficiently improving generalization in deep learning.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Penalizing gradient norm for efficiently improving generalization in deep learning

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.163061Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.619097Z digest=sha256:f19cf2d4320427ddfc08ef5583a9c0e864048f4a2fadee2932c3146c2c0e67bf

Observation 11f65c12-4f3b-4bb2-b1e4-561effb46326 · outbound

This paper cites Algorithmic capabilities of random transformers.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Algorithmic capabilities of random transformers

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:15.057299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.719543Z digest=sha256:6afbc986eb2492c9740b77a9e872010eb64fc870c31c91b26fdae39e120a628c

Observation b3db6963-7903-421f-8a58-a703d02dd134 · outbound

This paper cites Susskind, Samy Bengio, and Preetum Nakkiran.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Susskind, Samy Bengio, and Preetum Nakkiran

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:14.929332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.771114Z digest=sha256:7c7d79e3c72378e0ff716080a61fa4eea1fbb02f40efe30b702f186c0eed06e9

Observation 780b74b9-3aa4-4f75-b002-2baf6afa248f · outbound

This paper cites noun2 verb3 noun5.

TRACE for Tracking the Emergence of Semantic Representations in Transformers noun2 verb3 noun5

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T14:42:14.752021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.959881Z digest=sha256:5fd4cc055faa5d9cf2113ff72bafa11c59b3b3260e58a64ad1eb1db1e54eb4e8

Observation 6afe8182-68e1-4536-86f0-694a0d848d7e · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:14.834517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.860852Z digest=sha256:9b868a866a3c89ea6be7d54c24d9a37fb8249d74429ae2387d40d266196607eb

Observation c41654ee-fbc1-4c6a-8204-dbed1783a169 · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 2019

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:15.606068Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:13.031867Z digest=sha256:49eb50bfb8295d9a93759de7dc95ba4ab176caa9505a919591c242379a6dd926

Observation bc771ef0-d21e-41dd-9554-6974d468451a · outbound

This paper cites an unresolved cited work.

TRACE for Tracking the Emergence of Semantic Representations in Transformers Unresolved cited work

Reference 2024

Resolution
unresolved
raw_fallback, observed 2026-08-07T14:42:16.973758Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T14:42:11.134431Z digest=sha256:bc9f809a2f0285853d276a65536bd8bc0733a69ba3dde423e70a4521bb151dc5

Pith citing papers

Observation cb30c5bf-1c43-4288-b1ad-d731ef66f01e · inbound

Rethinking Intrinsic Dimension Estimation in Neural Representations cites this paper.

Rethinking Intrinsic Dimension Estimation in Neural Representations TRACE for Tracking the Emergence of Semantic Representations in Transformers

Reference 27

Resolution
verified exact
arxiv_id, observed 2026-05-10T00:54:48.767180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-05-10T00:50:49.134622Z digest=sha256:cdd082e148a265a2d2b752a3c1e99923e22cde82e1a5d8e352df6cfc42ee7c0e