Pith. sign in

Paper Citation Record · LEDGER

Mechanistic Insights into Grokking from the Embedding Layer

As of 23 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 3 inbound Pith citation observations for arXiv:2505.15624.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15624 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:33.600845Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-11T00:46:52.525784Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-11T00:47:42.529781Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy7
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a1567f65-7ae7-4bfb-9799-d8f790b73b5c · outbound

This paper cites Unifying Grokking and Double Descent.

Mechanistic Insights into Grokking from the Embedding Layer Unifying Grokking and Double Descent

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.311984Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.311984Z digest=sha256:b8824860e37985679d19137abc3aa49c9890f0a4fb7b78d06531a79e662dd869

Observation 6d143eb0-f0f2-4aec-a7f8-7cb0c7af2b31 · outbound

This paper cites Grokking Modular Polynomials.

Mechanistic Insights into Grokking from the Embedding Layer Grokking Modular Polynomials

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.413642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.413642Z digest=sha256:1566437a6e2287f8b9c5b33440fe2e22f11ac135a65472dee996043d80c9dcfb

Observation 9945eda6-9954-4e43-90e3-a9ff8dec296c · outbound

This paper cites Deep Grokking: Would Deep Neural Networks Generalize Better?.

Mechanistic Insights into Grokking from the Embedding Layer Deep Grokking: Would Deep Neural Networks Generalize Better?

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.512408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.512408Z digest=sha256:9b6a91dc05a50d0744b00d558353dbd54723756389b6c1a90b9e9c451f285985

Observation 5c346a6e-f423-4725-bf80-2df3f2041573 · outbound

This paper cites Grokking modular arithmetic.

Mechanistic Insights into Grokking from the Embedding Layer Grokking modular arithmetic

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.589869Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.589869Z digest=sha256:6a6f9616b22a6574352aa996ecfff5337c2c98190af6fbee6613c29e995e72bb

Observation 03ef6097-b76f-4801-a308-79708ae23106 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:36.091392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:31.674210Z digest=sha256:62cf42bd901ebbadebcd6b17498a557d6c8392daa066679295b16037289abf66

Observation 516a2bc2-0ad6-4865-97d4-94074518c8a5 · outbound

This paper cites Deep Networks Always Grok and Here is Why.

Mechanistic Insights into Grokking from the Embedding Layer Deep Networks Always Grok and Here is Why

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:31.770732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:31.770732Z digest=sha256:d732577ba08512583c8af0b833189b0411327ab25d33f6e5c1c050addc929257

Observation 8055ed54-856d-4d60-b4da-3bfb127837fd · outbound

This paper cites Jeffares, A.

Mechanistic Insights into Grokking from the Embedding Layer Jeffares, A

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.927084Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:31.871110Z digest=sha256:f02b6c960560cd743388c20e3b047e6148ec1b4b7693e0fc49994de408bb1a3e

Observation c2cb3d8b-281f-492e-9aac-cb0261ace342 · outbound

This paper cites Kobayashi, Y.

Mechanistic Insights into Grokking from the Embedding Layer Kobayashi, Y

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.782635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:31.966594Z digest=sha256:63352ba7966cbc78748f7e8dc28a2db0e345e2532cb7550eded15acbb389aff6

Observation efec256d-0e15-427f-a806-b591c61bfe1b · outbound

This paper cites Kumar.Grokking as the transition from lazy to rich training dynamics.

Mechanistic Insights into Grokking from the Embedding Layer Kumar.Grokking as the transition from lazy to rich training dynamics

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.650629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:32.104945Z digest=sha256:7bfde7cfa21a77eea2f6690d27c713cbf44c10a25ca7b347fbb4abfcd453b2e2

Observation dd889ea2-f70c-49c0-805a-a2fce27314aa · outbound

This paper cites Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be.

Mechanistic Insights into Grokking from the Embedding Layer Noise Is Not the Main Factor Behind the Gap Between SGD and Adam on Transformers, but Sign Descent Might Be

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.185977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.185977Z digest=sha256:f0513afe82a661ee9e90d92b5faa6072f7ee041093d17453d3d52ab5b057b3bf

Observation d6d12055-1c57-463e-97b5-fb5fb706bda7 · outbound

This paper cites Grokfast: Accelerated Grokking by Amplifying Slow Gradients.

Mechanistic Insights into Grokking from the Embedding Layer Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.279376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.279376Z digest=sha256:ba89c08555c4833f119f4a14ace170a4e126c26672ca0a1e5cb078fa87a7d23b

Observation b8b276ee-db82-4c96-b527-582ea220c614 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.527786Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:32.374873Z digest=sha256:24f0af9e426a05ce3b5102e78bad79fbf295e63ddd465797b6658381f168a93d

Observation 6f712040-a429-4652-8368-7fb819591959 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:35.411399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:32.451877Z digest=sha256:eef8dc8046234bd309cb468dec3e501f6cf65fcdb8c227c74ccbaecaa46ed68f

Observation 4edad32a-ca95-44e4-aa99-fd44fb87a4c7 · outbound

This paper cites Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking.

Mechanistic Insights into Grokking from the Embedding Layer Dichotomy of Early and Late Phase Implicit Biases Can Provably Induce Grokking

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.525471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.525471Z digest=sha256:4b4d896cb79d69d1087e0417832a56a66a5cd831985b14cc52f11a29a10ac7d3

Observation fe6b5f78-8ed3-44df-a795-4e4e76431139 · outbound

This paper cites Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition.

Mechanistic Insights into Grokking from the Embedding Layer Why Do You Grok? A Theoretical Analysis of Grokking Modular Addition

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.612854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.612854Z digest=sha256:87252f57ac797c7c41e611aff70b25b1737cd05574dc0ee0274b6adefafd4d1d

Observation fdd0ef98-8ed2-4d81-83c7-a3921b229c0f · outbound

This paper cites Nakkiran, G.

Mechanistic Insights into Grokking from the Embedding Layer Nakkiran, G

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:35.198115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:32.726031Z digest=sha256:d1b61c11ab87b87374e3265bb1059f63c1bd60ceca645a4f53dbcead9e145ca5

Observation ef27649e-48a9-407b-ad40-f0bea8a86ee0 · outbound

This paper cites Progress measures for grokking via mechanistic interpretability.

Mechanistic Insights into Grokking from the Embedding Layer Progress measures for grokking via mechanistic interpretability

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.787652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.787652Z digest=sha256:fcd1d3bb67b8393aa63b31ba8f6e25060385e3768a4e254701f62e93aff12b40

Observation 86065612-bebb-4c33-b7ee-6d21d2f4474e · outbound

This paper cites Toward Understanding Why Adam Converges Faster Than SGD for Transformers.

Mechanistic Insights into Grokking from the Embedding Layer Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.846977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.846977Z digest=sha256:f06c1124d19036020014f98a920890ffbcae9cc477306cee996aeb4fb2f01c90

Observation 7ff63fd5-d0ac-42d9-b025-6f6a941825fc · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

Mechanistic Insights into Grokking from the Embedding Layer Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.907248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.907248Z digest=sha256:4d620b804105fa0c7e151d5b3f134be2cb9830e3d47aa0f1a955cb21aa323080

Observation 5a6f4584-9cee-4797-9c82-1e357fe54ed9 · outbound

This paper cites Grokking at the Edge of Numerical Stability.

Mechanistic Insights into Grokking from the Embedding Layer Grokking at the Edge of Numerical Stability

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.966025Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.966025Z digest=sha256:95c07e919b88203d921d53dc3a3d16f256749af214b44642384b0e18cfce2f3f

Observation 934c21f7-3b4a-432d-ae6c-16d98684e37a · outbound

This paper cites Explaining grokking through circuit efficiency.

Mechanistic Insights into Grokking from the Embedding Layer Explaining grokking through circuit efficiency

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.018742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.018742Z digest=sha256:1b76a705fa8cbbcb34fe307e62f76108f4ff65cd54ce432682cea48ab4ab73b2

Observation 0f68dad0-555d-49be-a7f5-b6cf1d835efa · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.088522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.088522Z digest=sha256:bc162f070c9d1e30d275dbaa79d52d57d4af6f29b13ed5bb70ae2735dd170cd7

Observation befd7f07-cf2f-4dd4-837c-c158b116bf73 · outbound

This paper cites Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model.

Mechanistic Insights into Grokking from the Embedding Layer Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.165073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.165073Z digest=sha256:375bac048ae63f736ca8e61cab75dc81a1744719b5e962fe6d49a61c293ce306

Observation 64a87adb-cb78-467d-980d-9ca0ad804177 · outbound

This paper cites Yang and E.

Mechanistic Insights into Grokking from the Embedding Layer Yang and E

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.955379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:33.244750Z digest=sha256:f06531d1963ad7b5991df00c5d56e676ab32b67aadd012f2ec241d3c4cd7b397

Observation a46dae56-8ffe-4a9d-972c-b3508831d25c · outbound

This paper cites Zhang, S.

Mechanistic Insights into Grokking from the Embedding Layer Zhang, S

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.789016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:33.329481Z digest=sha256:ce78fd754576f7ff17b38ceaaf6853f57db5b38581b391b1701f8b9e8ca4ae0e

Observation 8db54ecc-4645-45b5-aa8f-62252775bc69 · outbound

This paper cites Why Transformers Need Adam: A Hessian Perspective.

Mechanistic Insights into Grokking from the Embedding Layer Why Transformers Need Adam: A Hessian Perspective

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:33.396451Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:33.396451Z digest=sha256:0e56565bc8133d008e566b75010574d19545de47d9a06e0a443637065e87cf7b

Observation 63cf471c-575a-4285-8928-cd5f11de9c27 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.646298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:33.461927Z digest=sha256:a816441ee7ac41adfc4b6ee580442a66b7cb179656abfac6fc79382693023323

Observation 94d77c88-887a-4b30-a7c5-afbfd1704530 · outbound

This paper cites an unresolved cited work.

Mechanistic Insights into Grokking from the Embedding Layer Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:34.462892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:33.515869Z digest=sha256:727e7e5b692f1b84d931a8006f39211bf9475174fffac768b456bdb566fafea9

Observation 0cb443d6-bec1-4308-ab18-747d43efe9dd · outbound

This paper cites Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training.

Mechanistic Insights into Grokking from the Embedding Layer Figure 9 shows the maximum eigenvalues of the Hessian with respect to E and W during training

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:34.254769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-07T15:20:33.600845Z digest=sha256:6298f2c6ac26c2340ab8c866a911469f18da03e4dbc40a3a67d380bfab6a2209

Pith citing papers

Observation 62ecb233-e66f-4453-a930-9227882a6184 · inbound

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction cites this paper.

Deciphering Two Training Clocks in Grokking via Deep Linear Network Theory with Conditional ReLU Reduction Mechanistic Insights into Grokking from the Embedding Layer

Reference 57

Resolution
verified exact
arxiv_id, observed 2026-07-02T12:06:56.081199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-28T02:26:16.631418Z digest=sha256:5de2878e56794945b475cbd23134d0838e196c4322958e89881d1cdf73024d7f

Observation 1b04501c-70a7-4c5e-8e6e-8f0b3f04c833 · inbound

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic cites this paper.

Beyond Neural Collapse: Task-Intrinsic Geometry Governs Neural Representations in Modular Arithmetic Mechanistic Insights into Grokking from the Embedding Layer

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-07-02T23:57:28.749482Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-27T17:39:14.658342Z digest=sha256:b29aa3a31dfdef7be080fb8a8c344d5aae68d29c10f132b2dab5b03cb6b6465a

Observation 19c113ba-196b-4a86-8859-7cab247f68bd · inbound

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics cites this paper.

At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics Mechanistic Insights into Grokking from the Embedding Layer

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-07-11T00:47:42.552783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-07-11T00:46:52.525784Z digest=sha256:efa30b6eb2db4f7a9fe3c236198f2f8d081997e4c68c07fcf6d458d931afc674