Pith. sign in

Paper Citation Record · LEDGER

What Can Grokking Teach Us About Learning Under Nonstationarity?

As of 21 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 2 inbound Pith citation observations for arXiv:2507.20057.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.20057 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T17:59:10.428787Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T10:34:43.639777Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-21T07:34:02.917248Z

Reference resolution

30 of 30 outbound references displayed

  • verified exact2
  • verified fuzzy9
  • unresolved19
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a33e064c-2a2f-46d9-89b2-1aafb51075dd · outbound

This paper cites LayerNorm layers, when incorporated, are applied to the attention inputs and outputs, and the MLP outputs.

What Can Grokking Teach Us About Learning Under Nonstationarity? LayerNorm layers, when incorporated, are applied to the attention inputs and outputs, and the MLP outputs

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.867629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.419198Z digest=sha256:89be2c9a4973c4e19181d340660eb4a20a91cb1e235fb21fdf5050880b75f3bc

Observation 266f8e5a-1112-465f-8fed-f6f71db8c494 · outbound

This paper cites an unresolved cited work.

What Can Grokking Teach Us About Learning Under Nonstationarity? Unresolved cited work

Reference 2

Resolution
verified exact
raw_fallback, observed 2026-08-15T17:59:10.581087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.428787Z digest=sha256:282c8514ddf6e5eff7c41c79ed222b2af60b2c5d9df509572a760a71e7eb7194

Observation 0ddf42b4-9fac-4894-b765-744d56dec34b · outbound

This paper cites Unveiling grokking: Analyzing feature learning dynamics during training.

What Can Grokking Teach Us About Learning Under Nonstationarity? Unveiling grokking: Analyzing feature learning dynamics during training

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.997182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.291734Z digest=sha256:524fbb8847f735df35b938d4efbc0f01cfe8abcdd75f1f347c508ce76ae78b10

Observation ea857991-2d3c-4e33-a3b1-3b7bf41b1cc6 · outbound

This paper cites Unifying Grokking and Double Descent.

What Can Grokking Teach Us About Learning Under Nonstationarity? Unifying Grokking and Double Descent

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.311153Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.311153Z digest=sha256:29e2b0186314b22404fdab501e9e6735232800de87633dd993f1261bba7eab75

Observation a560902e-5e70-47a7-ac13-2172d4976cb3 · outbound

This paper cites Continual Backprop: Stochastic Gradient Descent with Persistent Randomness.

What Can Grokking Teach Us About Learning Under Nonstationarity? Continual Backprop: Stochastic Gradient Descent with Persistent Randomness

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.317139Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.317139Z digest=sha256:a3f0b4e505e37b783f1334e396e6d5093b03f122958d66a79493d4f35bd64128

Observation d8f42cc5-76a6-41ed-ba1f-4fec4504961e · outbound

This paper cites Learning continually by spectral regularization.

What Can Grokking Teach Us About Learning Under Nonstationarity? Learning continually by spectral regularization

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.968839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.338917Z digest=sha256:bf457aa880ac8fa349b74df08f980e475aee20d983ed681b877abe43f852bbca

Observation 8c0cf492-03d2-4990-b1a7-3629ed7108d7 · outbound

This paper cites An exponential learning rate schedule for deep learning.

What Can Grokking Teach Us About Learning Under Nonstationarity? An exponential learning rate schedule for deep learning

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.956588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.349304Z digest=sha256:d2c870dc2559bb05ee61fc727eda9c99539f964e42d51b24ba88c2b7cacec7a1

Observation 16dde9bc-2408-4715-b719-5b47ac63b3c6 · outbound

This paper cites Disentangling the Causes of Plasticity Loss in Neural Networks.

What Can Grokking Teach Us About Learning Under Nonstationarity? Disentangling the Causes of Plasticity Loss in Neural Networks

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.354242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.354242Z digest=sha256:de0af3c7829db2e49143bd86d4a253bee3b25bd2c8a804ffb23175412f2ae4f2

Observation b146f3d7-a4dc-443f-91cd-fbf5a2c14fd1 · outbound

This paper cites Progress measures for grokking via mechanistic interpretability.

What Can Grokking Teach Us About Learning Under Nonstationarity? Progress measures for grokking via mechanistic interpretability

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.359160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.359160Z digest=sha256:a43d5173765b2c6b4a227b897378ef3f12a4f108f587c7c33053c28348ac1ba5

Observation d8c28d6f-f892-471e-aba1-994cd6ea9756 · outbound

This paper cites Cyclical learning rates for training neural networks.

What Can Grokking Teach Us About Learning Under Nonstationarity? Cyclical learning rates for training neural networks

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.924145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.374235Z digest=sha256:11dc3bda70aa19848db535f3126c7348d809c032938a715e1b58e61d39a13737

Observation 6296aa7e-7ab0-4bf5-948a-3493b1eb89bd · outbound

This paper cites On the infinite width limit of neural networks with a standard parameterization.

What Can Grokking Teach Us About Learning Under Nonstationarity? On the infinite width limit of neural networks with a standard parameterization

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.379132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.379132Z digest=sha256:08b15793c4404cfb491ded51b97e17d85084940bbede92d2d0bbacb69bfa7a0b

Observation d1ef3a8a-7be3-4aef-8eb8-f0d4e38c79ec · outbound

This paper cites Susskind.

What Can Grokking Teach Us About Learning Under Nonstationarity? Susskind

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.910375Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.383781Z digest=sha256:3b2a4388e2b4d535efef034274be170b55b8e9d22a7eca231b9976176701f1fa

Observation 3fffa72d-907f-408b-b12a-e2e11041e324 · outbound

This paper cites Deep Reinforcement Learning and the Deadly Triad.

What Can Grokking Teach Us About Learning Under Nonstationarity? Deep Reinforcement Learning and the Deadly Triad

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.388260Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.388260Z digest=sha256:f17c66e8a99cc268a5cb830418c9d01ed3a9523b4902bd15b1bde446b7db26d1

Observation 02155c98-8f02-46db-a674-054dc9e7c979 · outbound

This paper cites Explaining grokking through circuit efficiency.

What Can Grokking Teach Us About Learning Under Nonstationarity? Explaining grokking through circuit efficiency

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.393060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.393060Z digest=sha256:9c7ecf061c194be2c73d5060db5134054c6d5c188c538ddec9d5088ca0a4bb36

Observation 08ce421a-91b0-482a-bcce-9c909a8c2ec1 · outbound

This paper cites Small-scale proxies for large-scale Transformer training instabilities.

What Can Grokking Teach Us About Learning Under Nonstationarity? Small-scale proxies for large-scale Transformer training instabilities

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.398905Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.398905Z digest=sha256:9e6611b955b4e94de025a76d2387a4c200fa6c27eaca1acd544648b38c34319c

Observation 906f71b4-4a82-43e3-a8d2-dd814fdffe8e · outbound

This paper cites Wide feedforward or recurrent neural networks of any architecture are gaussian processes.

What Can Grokking Teach Us About Learning Under Nonstationarity? Wide feedforward or recurrent neural networks of any architecture are gaussian processes

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.897574Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.404208Z digest=sha256:d601c7dad120d67639a2e0169b7c949f127704cf7c748650e3bbab6baba57c0b

Observation 1047ff90-9f4a-4071-b21a-0992968c40b8 · outbound

This paper cites an unresolved cited work.

What Can Grokking Teach Us About Learning Under Nonstationarity? Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-15T17:59:10.881650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.414018Z digest=sha256:5ae7322b35dd3a4899c0c414320d64e40b814b0b1899b5058f56d3684ab90554

Observation b8b0d6d6-9114-441b-94a5-d3018f54b6be · outbound

This paper cites an unresolved cited work.

What Can Grokking Teach Us About Learning Under Nonstationarity? Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-15T17:59:10.852763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.424203Z digest=sha256:ca272fd5b906feea92c8817e16651255eb65ad8fbd96fe590fb7cb2dae6dc820

Observation 13248f8d-f4d2-443d-9996-0fa5537002ea · outbound

This paper cites A study on the plasticity of neural networks.

What Can Grokking Teach Us About Learning Under Nonstationarity? A study on the plasticity of neural networks

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.297015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.297015Z digest=sha256:9ad06157dd2fc0a220fc8af1729b8f53560283e511f421779c2ad9d2e717168e

Observation 22351bf8-d39f-499c-9a2d-8a3492c02aef · outbound

This paper cites Early stopping in deep networks: Double descent and how to eliminate it.

What Can Grokking Teach Us About Learning Under Nonstationarity? Early stopping in deep networks: Double descent and how to eliminate it

Reference 2015

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.982639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.323206Z digest=sha256:0c962380b2d0a235926caaca175445ad4700fc0c226ad2a7a2bc61bada6e851a

Observation f10a81b3-d873-4188-85fc-b4b62b004891 · outbound

This paper cites Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets.

What Can Grokking Teach Us About Learning Under Nonstationarity? Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Reference 2016

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.364239Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.364239Z digest=sha256:3a993527cfaa52fd5caf550d8464596c4c511b108546fd7f46ca1a8b432b2721

Observation c4ed09f4-f5bc-4d29-b807-e3b34f9ec5b0 · outbound

This paper cites Second-order regression models exhibit progressive sharpening to the edge of stability.

What Can Grokking Teach Us About Learning Under Nonstationarity? Second-order regression models exhibit progressive sharpening to the edge of stability

Reference 2017

Resolution
verified exact
local_arxiv, observed 2026-08-15T17:59:10.821562Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.280478Z digest=sha256:c6eaa59545eae38d520cf16d1758b4da3352bba71d0cdc8c3ca15439e062200b

Observation 838c3a9d-5e08-49ea-95ad-313b3546d625 · outbound

This paper cites Maintaining Plasticity in Continual Learning via Regenerative Regularization.

What Can Grokking Teach Us About Learning Under Nonstationarity? Maintaining Plasticity in Continual Learning via Regenerative Regularization

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.328060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.328060Z digest=sha256:6914869086bdbeb4652f880e104bfe71fb15e12b6ab961735ecb3185c4e54519

Observation a37ad0a8-7f91-4b32-8004-f57355b9e24e · outbound

This paper cites Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer.

What Can Grokking Teach Us About Learning Under Nonstationarity? Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer

Reference 2019

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.409472Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.409472Z digest=sha256:5570acc20559a57d7cf5594373542b4d7d16a2c69b08faeb209a1594eebc0c7e

Observation bb2fe723-d15c-4539-8965-aa09ce56a16a · outbound

This paper cites Implicit Gradient Regularization.

What Can Grokking Teach Us About Learning Under Nonstationarity? Implicit Gradient Regularization

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.285588Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.285588Z digest=sha256:9744a28551edeb2bac568d9711a792faafca6490883a272a8b5d2aacd9b1f8b3

Observation 7b8d9fe0-d696-4300-b765-3bd6a747fbb2 · outbound

This paper cites Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability.

What Can Grokking Teach Us About Learning Under Nonstationarity? Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.303191Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.303191Z digest=sha256:fb0f4038e6834ca148c0dc22e135b8dd6d20a617f3a34bd25434cfa7757a0fbd

Observation 18ada590-9283-4b06-a50a-f6bf1017c784 · outbound

This paper cites On the interplay between stepsize tuning and progressive sharpening.

What Can Grokking Teach Us About Learning Under Nonstationarity? On the interplay between stepsize tuning and progressive sharpening

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-15T17:59:10.937999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-15T17:59:10.369129Z digest=sha256:c845dd7a3071d6d47376f51adcb1971e4eb74cee19634c01e97060c59477430c

Observation 5ed21da5-a930-4c5a-a6a4-f090cd75db1c · outbound

This paper cites Critical Learning Periods in Deep Neural Networks.

What Can Grokking Teach Us About Learning Under Nonstationarity? Critical Learning Periods in Deep Neural Networks

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.274377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.274377Z digest=sha256:a0d377aea940743ac8ae623b6154947848153f4cc77f7bdc3cf4ab6fb6f494af

Observation 5533ea32-393c-4d80-8b1f-a1ab9b0a3c80 · outbound

This paper cites Directions of Curvature as an Explanation for Loss of Plasticity.

What Can Grokking Teach Us About Learning Under Nonstationarity? Directions of Curvature as an Explanation for Loss of Plasticity

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.333300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.333300Z digest=sha256:4d88b803b7efc0fc679004d9cfe690eee44df8f699069d9208ea9fea63110ed3

Observation bb9e2d4a-14b5-43f3-a56b-4156a41cbec7 · outbound

This paper cites The large learning rate phase of deep learning: the catapult mechanism.

What Can Grokking Teach Us About Learning Under Nonstationarity? The large learning rate phase of deep learning: the catapult mechanism

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-15T17:59:10.343791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T17:59:10.343791Z digest=sha256:0fedfefcd17ea99bff2700f9cfda08adae115cf9dc24b3a042259526e0e36727

Pith citing papers

Observation 15211429-16f3-4e8c-8bec-d330d49ab307 · inbound

Weight Decay Regimes in Grokking Transformers: Cheap Online Diagnostics cites this paper.

Weight Decay Regimes in Grokking Transformers: Cheap Online Diagnostics What Can Grokking Teach Us About Learning Under Nonstationarity?

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-21T07:34:02.918767Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-05-21T07:30:07.287938Z digest=sha256:b2b298b3e24d77a1b974b92dd336781e005c934840c7ac52603fe14ad14bbfa6

Observation 4c48ecc3-b73b-48ea-b9a8-4099b40208ce · inbound

The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models cites this paper.

The Kinetics of Training: A Driven-Nucleation Rate Law for Emergence, Plasticity Loss, and Circuit Control in Language Models What Can Grokking Teach Us About Learning Under Nonstationarity?

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-01T10:34:43.639777Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T10:34:43.639777Z digest=sha256:1cfbe672ab6fd8af0844daa473f5bcc1ed81dde47db03ed719506b5cdde10fc5