Pith. sign in

Paper Citation Record · LEDGER

Toward Understanding Why Adam Converges Faster Than SGD for Transformers

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2306.00204.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2306.00204 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:32.846977Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T00:27:30.098265Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 86065612-bebb-4c33-b7ee-6d21d2f4474e · inbound

Mechanistic Insights into Grokking from the Embedding Layer cites this paper.

Mechanistic Insights into Grokking from the Embedding Layer Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:32.846977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:32.846977Z digest=sha256:4898178a52e9090c9ac820c9eb766838d84bc174006ff3ba7c3a05f8301cd1f6

Observation c90daf0d-ba2c-4c9c-8d1c-cfba25a472cb · inbound

Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling cites this paper.

Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T00:50:30.615997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:50:30.615997Z digest=sha256:2af8b3ef740614c60d1f35ade2f4b1182e7b16116a4972086f07dc8671277333

Observation 94da035a-eaff-4fde-bff5-c5e39899b738 · inbound

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails cites this paper.

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-15T16:36:17.446775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-15T16:34:31.388219Z digest=sha256:ed53dca8cc82f2b751e7aea03e5be79f436fe9387d9c6149b4a09f7b76dd4742

Observation a94a8ef7-bd88-443b-ab9a-14d63ed5e166 · inbound

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails cites this paper.

Why Adam Can Beat SGD: Second-Moment Normalization Yields Sharper Tails Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-05-21T11:50:03.763820Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-21T11:47:27.345223Z digest=sha256:1e47382245f96c75ec8488101ac3afba8bce69f02b2cac32fc4e8d954765e985

Observation 23181093-ef2c-42ff-804d-ff41c271be07 · inbound

Spatial navigation in preclinical Alzheimer's disease: A review cites this paper.

Spatial navigation in preclinical Alzheimer's disease: A review Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 68

Resolution
unresolved
no resolver link, observed 2026-07-13T19:53:53.219607Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-13T19:53:53.219607Z digest=sha256:6aaf2f83fca288354b2f5875da29c6243e852c099b9aea26e1e197b9d2480251

Observation f02d5820-7681-4c60-b805-390ab01bc326 · inbound

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent cites this paper.

Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 37

Resolution
verified exact
arxiv_id, observed 2026-05-11T19:16:09.672347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-08T12:22:27.265973Z digest=sha256:5fae83b6ecf2da5a313aeea281567ed2cc92aa805514249571cc0841df0719a3

Observation fbdbb427-e811-45ef-b2ed-c306509e69e1 · inbound

Convergence of difference inclusions via a diameter criterion cites this paper.

Convergence of difference inclusions via a diameter criterion Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 118

Resolution
verified exact
arxiv_id, observed 2026-05-15T02:23:31.750140Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-15T02:21:30.228735Z digest=sha256:56229fed57affcd5068a711c068d639fc6a6e3ec4a5073e04fa4735cee404926

Observation 0ca5b382-defb-4f32-aac0-d706b0f72e82 · inbound

Revisiting the Adam-SGD Gap in LLM Pre-Training: The Role of Large Effective Learning Rates cites this paper.

Revisiting the Adam-SGD Gap in LLM Pre-Training: The Role of Large Effective Learning Rates Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-05-20T13:38:19.452751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-20T13:34:09.129379Z digest=sha256:fd46452856e23f09b1162df2e5df2fd7b308a71024374f48b1f0d77f6933f7ab

Observation 29350e22-a680-4dad-b17d-d3242da6f806 · inbound

Looped Transformers with Layer Normalization Provably Learn the Power Method cites this paper.

Looped Transformers with Layer Normalization Provably Learn the Power Method Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 55

Resolution
verified exact
arxiv_id, observed 2026-06-28T19:22:35.276216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-28T19:03:51.212121Z digest=sha256:a2671b508312211954e63bf7f44a137a5f5d0150e89bc78887963e1efef37774

Observation 8f1ec825-57ee-4075-b27d-5c225b58b0a2 · inbound

Why Muon Outperforms Adam: A Curvature Perspective cites this paper.

Why Muon Outperforms Adam: A Curvature Perspective Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 174

Resolution
verified exact
arxiv_id, observed 2026-07-02T07:16:44.460115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-28T07:04:21.012269Z digest=sha256:095e37140b85f075f23cc05046186d15b400959c3cf81358a3202edc17b3ba86

Observation c0eb6d77-ba4d-4e16-be4b-ff2dc4a299bb · inbound

Muon Learns More Robust and Transferable Features than Adam cites this paper.

Muon Learns More Robust and Transferable Features than Adam Toward Understanding Why Adam Converges Faster Than SGD for Transformers

Reference 52

Resolution
verified exact
arxiv_id, observed 2026-07-03T00:27:30.099527Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-27T17:08:30.717799Z digest=sha256:51724bcbd60eae9b4c06fe0cf4fa18655f5d357b22fa4176eaec1357f94d4b2b