Pith. sign in

Paper Citation Record · LEDGER

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

As of 9 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 3 inbound Pith citation observations for arXiv:2508.01483.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.01483 v1

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T05:55:59.258807Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T12:38:54.214964Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-01T07:35:29.145833Z

Reference resolution

25 of 25 outbound references displayed

  • verified exact1
  • verified fuzzy7
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e64f15ae-2dd7-4dc1-b24f-663b9b1d1926 · outbound

This paper cites The 210M parameter model is used in the majority of the experiments.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The 210M parameter model is used in the majority of the experiments

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.537123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.236650Z digest=sha256:79d68786f5029a394dcdacbb79613277cf82363527a0fe41809ea7179b420266

Observation ad4e3efd-a260-4745-9c5b-3f30696613ab · outbound

This paper cites All runs are trained with bfloat16 automatic mixed precision.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler All runs are trained with bfloat16 automatic mixed precision

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.547942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.232940Z digest=sha256:1dfffc646d38a97da29c60007f004695bf56db15f2bc8c451fb5940aa158819c

Observation 2115d95b-9171-448a-a406-aa00182860b1 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.183667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.183667Z digest=sha256:655a4f9eae86992db7564bf38263a914a63f1a2088ab90d5f3b3f123bc106df1

Observation d412c8ff-fcee-4fd4-822c-7e428aa65de8 · outbound

This paper cites Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule

Reference 7

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.358651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.191450Z digest=sha256:9835b129dbec1d31784256cea8c80584e5e3fcb27d499229cf46ea7c79281f0c

Observation 69dd7595-67b5-4912-b7db-73a62bd9bab1 · outbound

This paper cites Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training

Reference 8

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.344185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.195570Z digest=sha256:848dce3e5586e8e25d7dfc9c243fee75491a9d7df35ccf5b4c1604c305ee135b

Observation 4353f7bc-a0b3-4d53-84e0-45d0af8c4c6c · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.591293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.203520Z digest=sha256:1fe191755a13c7bdaab29a5d26def23c1228e9d8e27be54e2ef3abfe9fabbdd6

Observation b9426328-c111-4b69-b3a0-8f8b51c52533 · outbound

This paper cites doi: 10.18653/v1/2024.acl-long.293.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.acl-long.293

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.207072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.207072Z digest=sha256:7abf9f9abca0e75471d9e015f90454deee9c52aa7d7a30d1728e641c3e4e83ab

Observation ef360291-23dc-49cf-b3a7-df6e3df566fc · outbound

This paper cites Don't Decay the Learning Rate, Increase the Batch Size.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Don't Decay the Learning Rate, Increase the Batch Size

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.210656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.210656Z digest=sha256:683d452a519bcd775fa7b61467669fbdb4c2448d7b15fd46481ce54c80c0dbe0

Observation bf2116aa-d4ff-40e6-863b-a992720fe400 · outbound

This paper cites Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.580840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.214720Z digest=sha256:7fba8e81487d9b650e841890d5fad431bdf5f3f19d3f51b521f68730dc6bb40f

Observation f580f63f-e4c4-4652-8135-ac6ad900a171 · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.954.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.findings-emnlp.954

Reference 14

Resolution
verified exact
doi, observed 2026-08-06T05:55:59.290875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.218248Z digest=sha256:64e73ce09b70e7a24c44e3899c1d852381548a76323a822e0c443f582373e098

Observation 5f0e8e74-056e-4c73-a84c-aa0ac1620d68 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler LLaMA: Open and Efficient Foundation Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.221774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.221774Z digest=sha256:e5662a60e6aa01f7496803b81e167c84efc5a7a40f387c3b4b08d9017a8d9bb6

Observation 9a27deff-1654-4ae9-bb7c-f62815412d85 · outbound

This paper cites 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.569801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.225701Z digest=sha256:70bf0fd2a76389c9dfd8c44ecd0d9172d1d6bc257a9041bd3a6631b26b210d53

Observation a80fc90e-720b-48d2-aac3-1bb7e1a9176a · outbound

This paper cites 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.558978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.229131Z digest=sha256:2fac1fcca941adc8b6347261d37b8be16e7fc3c287170c32aaca8eb162717150

Observation 02a056cd-9cb2-4ee4-b63b-3d86532566e0 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.504163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.247298Z digest=sha256:c3eec5ee889e4b8bf90ca0181fab776cd284688809e9128c10549c13cfd17310

Observation a970ca86-da9b-4405-a693-f1ebf87989f5 · outbound

This paper cites Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.525954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.240218Z digest=sha256:ea2c787b6983cc476967b75f41f0522eec8cc5de49b3fd2d475e2317472b4c5a

Observation c25cd938-6e2b-45ef-ad7b-7af13e4b9ebd · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.514509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.243991Z digest=sha256:5ca4bb79d11eb2b0e9232af80c7bc8d4cc01be4553006b9480e1bdcebd6df2d3

Observation a0b0458f-e33c-4606-a9ec-b0316251651e · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.492461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.251270Z digest=sha256:2f0f34ca25f8e7b6da90e8e9c72c30308130f2ae4e25f5a2194d336df5adbeb8

Observation 4a2350c0-b7da-4a76-8039-e8a11de5be3f · outbound

This paper cites effective learning rate.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler effective learning rate

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.481617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.254943Z digest=sha256:af6168136c2c2e58a632ffe05c03c2c787c2b6bf9e563867a76c0d1091675dea

Observation c67ab800-5a04-4d09-90ed-1fafb9fda031 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.470768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.258807Z digest=sha256:7d6ef42ddd43a96ee2cf4722b3f80176fdc07d06df5d613309787742feb3549f

Observation b51ce19c-d957-49fd-ba5d-2ceab981533c · outbound

This paper cites Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.199656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.199656Z digest=sha256:aa3fc69fc2bf718816da3d84d0130cd01a1b2b5e77c462cbe5eca09df819a731

Observation 3860b738-1439-4bf8-9137-5dd28d9283b6 · outbound

This paper cites Online Normalization for Training Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Online Normalization for Training Neural Networks

Reference 2019

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.392100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.175107Z digest=sha256:3b582b7c65977483d19e919233f0c67517873dbc891137fbf3fb128d0535c65f

Observation 79e55738-1928-4437-b9db-ff79d9374f41 · outbound

This paper cites The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.187523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.187523Z digest=sha256:1532ffa54382cedcd017cec58f60f202549c13aa771e7de25d820fe855489593

Observation 9f4e2581-7596-42f5-ae26-ee771dafc909 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.601287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-06T05:55:59.179408Z digest=sha256:196481bf5acc20021615959879bd6d2773abc2f8b28e3f8aa3b2eddb4830630a

Observation e5e79c72-541b-441f-8e96-9ab167de6dba · outbound

This paper cites Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.166459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.166459Z digest=sha256:2ea0fef5aa6e923723ed21a2339f31d3beadff17deff333256d6cf473c26db7e

Observation 1b48094d-8215-4781-b2fe-76fcf80fa2e7 · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.170814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.170814Z digest=sha256:1a28b55a62ea2375770d5d354ad8ac93a9ba7a56215c9d332e32ef84e519e74b

Pith citing papers

Observation a5ed8a55-fe3a-47d2-8dbc-4f922557ea2f · inbound

Why Do We Need Warm-up? A Theoretical Perspective cites this paper.

Why Do We Need Warm-up? A Theoretical Perspective Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-04T12:38:54.214964Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T12:38:54.214964Z digest=sha256:8f8b983edf17835c6790e625939cc0aaf401829084e3ff4842dee56e249c80d3

Observation ef85312c-51f3-4c57-95ef-b567d5823845 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:21:28.309833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-12T04:19:12.696712Z digest=sha256:8808315ab29aed546db160999db07b401191960190bee73dbbf007027b2af2f1

Observation 912ed991-2177-4a6b-84d1-51791829ffd9 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:29.147307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-07-01T07:26:37.559459Z digest=sha256:a567a9dc3712f0f55d388e04d95c2b5dc4b79bc94e8048beecf5a4de2a76d19e