Pith. sign in

Paper Citation Record · LEDGER

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

As of 22 August 2026, this Paper Citation Record lists 25 of 25 outbound references and 3 inbound Pith citation observations for arXiv:2508.01483.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.01483 v1

Coverage vector

measured 25 of 25 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T05:55:59.258807Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T12:38:54.214964Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-01T07:35:29.145833Z

Reference resolution

25 of 25 outbound references displayed

  • verified exact1
  • verified fuzzy7
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e64f15ae-2dd7-4dc1-b24f-663b9b1d1926 · outbound

This paper cites The 210M parameter model is used in the majority of the experiments.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The 210M parameter model is used in the majority of the experiments

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.537123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.236650Z digest=sha256:a3a57495633f663870a1b30df85a72421114647aead39f17e5c4471d31d2a28b

Observation ad4e3efd-a260-4745-9c5b-3f30696613ab · outbound

This paper cites All runs are trained with bfloat16 automatic mixed precision.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler All runs are trained with bfloat16 automatic mixed precision

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.547942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.232940Z digest=sha256:a3f3762509cf7ffa4e299bef30a03ec29586008e70db8fadbd48584cfd735e25

Observation 2115d95b-9171-448a-a406-aa00182860b1 · outbound

This paper cites An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.183667Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.183667Z digest=sha256:c8e3948d6a19d4813258326ac044f8cdb3de2729934e0cc22268f5dbdc2ccf20

Observation d412c8ff-fcee-4fd4-822c-7e428aa65de8 · outbound

This paper cites Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule

Reference 7

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.358651Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.191450Z digest=sha256:42ed49696922d153a7ad4175b5f62245bc5ae66a7ee493052a51336ca37568db

Observation 69dd7595-67b5-4912-b7db-73a62bd9bab1 · outbound

This paper cites Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training

Reference 8

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.344185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.195570Z digest=sha256:581868aced0936e5a5c13326a80fb9597b81871b3ea697f546b0fa256214b593

Observation 4353f7bc-a0b3-4d53-84e0-45d0af8c4c6c · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.591293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.203520Z digest=sha256:fbe1494e3953c06c5647b5e9615bd7fff345c3b5cfee8578d35f940a98a7f99c

Observation b9426328-c111-4b69-b3a0-8f8b51c52533 · outbound

This paper cites doi: 10.18653/v1/2024.acl-long.293.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.acl-long.293

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.207072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.207072Z digest=sha256:d212728ed4b577bb4cbe62d9dcb2be8daecbfb9b1268d7fe41c8c7c19806d43c

Observation ef360291-23dc-49cf-b3a7-df6e3df566fc · outbound

This paper cites Don't Decay the Learning Rate, Increase the Batch Size.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Don't Decay the Learning Rate, Increase the Batch Size

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.210656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.210656Z digest=sha256:d635d979bafa12c3cd6f213e88a391f3a7dfa62a3f7203095c83f2eef3e4d97b

Observation bf2116aa-d4ff-40e6-863b-a992720fe400 · outbound

This paper cites Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shreyas Subramanian, Vignesh Ganapathiraman, and Corey D Barrett

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.580840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.214720Z digest=sha256:7cea586bedc1196ac41fb218459038f5daa6855110ea86d2ff19a865fe441a23

Observation f580f63f-e4c4-4652-8135-ac6ad900a171 · outbound

This paper cites doi: 10.18653/v1/2024.findings-emnlp.954.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler doi: 10.18653/v1/2024.findings-emnlp.954

Reference 14

Resolution
verified exact
doi, observed 2026-08-06T05:55:59.290875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.218248Z digest=sha256:08c361441241c09c2cc36ba8b38703e4c7d9904421c4ce2ec10db787ebe65f44

Observation 5f0e8e74-056e-4c73-a84c-aa0ac1620d68 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler LLaMA: Open and Efficient Foundation Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.221774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.221774Z digest=sha256:5bcef9fa72dcc3490cd572c8c09a8bab4a2e8e02b04d12dd08e84421d063d4ec

Observation 9a27deff-1654-4ae9-bb7c-f62815412d85 · outbound

This paper cites 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 16 Published in Transactions on Machine Learning Research (08/2025) Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.569801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.225701Z digest=sha256:6a7c41192646ded0078b89c1fcc9e93b80ec83bfd1060808ca497f897de770c4

Observation a80fc90e-720b-48d2-aac3-1bb7e1a9176a · outbound

This paper cites 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler 17 Published in Transactions on Machine Learning Research (08/2025) A Experiments Context The experimental setup mirrors that of Hägele et al

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.558978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.229131Z digest=sha256:aeba7e0dc585e1075de5bef679948ed71368dfed0990911f6c2b419e971dfcac

Observation 02a056cd-9cb2-4ee4-b63b-3d86532566e0 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.504163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.247298Z digest=sha256:6e420cc531bd8d9dde936f5041118d19752cb67ea2ed1f41265a859c47b1b176

Observation a970ca86-da9b-4405-a693-f1ebf87989f5 · outbound

This paper cites Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Presumably, variations between plots should become less noticeable with an increase in the number of experiments with different data permutations

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.525954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.240218Z digest=sha256:a4719ccdc85a976ec3426599cb557d3c4f603617a5928406a663b78f3cbfdaf4

Observation c25cd938-6e2b-45ef-ad7b-7af13e4b9ebd · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.514509Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.243991Z digest=sha256:5f1e4c3b3097fd102e3382aa425ae837582809215fe9778533557dfd444e6162

Observation a0b0458f-e33c-4606-a9ec-b0316251651e · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.492461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.251270Z digest=sha256:ddbfb3a8494cd841f6a15e34d4d5c2c15900a80fae6c900258b58641a2b79f86

Observation 4a2350c0-b7da-4a76-8039-e8a11de5be3f · outbound

This paper cites effective learning rate.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler effective learning rate

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T05:55:59.481617Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.254943Z digest=sha256:1501380a9ed603a74355e5e739ce75a6d7c1ca15d34427a4ec63c2bbf50e5117

Observation c67ab800-5a04-4d09-90ed-1fafb9fda031 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.470768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.258807Z digest=sha256:b55867fb24e317121529f24184a4121a9044eaf3e085749ef7c35820780682b2

Observation b51ce19c-d957-49fd-ba5d-2ceab981533c · outbound

This paper cites Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.199656Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.199656Z digest=sha256:2f6eb793600a4b14696274331af962cfb3217f9566956d52b1d0d51efe4c57f9

Observation 3860b738-1439-4bf8-9137-5dd28d9283b6 · outbound

This paper cites Online Normalization for Training Neural Networks.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Online Normalization for Training Neural Networks

Reference 2019

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T05:55:59.392100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.175107Z digest=sha256:24655b0c813c0580dd9179d007f29da61c21ec02318cdda2fd83174617a7fcb2

Observation 79e55738-1928-4437-b9db-ff79d9374f41 · outbound

This paper cites The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler The Step Decay Schedule: A Near Optimal, Geometrically Decaying Learning Rate Procedure For Least Squares

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.187523Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.187523Z digest=sha256:7da519878c69c8215f25f0718ab70646277c5667f0483e3f1f0a0949772b37e9

Observation 9f4e2581-7596-42f5-ae26-ee771dafc909 · outbound

This paper cites an unresolved cited work.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Unresolved cited work

Reference 2023

Resolution
unresolved
raw_fallback, observed 2026-08-06T05:55:59.601287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-08-06T05:55:59.179408Z digest=sha256:b4bb725c35c4f7c476ef5e2816d035e961275e9ede877a7b85682c4056c4de19

Observation e5e79c72-541b-441f-8e96-9ab167de6dba · outbound

This paper cites Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, and Joel Hestness

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.166459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.166459Z digest=sha256:1090fa2cacbe5951f908470e1e084edbd9c14f64d90c0a3c31a575dc3a93a9cc

Observation 1b48094d-8215-4781-b2fe-76fcf80fa2e7 · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T05:55:59.170814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T05:55:59.170814Z digest=sha256:015bf39408f96bd27aba405fe5f7c0612d5bf79470cec7a5b76c297ebfcf2724

Pith citing papers

Observation a5ed8a55-fe3a-47d2-8dbc-4f922557ea2f · inbound

Why Do We Need Warm-up? A Theoretical Perspective cites this paper.

Why Do We Need Warm-up? A Theoretical Perspective Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-04T12:38:54.214964Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-04T12:38:54.214964Z digest=sha256:4542b5a7fe5c6644890566de8070332149b253f737d241441c34c646a92ba5d6

Observation ef85312c-51f3-4c57-95ef-b567d5823845 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-05-12T06:21:28.309833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-05-12T04:19:12.696712Z digest=sha256:4724a9a58f18cf6a9ac2c5c5a31668959f8d77d41e90010e033723213312dd7c

Observation 912ed991-2177-4a6b-84d1-51791829ffd9 · inbound

Sparse Layers are Critical to Scaling Looped Language Models cites this paper.

Sparse Layers are Critical to Scaling Looped Language Models Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler

Reference 23

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:29.147307Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

source=pdf_text observed=2026-07-01T07:26:37.559459Z digest=sha256:420645bc2b8d41f46fcd16c0cf99786e78f9c03ec69dc6924da0b3bea1c44a64