Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z
Paper Citation Record · LEDGER
As of 8 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 1 inbound Pith citation observation for arXiv:2505.22549.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-06-26T21:25:15.709652Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-07-04T00:09:15.167070Z
62 of 62 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation d2172a97-5db9-44bd-940e-f6e3a406a789 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1182027c-1689-4156-9684-b6ec03755afb · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Arjevani, Y
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 06d66d0d-b985-48ff-b2f1-9020cf6ff699 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Balles and P
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation c2fceca2-3682-44d7-ac14-742348bfe704 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Ben Allal, A
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 1eeb5636-1ece-4a77-b008-610f822a643c · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 5
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation f4aabb6e-e55f-47e6-80f0-2ee6a4b6b9ed · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Brown, B
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 85f54d5b-9c0d-4c0a-915c-3e936ec6cb40 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7dcaaa74-a7ad-4b7e-8a40-33a8c294e375 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation e397315e-a9c3-4ad6-b551-2f29fe8c7e29 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Cheng and M
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation e3cbe639-80a1-4d91-9dfd-0cc96524c175 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Chowdhery, S
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 56c4c9b9-d72e-4cab-95bf-0ca6cfe59eab · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ec5ff9dd-d323-429c-b9ae-5d73bd6acdd0 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models DiLoCo: Distributed Low-Communication Training of Language Models
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dc2aca47-b452-4bb7-9d1f-c8ec3322efaa · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Llama 3 Herd of Models
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fa042afe-7b73-4a30-ba41-43604c9a1a77 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Hägele, E
Reference 14
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation d3ec821f-913d-4e5c-8e05-df2105ea2c9f · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Training Compute-Optimal Large Language Models
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 02244ee3-5359-4aac-a49f-4620c7a164eb · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Iacob, L
Reference 16
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation b70640e3-b4a8-44a8-bcc5-5658b1bedac2 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kairouz, H
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation acbbcfa6-4117-4adf-9623-1b9f978c102d · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Scaling Laws for Neural Language Models
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 376832bb-4af6-4c5e-8318-9b5c83f6dc18 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation e6b5315a-c6d4-4ce1-a797-9a502e0854e0 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 02b638ad-33a7-4afb-9204-5936a9e00396 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kunstner, J
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9ac251c1-d723-4cb9-8bbe-b6c7b1434dd3 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 553ec41f-12ed-4230-8365-2b04178fd61e · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On Distributed Adaptive Optimization with Gradient Compression
Reference 23
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9070db0e-b562-4e6e-95cd-a603cefe4134 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Asynchronous Local-SGD Training for Language Modeling
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5b730c6a-0274-4a67-89cc-ec0346934cfd · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models An Improved Analysis of Stochastic Gradient Descent with Momentum
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1ba3bc43-cbaf-4110-8490-f59d8522d991 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models McMahan, E
Reference 26
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 0fdc09ab-3052-41d3-b99f-ce62e1a5d987 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pagliardini, P
Reference 27
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 56b6d560-0ace-49c7-a97d-8e2ebdf0eb02 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pascanu, T
Reference 28
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation c38cac2e-3901-4c06-9d7c-510c33131ad8 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Penedo, H
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 31724ded-a253-4b0a-82e1-f6fc126e04cd · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Rajbhandari, J
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation de86753f-45cd-41d4-a142-a31a4eb5fa0f · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation dd1bc151-ab41-426d-81d6-81c6d1a113fa · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Romero, J
Reference 32
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9670be89-79d8-4266-9918-a33f2a890c84 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Future of Large Language Model Pre-training is Federated
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f35efcc2-b8a9-4ef4-9009-2212069bb9b6 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 7dc45ccc-7726-4c18-be64-1d6f46d010bd · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sardana, J
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 1633bc0d-b3c6-455e-9726-e95d9252e04f · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0edd5e36-f54c-4ea8-9d15-ad58925c83a3 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Horovod: fast and easy distributed deep learning in TensorFlow
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dcc13d16-0859-42b1-878a-2b6d86398f7b · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fc3c1ede-4716-4da3-a7af-1cd3deb103ae · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 1c8d626d-472d-4307-b3eb-49323cc5fe02 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation fae14c7f-d9e3-4107-9ccf-58096e679471 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 41
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 3e0828f0-b59b-4972-9592-a2c521a7d14a · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sutskever, J
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 284a3f56-ed13-49ee-b690-91e29127956b · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Taniguchi, K
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 1e361132-4e09-46ec-b25e-2197c8203fa1 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Touvron, L
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 11adccbd-73df-459a-b8f8-7ffb50aaaf5d · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models A Field Guide to Federated Optimization
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4b52a0a3-13e7-4cda-8ad3-3c5fbfa43fb7 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Wortsman, T
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9b8a6365-cff8-4b6e-94ef-da7de7d9d3d3 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation cd03e95e-8439-4bc0-a05e-d05eed787a6f · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 5b0172b0-644d-41ee-a673-1a941bf38ccd · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 6eef702e-2002-468c-8be1-d59019a01988 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zellers, A
Reference 50
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 9baf1577-4e6d-4ae4-ae60-cbfa1c113c7b · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, D
Reference 51
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation d1fc6803-060c-4bd3-b437-6bf27ee7b888 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, C
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 3cfae97b-22f2-47a0-887e-05acd4d4b233 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 4130c04a-182c-4b4f-9db3-1f4c5cded0bb · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Starting from the recommended baseline learning rate (η0) from Allal et al
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 2f86a6c2-fac7-40d6-8d20-bcb3e60a948c · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation a47370d2-6703-46b3-a6ba-9cb97ecfc5dd · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 2a by including results on the heterogeneous data dis- tribution described in Section 4.1
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 84a2cd1c-e0d3-4019-bc13-1279e37a1492 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 072682f0-0c24-4435-8b21-291f702ca700 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by evaluatingDES-LOC-Adam
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation adafeeb5-6161-44ab-9cd6-4ed87e2d9bed · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1)
Reference 59
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation fdb9cb9d-a4d9-4009-bb60-b631ec4d23a1 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work
Reference 60
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation c596c3a4-92a7-41c7-ab4b-b3e0fe3fafd1 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 60c5d486-d6dd-416d-9b5e-8ebfe01f3065 · outbound
DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models standard
Reference 62
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.
Observation 4e410f05-9633-4292-9045-ef6ea71e3455 · inbound
FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models
Reference 110
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.