Pith. sign in

Paper Citation Record · LEDGER

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

As of 8 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 1 inbound Pith citation observation for arXiv:2505.22549.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.22549 v1

Coverage vector

measured 62 of 62 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z

measured 63 of 63 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T21:25:15.709652Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.167070Z

Reference resolution

62 of 62 outbound references displayed

  • verified exact3
  • verified fuzzy30
  • unresolved28
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d2172a97-5db9-44bd-940e-f6e3a406a789 · outbound

This paper cites SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.016971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.016971Z digest=sha256:6772abbd539df2b24728b7ef6b985501e6289f9cbadb9c02c29c2927a68e92cd

Observation 1182027c-1689-4156-9684-b6ec03755afb · outbound

This paper cites Arjevani, Y.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Arjevani, Y

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.319228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.076371Z digest=sha256:a380d5fe9a1fcaee9fe4917505ae07e29a693f052cc3553eb2e8529280b82349

Observation 06d66d0d-b985-48ff-b2f1-9020cf6ff699 · outbound

This paper cites Balles and P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Balles and P

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.141686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.189804Z digest=sha256:9f46e36cbece9e594c3816de41246925db96bfec537415731f0796fabdfd8d82

Observation c2fceca2-3682-44d7-ac14-742348bfe704 · outbound

This paper cites Ben Allal, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Ben Allal, A

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.023451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.345120Z digest=sha256:f32fad7456005e06b15f40cef8c1eb71bad57ddb5c973c060b96669971bcb3f6

Observation 1eeb5636-1ece-4a77-b008-610f822a643c · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.818454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.505095Z digest=sha256:2d4bf519bceef9e5010bff9ad98c9a410aa487120cc7bd5e474f61f1c44b5dab

Observation f4aabb6e-e55f-47e6-80f0-2ee6a4b6b9ed · outbound

This paper cites Brown, B.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Brown, B

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:36.553211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.584311Z digest=sha256:3b177b141f3063b0e54f16c98abf3acfc5fac998aaeaf36dae13a671441a810d

Observation 85f54d5b-9c0d-4c0a-915c-3e936ec6cb40 · outbound

This paper cites Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.674049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.674049Z digest=sha256:724fb8a2ff14a414f8f6fd7d4410740780611d7d3dcedf86f96e170bd7c132a4

Observation 7dcaaa74-a7ad-4b7e-8a40-33a8c294e375 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.299354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.819250Z digest=sha256:94e6b6f7b83b00d28bac30a8a29a4b938732541db25685503855a0f84241c65d

Observation e397315e-a9c3-4ad6-b551-2f29fe8c7e29 · outbound

This paper cites Cheng and M.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Cheng and M

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.995718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:20.901750Z digest=sha256:e865bafd5ddae8d78111a7cdb96206934288eb174824743b84a449fbc2a923d8

Observation e3cbe639-80a1-4d91-9dfd-0cc96524c175 · outbound

This paper cites Chowdhery, S.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Chowdhery, S

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.728657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.001201Z digest=sha256:b17115208b22df50214a1e0905e2f02ef92dea04c0dfa088b22eac3eea7ee2d4

Observation 56c4c9b9-d72e-4cab-95bf-0ca6cfe59eab · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.076522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.076522Z digest=sha256:5476250ccfe1801cb0324cc7aa79c031de5003edcae10074d058676ca2eb8f6d

Observation ec5ff9dd-d323-429c-b9ae-5d73bd6acdd0 · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models DiLoCo: Distributed Low-Communication Training of Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.194758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.194758Z digest=sha256:cbbeb9e7210d585d6ab4245d1f3039c1be91950424f04b01b711d5cb853b6928

Observation dc2aca47-b452-4bb7-9d1f-c8ec3322efaa · outbound

This paper cites The Llama 3 Herd of Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Llama 3 Herd of Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.241231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.241231Z digest=sha256:6864faaa16087dcb88e65f19231b6c3fb28186dde44e47ef7ecaf11758de1a99

Observation fa042afe-7b73-4a30-ba41-43604c9a1a77 · outbound

This paper cites Hägele, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Hägele, E

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.471669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.347722Z digest=sha256:c962f0ff50c8f9d0536c53ab35a4802bf675dc7a42b3d21554d41555a88bd1bd

Observation d3ec821f-913d-4e5c-8e05-df2105ea2c9f · outbound

This paper cites Training Compute-Optimal Large Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Training Compute-Optimal Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.432532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.432532Z digest=sha256:77590ada57b9f80b1559ea9a8a7d64cc7bff3efe530019ae3ca4a3c5f450e229

Observation 02244ee3-5359-4aac-a49f-4620c7a164eb · outbound

This paper cites Iacob, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Iacob, L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.289962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.502087Z digest=sha256:296b82a1e685ae892f3b74935d54cf74fed5814218bab1147938b9f9196e20d9

Observation b70640e3-b4a8-44a8-bcc5-5658b1bedac2 · outbound

This paper cites Kairouz, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kairouz, H

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.138200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.584559Z digest=sha256:89e8a63b046665a2e906897959e75db28f59273b959468fc045a3f87dcbaea44

Observation acbbcfa6-4117-4adf-9623-1b9f978c102d · outbound

This paper cites Scaling Laws for Neural Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Scaling Laws for Neural Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.616016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.616016Z digest=sha256:6eb9bcb26de6f2ff401725d72bd89d2d7eb81fa4257e194448b30e656382d15b

Observation 376832bb-4af6-4c5e-8318-9b5c83f6dc18 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.958988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.719820Z digest=sha256:907b2fb1bc3ca281fbcdcc13acb7a2fa7ddafc17c941b52e24eccde963464665

Observation e6b5315a-c6d4-4ce1-a797-9a502e0854e0 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.694578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.798715Z digest=sha256:414eae29b11429947200ee6ecdb0e1a051d149b8def87b605b8ac129b45c1120

Observation 02b638ad-33a7-4afb-9204-5936a9e00396 · outbound

This paper cites Kunstner, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kunstner, J

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:34.397500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.885888Z digest=sha256:451e6e408db51bc4228e92b97cb34cc41919fdb1a377f2b546a6c0e36b1d712a

Observation 9ac251c1-d723-4cb9-8bbe-b6c7b1434dd3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.195239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:21.972625Z digest=sha256:8d9350fc58c3e348cfe49bd8fa61723f0ad17792fba06b4d3f02228e374cb7a9

Observation 553ec41f-12ed-4230-8365-2b04178fd61e · outbound

This paper cites On Distributed Adaptive Optimization with Gradient Compression.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On Distributed Adaptive Optimization with Gradient Compression

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.318258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.047003Z digest=sha256:ba39e84c88bdddff3129dad41f7d3bf6ac6d21136d0f972a2d9bab294c94ba99

Observation 9070db0e-b562-4e6e-95cd-a603cefe4134 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Asynchronous Local-SGD Training for Language Modeling

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.137707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.137707Z digest=sha256:c0352c447de0bfa1d9c70b729cc1fd5b7af2a35b07b2f7f43b5d4e91f5681b47

Observation 5b730c6a-0274-4a67-89cc-ec0346934cfd · outbound

This paper cites An Improved Analysis of Stochastic Gradient Descent with Momentum.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models An Improved Analysis of Stochastic Gradient Descent with Momentum

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.271416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.271416Z digest=sha256:62443dbd10a71e07ddf939db80b19a282f9fdaf9ce1d4d7890764b7af1b3827d

Observation 1ba3bc43-cbaf-4110-8490-f59d8522d991 · outbound

This paper cites McMahan, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models McMahan, E

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.934171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.356385Z digest=sha256:229eedef301dac2ef2c9a9c31e2186ba206b4cc56c0443dd6af611cba2826166

Observation 0fdc09ab-3052-41d3-b99f-ce62e1a5d987 · outbound

This paper cites Pagliardini, P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pagliardini, P

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.696273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.421704Z digest=sha256:3abe98fde5d30d868d8f444c31371123fe9c49e74b2fa835b56d2438334b6077

Observation 56b6d560-0ace-49c7-a97d-8e2ebdf0eb02 · outbound

This paper cites Pascanu, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pascanu, T

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.513449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.510089Z digest=sha256:03df77dea84de58b2d959e7f2ce507dab34da68f092e23ca1f0a439dd393dff7

Observation c38cac2e-3901-4c06-9d7c-510c33131ad8 · outbound

This paper cites Penedo, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Penedo, H

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.317576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.599548Z digest=sha256:a78d8b2b791dbf00e75938c155e57d1ae1064214f3774e45483327a8e3702575

Observation 31724ded-a253-4b0a-82e1-f6fc126e04cd · outbound

This paper cites Rajbhandari, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Rajbhandari, J

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.137571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.735762Z digest=sha256:ae96b9d889094a3737c2715112a97ca842dace1200727b818500e23adf5cf8cd

Observation de86753f-45cd-41d4-a142-a31a4eb5fa0f · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:31.849223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.838407Z digest=sha256:96d39fdd4a9aea4f37b2f6ee4ef31740c4a71d2e1fd33362b8ad1159c2cfca38

Observation dd1bc151-ab41-426d-81d6-81c6d1a113fa · outbound

This paper cites Romero, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Romero, J

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:31.172018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:22.915688Z digest=sha256:40367bc98e7dfccea5c44a332c490598f89539d81c05d12830ffe985574dd445

Observation 9670be89-79d8-4266-9918-a33f2a890c84 · outbound

This paper cites The Future of Large Language Model Pre-training is Federated.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Future of Large Language Model Pre-training is Federated

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.000067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.000067Z digest=sha256:d98f1581c0550bff4eff0f88de70d5981579d0a33102435cd3fb552423fc8393

Observation f35efcc2-b8a9-4ef4-9009-2212069bb9b6 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.926712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.091906Z digest=sha256:a4a7e0c2749184951b97bee3d801a43be3835ddb8ffdc661e532f91dc59441a9

Observation 7dc45ccc-7726-4c18-be64-1d6f46d010bd · outbound

This paper cites Sardana, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sardana, J

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:30.730065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.138477Z digest=sha256:a4b09f4876206a490c7a7aa15b3df0b018698a7fce36da099811a3e276bb5be5

Observation 1633bc0d-b3c6-455e-9726-e95d9252e04f · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.210344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.210344Z digest=sha256:f5ac530d3d068e63f884a9150f01c21c29eaa41715e3751853b5811996646a12

Observation 0edd5e36-f54c-4ea8-9d15-ad58925c83a3 · outbound

This paper cites Horovod: fast and easy distributed deep learning in TensorFlow.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Horovod: fast and easy distributed deep learning in TensorFlow

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.272737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.272737Z digest=sha256:caa3102e5918e158395468b9f28970f229537b577d83b35c784c14aba4d2ed48

Observation dcc13d16-0859-42b1-878a-2b6d86398f7b · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.388282Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.388282Z digest=sha256:75e6fc3bc3816714e7c364081b941d9176313db37aa3d694247f8ee7e49ad525

Observation fc3c1ede-4716-4da3-a7af-1cd3deb103ae · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.297874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.472300Z digest=sha256:9e7da393c0f2c6bf67c87408941117932e10368013a7c654731805e990394b99

Observation 1c8d626d-472d-4307-b3eb-49323cc5fe02 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.060945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.544757Z digest=sha256:c8210a5f915dd4a3aaa63e88665fb37dc34c4b2d4f25f9d76f9f67710897fd43

Observation fae14c7f-d9e3-4107-9ccf-58096e679471 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.939892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.591593Z digest=sha256:a2939d45d3ec257d5f84f8811805cd2b881bc991e6c167680eac29955c940c30

Observation 3e0828f0-b59b-4972-9592-a2c521a7d14a · outbound

This paper cites Sutskever, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sutskever, J

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.727166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.721571Z digest=sha256:fcb5e8bc031225f028cd7aa4867bd643a8dcb2084fba3f2a8dd196db0593b3bd

Observation 284a3f56-ed13-49ee-b690-91e29127956b · outbound

This paper cites Taniguchi, K.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Taniguchi, K

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.456801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:23.778017Z digest=sha256:6f7464679ab5a85b933d348e8b07c9041a077d9fa6e8cf3948ec85e1acd5c168

Observation 1e361132-4e09-46ec-b25e-2197c8203fa1 · outbound

This paper cites Touvron, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Touvron, L

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.868628Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.868628Z digest=sha256:f3a5151544f0664ec7dfa8cd051fe84d6361c383d21373106f6e0ef60040e69b

Observation 11adccbd-73df-459a-b8f8-7ffb50aaaf5d · outbound

This paper cites A Field Guide to Federated Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models A Field Guide to Federated Optimization

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.936074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.936074Z digest=sha256:7a33d6f8f59991d02443203a9181efbb8a46ecdee8e526b41fc1e4b8de40bc09

Observation 4b52a0a3-13e7-4cda-8ad3-3c5fbfa43fb7 · outbound

This paper cites Wortsman, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Wortsman, T

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.272497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.003640Z digest=sha256:03a8c18581b344163465c420c90a9946de63932e9ce27c7d7d98f071e6b4f6e3

Observation 9b8a6365-cff8-4b6e-94ef-da7de7d9d3d3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.040628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.104412Z digest=sha256:43820e259c6935063c10df5b2a15c47c9ce447dd27db1f8a97cc5415d51f31f4

Observation cd03e95e-8439-4bc0-a05e-d05eed787a6f · outbound

This paper cites On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.051565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.215335Z digest=sha256:27b81be7d4e17abadef3cbb0639a8fee86c8832ee6758b260aaca6a998df581d

Observation 5b0172b0-644d-41ee-a673-1a941bf38ccd · outbound

This paper cites Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization

Reference 49

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:25.744102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.274554Z digest=sha256:cfe034e97c2b9c74fb0e67164b57fc4ec68094b7bfa1518b8df71c2bb686fd65

Observation 6eef702e-2002-468c-8be1-d59019a01988 · outbound

This paper cites Zellers, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zellers, A

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.884976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.383352Z digest=sha256:f369e1307bae9aca9da06990a373c48f3085c8276e3c1658625c5a319b3faabf

Observation 9baf1577-4e6d-4ae4-ae60-cbfa1c113c7b · outbound

This paper cites Zhang, D.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, D

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.718210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.463744Z digest=sha256:81ddaa9e01f41b47f8236f4753781e915619021f5c9c9793a21fc260b480a6da

Observation d1fc6803-060c-4bd3-b437-6bf27ee7b888 · outbound

This paper cites Zhang, C.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, C

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.462537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.547386Z digest=sha256:479e9b0d5356946a5e5e1884fb8a4cea849bd35f0e23daf4fa44e60682d3532c

Observation 3cfae97b-22f2-47a0-887e-05acd4d4b233 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:28.241838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.644047Z digest=sha256:f9f3e247f72be73e732fb64d7fa81e35eda3729d9c42a6783764d5fe1560d91d

Observation 4130c04a-182c-4b4f-9db3-1f4c5cded0bb · outbound

This paper cites Starting from the recommended baseline learning rate (η0) from Allal et al.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Starting from the recommended baseline learning rate (η0) from Allal et al

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.064042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.769520Z digest=sha256:a8fde3f4f58db8cee050e0e0f91f71151459a9d209754df6c654feeb5355dd34

Observation 2f86a6c2-fac7-40d6-8d20-bcb3e60a948c · outbound

This paper cites We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.910261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.889199Z digest=sha256:65358d7d67180c8d1b2b0e2115e9ae0b474357417bb2c7922d0ac8f62c85f279

Observation a47370d2-6703-46b3-a6ba-9cb97ecfc5dd · outbound

This paper cites 2a by including results on the heterogeneous data dis- tribution described in Section 4.1.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 2a by including results on the heterogeneous data dis- tribution described in Section 4.1

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.665023Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:24.969874Z digest=sha256:f2622cf9951c44d1110c416c8a09536e2fa819235e27d514fabf762e866f8c04

Observation 84a2cd1c-e0d3-4019-bc13-1279e37a1492 · outbound

This paper cites 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.393938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.034417Z digest=sha256:771884c65482325e9046efafdc62d1dc0d8d0517f01312133fca9011ca84f8f2

Observation 072682f0-0c24-4435-8b21-291f702ca700 · outbound

This paper cites 4 by evaluatingDES-LOC-Adam.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by evaluatingDES-LOC-Adam

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.177192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.108096Z digest=sha256:daeccb047fcf6fcd86730121e5e5ea75294c5325aa63d8fcacd839b3efe6456d

Observation adafeeb5-6161-44ab-9cd6-4ed87e2d9bed · outbound

This paper cites 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1).

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1)

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.988547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.240333Z digest=sha256:262c09c576810f23ac412cbc95378333eed07cbee08317684784d19c2cb7fe0c

Observation fdb9cb9d-a4d9-4009-bb60-b631ec4d23a1 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:26.837297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.314478Z digest=sha256:7e0d1f66359dda9c211c5760df2476b2386ed2466afdd28e70320da08cd563ba

Observation c596c3a4-92a7-41c7-ab4b-b3e0fe3fafd1 · outbound

This paper cites 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.688336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.393918Z digest=sha256:afa74eb2b245f3dcc8350f18bd7ef36c75137d8922688b74ac11895048119315

Observation 60c5d486-d6dd-416d-9b5e-8ebfe01f3065 · outbound

This paper cites standard.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models standard

Reference 62

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T13:13:26.537852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T13:13:25.493384Z digest=sha256:7f381c8c803bba72704ef40233ac6a2f82d177a9685463eb027e881a181c3d03

Pith citing papers

Observation 4e410f05-9633-4292-9045-ef6ea71e3455 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

Reference 110

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.169175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:e56157771ad5ac7f9bf058f8722751b4876521bf3784742d9fcab236760bbec6