Pith. sign in

Paper Citation Record · LEDGER

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

As of 19 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 1 inbound Pith citation observation for arXiv:2505.22549.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.22549 v1

Coverage vector

measured 62 of 62 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z

measured 63 of 63 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T21:25:15.709652Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.167070Z

Reference resolution

62 of 62 outbound references displayed

  • verified exact3
  • verified fuzzy30
  • unresolved28
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d2172a97-5db9-44bd-940e-f6e3a406a789 · outbound

This paper cites SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.016971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.016971Z digest=sha256:6aa5ee29c5d68709126bbda11f12f0a4cad8baabeb4a1ada02f296a4dd58b65b

Observation 1182027c-1689-4156-9684-b6ec03755afb · outbound

This paper cites Arjevani, Y.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Arjevani, Y

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.319228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.076371Z digest=sha256:ef3d3306d3a495a64daaa08e15041e0ffd86a8c523dbfec3a84613742374b684

Observation 06d66d0d-b985-48ff-b2f1-9020cf6ff699 · outbound

This paper cites Balles and P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Balles and P

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.141686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.189804Z digest=sha256:60e8300a43abfb2ee8cf946417d6f542d939e60d838f4a7206b12f5122707af7

Observation c2fceca2-3682-44d7-ac14-742348bfe704 · outbound

This paper cites Ben Allal, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Ben Allal, A

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.023451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.345120Z digest=sha256:89520862381bd8282bd4bd1fd1e4bef539d26884e2370312e10e4efefbaffda1

Observation 1eeb5636-1ece-4a77-b008-610f822a643c · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.818454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.505095Z digest=sha256:a93076fb11cc7fcdae77aac5b5b5ef390cd4f95c688195d4179d190990cdcdd4

Observation f4aabb6e-e55f-47e6-80f0-2ee6a4b6b9ed · outbound

This paper cites Brown, B.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Brown, B

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:36.553211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.584311Z digest=sha256:f0ad1b31cfefd88eae5335c36eea1644920fd88f84c884ff544a6e074d533bf5

Observation 85f54d5b-9c0d-4c0a-915c-3e936ec6cb40 · outbound

This paper cites Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.674049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.674049Z digest=sha256:8e2a0d92565122827500e9b232b8961d44f48b0e52b85572ebd5244362d9695e

Observation 7dcaaa74-a7ad-4b7e-8a40-33a8c294e375 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.299354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.819250Z digest=sha256:c72a35c3a90e9962c6661d8925c1f1dca3c530dc6d458acebce94458ffa0a160

Observation e397315e-a9c3-4ad6-b551-2f29fe8c7e29 · outbound

This paper cites Cheng and M.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Cheng and M

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.995718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:20.901750Z digest=sha256:fbf168b19775bcae3a669a69498009ed7f395c2687ed36f4e316aca7e137bbf7

Observation e3cbe639-80a1-4d91-9dfd-0cc96524c175 · outbound

This paper cites Chowdhery, S.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Chowdhery, S

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.728657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.001201Z digest=sha256:afa52b17804abdf4dee310011dac21b026c0f1c36f52d497eb366b03a99ff4f3

Observation 56c4c9b9-d72e-4cab-95bf-0ca6cfe59eab · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.076522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.076522Z digest=sha256:8e43aa77490d237af6f19d4b8f1c898c2eabb392217fcc0942789570d422837a

Observation ec5ff9dd-d323-429c-b9ae-5d73bd6acdd0 · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models DiLoCo: Distributed Low-Communication Training of Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.194758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.194758Z digest=sha256:4499401d67b906003dafc419b69679ecb8c8493068c5b0f74651a27accf2c4bd

Observation dc2aca47-b452-4bb7-9d1f-c8ec3322efaa · outbound

This paper cites The Llama 3 Herd of Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Llama 3 Herd of Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.241231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.241231Z digest=sha256:8366e861ee266d8185f09ac7bb532b521861e7a8a4265b67190c280e63bae42f

Observation fa042afe-7b73-4a30-ba41-43604c9a1a77 · outbound

This paper cites Hägele, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Hägele, E

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.471669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.347722Z digest=sha256:704dfd5783b9b04984cdfd992d67b519801ecd7d7082cd721a23be07dfffdb93

Observation d3ec821f-913d-4e5c-8e05-df2105ea2c9f · outbound

This paper cites Training Compute-Optimal Large Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Training Compute-Optimal Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.432532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.432532Z digest=sha256:b36e5c42c4d2c597757f9f9fc881cf86965a5c6fbc488a50e2aa8d449290f8ee

Observation 02244ee3-5359-4aac-a49f-4620c7a164eb · outbound

This paper cites Iacob, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Iacob, L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.289962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.502087Z digest=sha256:7578d119b99bc2865a073d78e0a07059c1dae564931cee54f8ffeb43168e0cdb

Observation b70640e3-b4a8-44a8-bcc5-5658b1bedac2 · outbound

This paper cites Kairouz, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kairouz, H

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.138200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.584559Z digest=sha256:a332532020f315e3bb6a1fc56880f7db82cb17cbfcc10bdc7fb1adb41cb622c2

Observation acbbcfa6-4117-4adf-9623-1b9f978c102d · outbound

This paper cites Scaling Laws for Neural Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Scaling Laws for Neural Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.616016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.616016Z digest=sha256:f7589061e4ff2698fd7e59488118474d893138dd46621923ef14b62e4837738e

Observation 376832bb-4af6-4c5e-8318-9b5c83f6dc18 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.958988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.719820Z digest=sha256:115d2bb050155572457c2c2bdf87731e896460ee29df5bf2b1219864d3708d92

Observation e6b5315a-c6d4-4ce1-a797-9a502e0854e0 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.694578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.798715Z digest=sha256:e032f54359b66839a210e2b0e119fca19c5ab61dd4a399576c14a8949ceb7a65

Observation 02b638ad-33a7-4afb-9204-5936a9e00396 · outbound

This paper cites Kunstner, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kunstner, J

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:34.397500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.885888Z digest=sha256:5b30381740ecc1296e14600062754083dce2f97cca8915f2149d4666b8f9812b

Observation 9ac251c1-d723-4cb9-8bbe-b6c7b1434dd3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.195239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:21.972625Z digest=sha256:2f5eadbbae02f473741e1e8767ab7442d324fd1f1b76768b7d3e1cfbcd6e24ce

Observation 553ec41f-12ed-4230-8365-2b04178fd61e · outbound

This paper cites On Distributed Adaptive Optimization with Gradient Compression.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On Distributed Adaptive Optimization with Gradient Compression

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.318258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.047003Z digest=sha256:6132a59c77e997076e361214d62a07e4f418fbd4c13203acea339a3487f75812

Observation 9070db0e-b562-4e6e-95cd-a603cefe4134 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Asynchronous Local-SGD Training for Language Modeling

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.137707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.137707Z digest=sha256:1256f15a64e1f1c21286bc4cc6cc0e4e569d51e0235867536c349a9c972536b1

Observation 5b730c6a-0274-4a67-89cc-ec0346934cfd · outbound

This paper cites An Improved Analysis of Stochastic Gradient Descent with Momentum.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models An Improved Analysis of Stochastic Gradient Descent with Momentum

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.271416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.271416Z digest=sha256:96b8c8dfcc1ead4af1be8c26df6bd0523fba8554ccb98c184abcd8fd9ce8aa0b

Observation 1ba3bc43-cbaf-4110-8490-f59d8522d991 · outbound

This paper cites McMahan, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models McMahan, E

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.934171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.356385Z digest=sha256:7ac31e5521d31fe6afd66836d521f884d420424c28f22afa9c617a08e98b7ec0

Observation 0fdc09ab-3052-41d3-b99f-ce62e1a5d987 · outbound

This paper cites Pagliardini, P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pagliardini, P

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.696273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.421704Z digest=sha256:5f65870171e817ba71e1bb29a95185a41d9ed00a42eed551b55b6309e082807f

Observation 56b6d560-0ace-49c7-a97d-8e2ebdf0eb02 · outbound

This paper cites Pascanu, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pascanu, T

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.513449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.510089Z digest=sha256:5be25437bdc419efe410df8beaf89a710947b4ee7ea177b8ac3d160c7b5c12a5

Observation c38cac2e-3901-4c06-9d7c-510c33131ad8 · outbound

This paper cites Penedo, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Penedo, H

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.317576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.599548Z digest=sha256:89bb0fe9bcd3bfeac2d1d0474c62fb2a5157763c7e62e87daf5cc2989e9f49f2

Observation 31724ded-a253-4b0a-82e1-f6fc126e04cd · outbound

This paper cites Rajbhandari, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Rajbhandari, J

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.137571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.735762Z digest=sha256:d189c83960a1f61177c3a02796a35d06d457f99e6576815b1a527b99575268dc

Observation de86753f-45cd-41d4-a142-a31a4eb5fa0f · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:31.849223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.838407Z digest=sha256:45aa9ce149e012ef6bf237fe228862497b3eab3d0ab57c009f775e67a184a18b

Observation dd1bc151-ab41-426d-81d6-81c6d1a113fa · outbound

This paper cites Romero, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Romero, J

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:31.172018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:22.915688Z digest=sha256:1801cbd6f2411bccc20cdb9a0ca8b34f9c01dc67d347c1bbd161e31e3b4fe2d9

Observation 9670be89-79d8-4266-9918-a33f2a890c84 · outbound

This paper cites The Future of Large Language Model Pre-training is Federated.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Future of Large Language Model Pre-training is Federated

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.000067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.000067Z digest=sha256:979735d144870a08f0dc34316b8c8f754001691dc0748b81691c997508193a41

Observation f35efcc2-b8a9-4ef4-9009-2212069bb9b6 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.926712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.091906Z digest=sha256:2788e13bd36afbab6b87e9ff6a8c562db806c81637e343cf596cd9894d16c325

Observation 7dc45ccc-7726-4c18-be64-1d6f46d010bd · outbound

This paper cites Sardana, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sardana, J

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:30.730065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.138477Z digest=sha256:2ef100746d067091b5f1ff2462ee21e8defa08a189f6056602a41f3f371b5aa0

Observation 1633bc0d-b3c6-455e-9726-e95d9252e04f · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.210344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.210344Z digest=sha256:b9f3592ac4940d75130352ff1af90b8209dbc96045317258463bc1bafd3bbf00

Observation 0edd5e36-f54c-4ea8-9d15-ad58925c83a3 · outbound

This paper cites Horovod: fast and easy distributed deep learning in TensorFlow.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Horovod: fast and easy distributed deep learning in TensorFlow

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.272737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.272737Z digest=sha256:e28fc95da4216a42133c3db4e407d8d5205c1223f8565c26b931b1520a75e7fa

Observation dcc13d16-0859-42b1-878a-2b6d86398f7b · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.388282Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.388282Z digest=sha256:17b7a3164b0f74eea787ca98af463cb211d4b17cf73d6d011f0c8dec105a08ad

Observation fc3c1ede-4716-4da3-a7af-1cd3deb103ae · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.297874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.472300Z digest=sha256:5f2f8bff8b364edd82cee687486226f851252b37ce450adb5a969720eb072952

Observation 1c8d626d-472d-4307-b3eb-49323cc5fe02 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.060945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.544757Z digest=sha256:40880c0f2f6e23aada945dceef9504da77aeabf1295ab89d5f2587e2eedd1c77

Observation fae14c7f-d9e3-4107-9ccf-58096e679471 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.939892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.591593Z digest=sha256:b683bb06636a4889ca610c61a7a1b67cb3990642b40df5a2f607a17b8b58d19d

Observation 3e0828f0-b59b-4972-9592-a2c521a7d14a · outbound

This paper cites Sutskever, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sutskever, J

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.727166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.721571Z digest=sha256:d3a10e0dd1bcb2eea03e2fbd22bbe65bc55c6513f2cefd9b45cd735f4bee5c33

Observation 284a3f56-ed13-49ee-b690-91e29127956b · outbound

This paper cites Taniguchi, K.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Taniguchi, K

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.456801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:23.778017Z digest=sha256:a05c3afb1320ab41622b8c162ec6c4e429abdf7b6f5d5afe433af55084e55c63

Observation 1e361132-4e09-46ec-b25e-2197c8203fa1 · outbound

This paper cites Touvron, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Touvron, L

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.868628Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.868628Z digest=sha256:74e3379da50867cc755b7d5b0b5e23a7d12c4ca7734c7a99f4daef35a160c1d8

Observation 11adccbd-73df-459a-b8f8-7ffb50aaaf5d · outbound

This paper cites A Field Guide to Federated Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models A Field Guide to Federated Optimization

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.936074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.936074Z digest=sha256:5ab27e68645e7360aed7c9885fbc1864df0ea9a5bd900953c838538f6e9aa05f

Observation 4b52a0a3-13e7-4cda-8ad3-3c5fbfa43fb7 · outbound

This paper cites Wortsman, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Wortsman, T

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.272497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.003640Z digest=sha256:43587510cac42b8ad2602f7a36a3d25221c277e2863dc6a27010d3eb867c9a61

Observation 9b8a6365-cff8-4b6e-94ef-da7de7d9d3d3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.040628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.104412Z digest=sha256:5999310a9a462967905dede7d0fe86372d1c450c72427099a3f5d4ef5faaa918

Observation cd03e95e-8439-4bc0-a05e-d05eed787a6f · outbound

This paper cites On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.051565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.215335Z digest=sha256:861d3fa0f231281bb3eccdc55b2bdafdb6bbedeb54892fb9999d223467d85c8a

Observation 5b0172b0-644d-41ee-a673-1a941bf38ccd · outbound

This paper cites Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization

Reference 49

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:25.744102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.274554Z digest=sha256:d95e9737a987f1d09f72889847757b373e97f6c16790940270f09bdf913c7317

Observation 6eef702e-2002-468c-8be1-d59019a01988 · outbound

This paper cites Zellers, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zellers, A

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.884976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.383352Z digest=sha256:c2ec453358653e39d967b1bc1af7eb29aee203b0d9fd07646c038abc793a3860

Observation 9baf1577-4e6d-4ae4-ae60-cbfa1c113c7b · outbound

This paper cites Zhang, D.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, D

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.718210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.463744Z digest=sha256:d0ebf112b3c33975c56224b395337e92f142819167d47a001ef50f79129deea6

Observation d1fc6803-060c-4bd3-b437-6bf27ee7b888 · outbound

This paper cites Zhang, C.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, C

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.462537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.547386Z digest=sha256:2a8aac90f383c847c7d90d2caa765fb87877289a6057906209939c0cd0b3f178

Observation 3cfae97b-22f2-47a0-887e-05acd4d4b233 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:28.241838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.644047Z digest=sha256:cd47a630cc4099272840b54af4c9394c0d99e3b95435c1d15b841a69fc787ba7

Observation 4130c04a-182c-4b4f-9db3-1f4c5cded0bb · outbound

This paper cites Starting from the recommended baseline learning rate (η0) from Allal et al.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Starting from the recommended baseline learning rate (η0) from Allal et al

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.064042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.769520Z digest=sha256:bbf06905e4f2323f7132ff9b48b44d1ff1c883133ad23caf82d54f91e2fcc2b9

Observation 2f86a6c2-fac7-40d6-8d20-bcb3e60a948c · outbound

This paper cites We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.910261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.889199Z digest=sha256:31f2bba0c974cdad37eff35a5995ae7380300601e40456000a4f0959f4ad3327

Observation a47370d2-6703-46b3-a6ba-9cb97ecfc5dd · outbound

This paper cites 2a by including results on the heterogeneous data dis- tribution described in Section 4.1.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 2a by including results on the heterogeneous data dis- tribution described in Section 4.1

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.665023Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:24.969874Z digest=sha256:9b3dd7006ec7d0334dd44a2b0f0f8048debadde27ac277bd270d05c3d018efbb

Observation 84a2cd1c-e0d3-4019-bc13-1279e37a1492 · outbound

This paper cites 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.393938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.034417Z digest=sha256:1066872ba8c47e9d89dbacb6ce637b932b9acc93d84648b5dc301ec2e06c7a79

Observation 072682f0-0c24-4435-8b21-291f702ca700 · outbound

This paper cites 4 by evaluatingDES-LOC-Adam.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by evaluatingDES-LOC-Adam

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.177192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.108096Z digest=sha256:8849cb36aeb92388cf3498c42b08ced3499292fb3ff138979641e68076b0719d

Observation adafeeb5-6161-44ab-9cd6-4ed87e2d9bed · outbound

This paper cites 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1).

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1)

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.988547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.240333Z digest=sha256:ee0ae3ccdec7421864bc2278bf30c9e7a06358d4fa96547b19e444f28c584f9e

Observation fdb9cb9d-a4d9-4009-bb60-b631ec4d23a1 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:26.837297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.314478Z digest=sha256:75289ab6d1426d2ba9b45465e7aa2e305b2174a20001319660e4b02f82c94fbb

Observation c596c3a4-92a7-41c7-ab4b-b3e0fe3fafd1 · outbound

This paper cites 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.688336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.393918Z digest=sha256:fcc97fdb0a0b6d6097618911c61791b76a807d9ed9962baa856ce563bd57ff59

Observation 60c5d486-d6dd-416d-9b5e-8ebfe01f3065 · outbound

This paper cites standard.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models standard

Reference 62

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T13:13:26.537852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-07T13:13:25.493384Z digest=sha256:52914079960b8a130c3cdddab1c422a20941cd183cc205cb7d4f33f9964e1183

Pith citing papers

Observation 4e410f05-9633-4292-9045-ef6ea71e3455 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

Reference 110

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.169175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:0618061989891a662444df503784de1909a1cb73fa3b9ff4e51148ad71007136