Pith. sign in

Paper Citation Record · LEDGER

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

As of 8 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 1 inbound Pith citation observation for arXiv:2505.22549.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.22549 v1

Coverage vector

measured 62 of 62 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:13:25.493384Z

measured 63 of 63 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-26T21:25:15.709652Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.167070Z

Reference resolution

62 of 62 outbound references displayed

  • verified exact3
  • verified fuzzy30
  • unresolved28
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d2172a97-5db9-44bd-940e-f6e3a406a789 · outbound

This paper cites SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.016971Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.016971Z digest=sha256:6772abbd539df2b24728b7ef6b985501e6289f9cbadb9c02c29c2927a68e92cd

Observation 1182027c-1689-4156-9684-b6ec03755afb · outbound

This paper cites Arjevani, Y.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Arjevani, Y

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.319228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.076371Z digest=sha256:0d51bd916d9c93d873f6cc5454def94dc0430a4f95375c15eac2fb8c1b1f448f

Observation 06d66d0d-b985-48ff-b2f1-9020cf6ff699 · outbound

This paper cites Balles and P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Balles and P

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.141686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.189804Z digest=sha256:f1c925b69e776c731d6d702723503a3b20d9c8a0b95ba9fc4170be2469695697

Observation c2fceca2-3682-44d7-ac14-742348bfe704 · outbound

This paper cites Ben Allal, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Ben Allal, A

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:37.023451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.345120Z digest=sha256:f092b533b674642e2f207da6f38b2fcba5c873c2e584cd96d344cc4dadf960e3

Observation 1eeb5636-1ece-4a77-b008-610f822a643c · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.818454Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.505095Z digest=sha256:082d1435b864a0bcadfd95ffff5198e8346e91139dad75b8b279e15a3107d07a

Observation f4aabb6e-e55f-47e6-80f0-2ee6a4b6b9ed · outbound

This paper cites Brown, B.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Brown, B

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:36.553211Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.584311Z digest=sha256:7c288e9f69059fa0235fe447e5424ec501703656839629c6e6c9e68f89668bae

Observation 85f54d5b-9c0d-4c0a-915c-3e936ec6cb40 · outbound

This paper cites Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:20.674049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:20.674049Z digest=sha256:724fb8a2ff14a414f8f6fd7d4410740780611d7d3dcedf86f96e170bd7c132a4

Observation 7dcaaa74-a7ad-4b7e-8a40-33a8c294e375 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:36.299354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.819250Z digest=sha256:81412fa96e45bfbdad6e5258fc6d3b8b596e4c670c5f1cfc3a030cda572bacdf

Observation e397315e-a9c3-4ad6-b551-2f29fe8c7e29 · outbound

This paper cites Cheng and M.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Cheng and M

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.995718Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:20.901750Z digest=sha256:2a2490eec53c83183401f8cef710cebd5404fb515ef874e90c490bb3fc58620c

Observation e3cbe639-80a1-4d91-9dfd-0cc96524c175 · outbound

This paper cites Chowdhery, S.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Chowdhery, S

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.728657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.001201Z digest=sha256:0fdb8fe28e37999a950cb8bece229086e2a0e83495ee0e0f2bdce6d0ad5d08a4

Observation 56c4c9b9-d72e-4cab-95bf-0ca6cfe59eab · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.076522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.076522Z digest=sha256:5476250ccfe1801cb0324cc7aa79c031de5003edcae10074d058676ca2eb8f6d

Observation ec5ff9dd-d323-429c-b9ae-5d73bd6acdd0 · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models DiLoCo: Distributed Low-Communication Training of Language Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.194758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.194758Z digest=sha256:cbbeb9e7210d585d6ab4245d1f3039c1be91950424f04b01b711d5cb853b6928

Observation dc2aca47-b452-4bb7-9d1f-c8ec3322efaa · outbound

This paper cites The Llama 3 Herd of Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Llama 3 Herd of Models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.241231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.241231Z digest=sha256:6864faaa16087dcb88e65f19231b6c3fb28186dde44e47ef7ecaf11758de1a99

Observation fa042afe-7b73-4a30-ba41-43604c9a1a77 · outbound

This paper cites Hägele, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Hägele, E

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.471669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.347722Z digest=sha256:a787a3c86aa2076ff21aad3f1245514fef1730487a41577db2f546a33e27004f

Observation d3ec821f-913d-4e5c-8e05-df2105ea2c9f · outbound

This paper cites Training Compute-Optimal Large Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Training Compute-Optimal Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.432532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.432532Z digest=sha256:77590ada57b9f80b1559ea9a8a7d64cc7bff3efe530019ae3ca4a3c5f450e229

Observation 02244ee3-5359-4aac-a49f-4620c7a164eb · outbound

This paper cites Iacob, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Iacob, L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.289962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.502087Z digest=sha256:c3b559f473593095f66e63bd5a3d14a68139a4cc02071c042bc99310be49ada8

Observation b70640e3-b4a8-44a8-bcc5-5658b1bedac2 · outbound

This paper cites Kairouz, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kairouz, H

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:35.138200Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.584559Z digest=sha256:10af212ee423ac192b67f6a4a2f6c296d544eb64508662ee7e57f52a88574e66

Observation acbbcfa6-4117-4adf-9623-1b9f978c102d · outbound

This paper cites Scaling Laws for Neural Language Models.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Scaling Laws for Neural Language Models

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:21.616016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:21.616016Z digest=sha256:6eb9bcb26de6f2ff401725d72bd89d2d7eb81fa4257e194448b30e656382d15b

Observation 376832bb-4af6-4c5e-8318-9b5c83f6dc18 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.958988Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.719820Z digest=sha256:d957815954af771cf579b20caaf923d9e0562e15a663d526d8aaea2c068770b6

Observation e6b5315a-c6d4-4ce1-a797-9a502e0854e0 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.694578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.798715Z digest=sha256:e4c4d1c61ab6ad071f1495decc9dd06392813a12feb800533b192ac6664c9794

Observation 02b638ad-33a7-4afb-9204-5936a9e00396 · outbound

This paper cites Kunstner, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Kunstner, J

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:34.397500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.885888Z digest=sha256:5dfbd8d7cf7d105b6c9d9b2473f4be08e3dc10d6c1b9bea30afa8c77cc6c4fcf

Observation 9ac251c1-d723-4cb9-8bbe-b6c7b1434dd3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:34.195239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:21.972625Z digest=sha256:9e9abf7ae54356eee97378241b8e61e9b6e5cc581a5fcc8442e607f544d7adaf

Observation 553ec41f-12ed-4230-8365-2b04178fd61e · outbound

This paper cites On Distributed Adaptive Optimization with Gradient Compression.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On Distributed Adaptive Optimization with Gradient Compression

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.318258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.047003Z digest=sha256:a57488e4cbcbe983f0c1a74bbe356492db911da24e2e413e689b910a0cff6b3b

Observation 9070db0e-b562-4e6e-95cd-a603cefe4134 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Asynchronous Local-SGD Training for Language Modeling

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.137707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.137707Z digest=sha256:c0352c447de0bfa1d9c70b729cc1fd5b7af2a35b07b2f7f43b5d4e91f5681b47

Observation 5b730c6a-0274-4a67-89cc-ec0346934cfd · outbound

This paper cites An Improved Analysis of Stochastic Gradient Descent with Momentum.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models An Improved Analysis of Stochastic Gradient Descent with Momentum

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:22.271416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:22.271416Z digest=sha256:62443dbd10a71e07ddf939db80b19a282f9fdaf9ce1d4d7890764b7af1b3827d

Observation 1ba3bc43-cbaf-4110-8490-f59d8522d991 · outbound

This paper cites McMahan, E.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models McMahan, E

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.934171Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.356385Z digest=sha256:0eecdaf736f6030d12ef49baf2eb3c25d7edfbe823da808e2b9cae1478ead6fa

Observation 0fdc09ab-3052-41d3-b99f-ce62e1a5d987 · outbound

This paper cites Pagliardini, P.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pagliardini, P

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.696273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.421704Z digest=sha256:b3f0359a6cb87992abd3658d0f68b0066c740afa179b604ecc89be1f332c327f

Observation 56b6d560-0ace-49c7-a97d-8e2ebdf0eb02 · outbound

This paper cites Pascanu, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Pascanu, T

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.513449Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.510089Z digest=sha256:cbf69a12637dc45368a75260ed440cd2dac7e7c1594d3a13e39174e5d97230ca

Observation c38cac2e-3901-4c06-9d7c-510c33131ad8 · outbound

This paper cites Penedo, H.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Penedo, H

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.317576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.599548Z digest=sha256:726abd49c9406f38f2cd273a8832a84c9d7d2c2bd0d840660a1c7194c4020b1d

Observation 31724ded-a253-4b0a-82e1-f6fc126e04cd · outbound

This paper cites Rajbhandari, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Rajbhandari, J

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:33.137571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.735762Z digest=sha256:a22a4de8535a80603764d80e93791f16a4b1f58d01520975d9628d8c9ba790b7

Observation de86753f-45cd-41d4-a142-a31a4eb5fa0f · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:31.849223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.838407Z digest=sha256:779e123fbca8a54c581642f4b5c34c42794d8fdf204bf1966bdb9f812d2fb0c3

Observation dd1bc151-ab41-426d-81d6-81c6d1a113fa · outbound

This paper cites Romero, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Romero, J

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:31.172018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:22.915688Z digest=sha256:543c7c6c1a85b62b624eb685e2cf037f8ce9aa5d3d51becc861a2863fe4321fe

Observation 9670be89-79d8-4266-9918-a33f2a890c84 · outbound

This paper cites The Future of Large Language Model Pre-training is Federated.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models The Future of Large Language Model Pre-training is Federated

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.000067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.000067Z digest=sha256:d98f1581c0550bff4eff0f88de70d5981579d0a33102435cd3fb552423fc8393

Observation f35efcc2-b8a9-4ef4-9009-2212069bb9b6 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.926712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.091906Z digest=sha256:0f50f34e63c8f3df3c711185744c47209698940b0e14389621e7f8c352e35fca

Observation 7dc45ccc-7726-4c18-be64-1d6f46d010bd · outbound

This paper cites Sardana, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sardana, J

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:30.730065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.138477Z digest=sha256:66471654ffc7d2c3b35dd46c2ef9594b633b2b98594f8224ebd934c61467c5f7

Observation 1633bc0d-b3c6-455e-9726-e95d9252e04f · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.210344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.210344Z digest=sha256:f5ac530d3d068e63f884a9150f01c21c29eaa41715e3751853b5811996646a12

Observation 0edd5e36-f54c-4ea8-9d15-ad58925c83a3 · outbound

This paper cites Horovod: fast and easy distributed deep learning in TensorFlow.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Horovod: fast and easy distributed deep learning in TensorFlow

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.272737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.272737Z digest=sha256:caa3102e5918e158395468b9f28970f229537b577d83b35c784c14aba4d2ed48

Observation dcc13d16-0859-42b1-878a-2b6d86398f7b · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.388282Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.388282Z digest=sha256:75e6fc3bc3816714e7c364081b941d9176313db37aa3d694247f8ee7e49ad525

Observation fc3c1ede-4716-4da3-a7af-1cd3deb103ae · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.297874Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.472300Z digest=sha256:416a02b7382258095805c14bcb4e9194ddcba8c7d545cccbb7e2f88176f82582

Observation 1c8d626d-472d-4307-b3eb-49323cc5fe02 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:30.060945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.544757Z digest=sha256:398223adacd6382205edac8182d81ef6acb766c9f55bd3ccdbdabbb2289157af

Observation fae14c7f-d9e3-4107-9ccf-58096e679471 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.939892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.591593Z digest=sha256:2d04a37d80b6d1eb208ab1ab750f1c6346d39a6bace77487ef6b96dcf53cddb2

Observation 3e0828f0-b59b-4972-9592-a2c521a7d14a · outbound

This paper cites Sutskever, J.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Sutskever, J

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.727166Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.721571Z digest=sha256:e80e8d10f5e46e6d358ca4a39fed8888dbb675cb9098890d0f22b57f3ffd9a7e

Observation 284a3f56-ed13-49ee-b690-91e29127956b · outbound

This paper cites Taniguchi, K.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Taniguchi, K

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.456801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:23.778017Z digest=sha256:95dde2e5cf25d1859263c1fd47cf797f2780b588f04664a7e4ce16443b2e675d

Observation 1e361132-4e09-46ec-b25e-2197c8203fa1 · outbound

This paper cites Touvron, L.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Touvron, L

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.868628Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.868628Z digest=sha256:f3a5151544f0664ec7dfa8cd051fe84d6361c383d21373106f6e0ef60040e69b

Observation 11adccbd-73df-459a-b8f8-7ffb50aaaf5d · outbound

This paper cites A Field Guide to Federated Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models A Field Guide to Federated Optimization

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T13:13:23.936074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:13:23.936074Z digest=sha256:7a33d6f8f59991d02443203a9181efbb8a46ecdee8e526b41fc1e4b8de40bc09

Observation 4b52a0a3-13e7-4cda-8ad3-3c5fbfa43fb7 · outbound

This paper cites Wortsman, T.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Wortsman, T

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:29.272497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.003640Z digest=sha256:a9f38119f85f27126983dfd20e1b079afc05c48db8fe229e2925d0fc3e2d4dc4

Observation 9b8a6365-cff8-4b6e-94ef-da7de7d9d3d3 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:29.040628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.104412Z digest=sha256:826ba452d604fcc623ac5d87977b1387df7b7df1db9f4eb18656f77091f9486f

Observation cd03e95e-8439-4bc0-a05e-d05eed787a6f · outbound

This paper cites On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization

Reference 48

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:26.051565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.215335Z digest=sha256:f408c36c1ae830eb5284d0c1aacda2a774278ccc14e59f806024e672418624f6

Observation 5b0172b0-644d-41ee-a673-1a941bf38ccd · outbound

This paper cites Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization

Reference 49

Resolution
verified exact
local_arxiv, observed 2026-08-07T13:13:25.744102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.274554Z digest=sha256:1145b0a0d66f690d1e498e20410ab95a52c6991871315c04f0c9d5943403dac5

Observation 6eef702e-2002-468c-8be1-d59019a01988 · outbound

This paper cites Zellers, A.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zellers, A

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.884976Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.383352Z digest=sha256:6327feb26661a651030b8c983fbda3ae7f5212f313c84c6a69c6202bb9ad168e

Observation 9baf1577-4e6d-4ae4-ae60-cbfa1c113c7b · outbound

This paper cites Zhang, D.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, D

Reference 51

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.718210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.463744Z digest=sha256:162612b5796b34d373e39e841521bc8efa017b5f6e3897d27040f58ff4774fe3

Observation d1fc6803-060c-4bd3-b437-6bf27ee7b888 · outbound

This paper cites Zhang, C.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Zhang, C

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.462537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.547386Z digest=sha256:ff4a47d5d365a1660e28de718d5b14c3c4acdf4648d31f2dab16c7fde6d9a5e5

Observation 3cfae97b-22f2-47a0-887e-05acd4d4b233 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:28.241838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.644047Z digest=sha256:7010ee73d97f899b1765fa88135c206a71e35c27810d9a147999f33f33d76e0d

Observation 4130c04a-182c-4b4f-9db3-1f4c5cded0bb · outbound

This paper cites Starting from the recommended baseline learning rate (η0) from Allal et al.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Starting from the recommended baseline learning rate (η0) from Allal et al

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:28.064042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.769520Z digest=sha256:bcb823fcaac778e737b8c763615dd4bb727cd319b182787df58536aa625a41a8

Observation 2f86a6c2-fac7-40d6-8d20-bcb3e60a948c · outbound

This paper cites We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models We then repeat this procedure for Local Adam , using η∗ DDP as the new baseline

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.910261Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.889199Z digest=sha256:691f5927070688b06768929dc0f3608ca32b063b5575568f1bb2c11d5a5569b5

Observation a47370d2-6703-46b3-a6ba-9cb97ecfc5dd · outbound

This paper cites 2a by including results on the heterogeneous data dis- tribution described in Section 4.1.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 2a by including results on the heterogeneous data dis- tribution described in Section 4.1

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.665023Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:24.969874Z digest=sha256:82c04e974e2f211d15d545cd1093509138171ee34186b3c059b7bc93f8cb1557

Observation 84a2cd1c-e0d3-4019-bc13-1279e37a1492 · outbound

This paper cites 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by showing the separate impact of varying synchro- nization frequencies for parameters and the second momentum when the base frequency is Kb = 16

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.393938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.034417Z digest=sha256:fe3ce1170fdf53fd9bf051e37000459a13e5507d4c425dcb4d74d63b245a3447

Observation 072682f0-0c24-4435-8b21-291f702ca700 · outbound

This paper cites 4 by evaluatingDES-LOC-Adam.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 4 by evaluatingDES-LOC-Adam

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:27.177192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.108096Z digest=sha256:a2e603701cc6a2a5e469663dd00401ebe12da64878b7fd127e7512583a41932a

Observation adafeeb5-6161-44ab-9cd6-4ed87e2d9bed · outbound

This paper cites 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1).

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 by showing DES-LOC-ADOPT’s perplexity against baseline methods on heterogeneous data (as defined in Section 4.1)

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.988547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.240333Z digest=sha256:c226282cf629c4e8be5090a31c708209a9612f80fb53ebbea51db8bb7959147e

Observation fdb9cb9d-a4d9-4009-bb60-b631ec4d23a1 · outbound

This paper cites an unresolved cited work.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models Unresolved cited work

Reference 60

Resolution
unresolved
raw_fallback, observed 2026-08-07T13:13:26.837297Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.314478Z digest=sha256:ce127bfd31ff78cb22177fc3e69b96d8fb4cf296014f174cbabaf58226b7a7e6

Observation c596c3a4-92a7-41c7-ab4b-b3e0fe3fafd1 · outbound

This paper cites 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models 5 for DES-LOC-Adam, demon- strating that DES-LOC achieves similar communication reductions and performance when using Adam instead of ADOPT

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T13:13:26.688336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.393918Z digest=sha256:de90fe898c5a49cf895891c543ced77435c7ac13485164daf60efe07cb11b250

Observation 60c5d486-d6dd-416d-9b5e-8ebfe01f3065 · outbound

This paper cites standard.

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models standard

Reference 62

Resolution
malformed identifier
raw_fallback, observed 2026-08-07T13:13:26.537852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T13:13:25.493384Z digest=sha256:3b4ca6c6592ff1efd80d35458bb7c0cded38586be3870283bf77d99bf91995b6

Pith citing papers

Observation 4e410f05-9633-4292-9045-ef6ea71e3455 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models

Reference 110

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.169175Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:9ec9c194f77737fc149f85799855b9eb83c72e079aa7dc52a1d8642d70483212