Pith. sign in

Paper Citation Record · LEDGER

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training

As of 8 August 2026, this Paper Citation Record lists 61 of 61 outbound references and 0 inbound Pith citation observations for arXiv:2506.04531.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.04531 v1

Coverage vector

measured 61 of 61 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:46:06.685339Z

measured 61 of 61 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

61 of 61 outbound references displayed

  • verified exact1
  • verified fuzzy26
  • unresolved33
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2ac87bf3-fe11-4f5d-8145-440dab3a0dab · outbound

This paper cites write newline.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.420751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.420751Z digest=sha256:5d9de58b294f3cb319756dde47df5e629d241543ca58ec520767426d0d99ebfd

Observation f8f47d13-e59b-45e4-afae-347526e25eb3 · outbound

This paper cites GPT-4 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training GPT-4 Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.426612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.426612Z digest=sha256:e0f64d68f46766e10f0293410d576e99de547baad464dbd93513ce2304b639d5

Observation 00f16575-a363-4033-aff5-1b339f2a1de0 · outbound

This paper cites On the choice of learning rate for local sgd.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the choice of learning rate for local sgd

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.560463Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.432013Z digest=sha256:9542bb920bb1c05e41da4e3f9ad0a9b1033e6e60f6407263362ce77a018bbcb2

Observation 26ecb27f-ed11-4482-816d-2a24f0bbebf8 · outbound

This paper cites G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.436385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.436385Z digest=sha256:de9e9239d9d537df9510088bf7b66bb7a752731685f974980c70ab0b987307bb

Observation ec89d5cc-1f69-444d-ab7e-2d9f9a34faf3 · outbound

This paper cites L., Gao, J., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Gao, J., and Choi, Y

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.441028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.441028Z digest=sha256:e6dba655c4be5ba34a9885e4a1bc74ba8fcf947975ccff41da17b78f279d853a

Observation 68dc5e3c-4d4b-48ce-9f99-9ee51f8cd146 · outbound

This paper cites LEAF: A Benchmark for Federated Settings.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training LEAF: A Benchmark for Federated Settings

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.445477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.445477Z digest=sha256:d0fdc8d60de629a9d45da8893eb3ed4200a4cbe63bb7e19d797c40c2b5bf6201

Observation 90e05d00-5118-4e00-914e-ad30f66d0988 · outbound

This paper cites Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.529418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.450151Z digest=sha256:c66e91ff0d83f483bb872c37bdbce2cc21763c2c262f6783517dff023429afdd

Observation d9442a6c-000d-48d4-b524-fa4aa748ada1 · outbound

This paper cites Asynchronous online federated learning for edge devices with non-iid data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous online federated learning for edge devices with non-iid data

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.515918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.454938Z digest=sha256:7de545284fbbe9fcbbed27073f30dc40033a76b632051afc81ec462be9d75e25

Observation e39444a7-3c0f-43aa-ac33-9e6a5203e745 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.459202Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.459202Z digest=sha256:da964a96a6b228ebcd640f531a4215bf8b3929b796dfb7b4d519ad6e46168a0a

Observation dad22139-1e59-466c-b8e4-2e8b4ae64195 · outbound

This paper cites Large scale distributed deep networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Large scale distributed deep networks

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.502116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.463751Z digest=sha256:dc4d437d4e318661ac49250f7d453600b2d9184ddda3f7d39aff8a07e6044dce

Observation 416f7470-76d8-4077-8710-3ab49683b68f · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training DiLoCo: Distributed Low-Communication Training of Language Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.468296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.468296Z digest=sha256:3e049c2f116b90227e058b47e2601365fa6806022cd01011bd40ef39d6c12246

Observation b3e578e4-b346-4654-964f-47b0319965b9 · outbound

This paper cites The Llama 3 Herd of Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.472885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.472885Z digest=sha256:955d1a56134616f10c2ddcce0fc2afa02f0d0623bf06f937397947ef6bcd65ae

Observation 2ecc8cc8-b082-43c9-858f-98285f36c311 · outbound

This paper cites N., et al.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training N., et al

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.477265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.477265Z digest=sha256:5277bd6c508a6009b861034f7b1c568f440e3eb557dbc4f4fb1db2128b21d03d

Observation 1926c09d-f5c9-4036-86f2-f3f270ee961d · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.481712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.481712Z digest=sha256:39633a156538060b5dc8e855630d825d0039fe1fdf1ba5dce26617fedb8dcd80

Observation 2d5fd34e-e590-48dd-950d-11b5d29c8612 · outbound

This paper cites M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.488168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.486456Z digest=sha256:fc7d84e521ce4365ee9847f81ff1d54f8b5686c552259e19e9ff12109ef2c216

Observation e6995cb0-cce3-45e5-98c2-1169e9dbcbe0 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Measuring Massive Multitask Language Understanding

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.490714Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.490714Z digest=sha256:bcdb45cd671e490e45434e9fcb8ef395b3c41c974855182828f97fc5e396b871

Observation 3eb051e4-c1d3-4861-8b23-c97c2cf39f00 · outbound

This paper cites OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.495371Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.495371Z digest=sha256:a7e70f250695e7e469cd1ed64de7da4d53fe4d62d3b2a8cb6f889613ea332987

Observation 43874f70-0f92-41e3-b5b0-df147ae4cf6e · outbound

This paper cites MegaScale : Scaling large language model training to more than 10,000 gpus.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training MegaScale : Scaling large language model training to more than 10,000 gpus

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.474677Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.500093Z digest=sha256:9c97af37db77843541f3abe8182cd611464ad732a758816c35eeefbdd6c59a7a

Observation 1a84a432-08b5-4fb5-be17-de251fa0e80f · outbound

This paper cites Tighter theory for local sgd on identical and heterogeneous data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Tighter theory for local sgd on identical and heterogeneous data

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.459720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.505985Z digest=sha256:25ae4b306d9de08fa4b165ca59f6cda45d835c7a10f764ee8832df40f73af6dc

Observation 53416eec-8621-40a5-ab27-02d4213d8aac · outbound

This paper cites A unified theory of decentralized sgd with changing topology and local updates.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training A unified theory of decentralized sgd with changing topology and local updates

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.445958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.510534Z digest=sha256:34964ebbd10a28d4707222cb896e96f195db7d33954438540a78fab7941c0a64

Observation 26c6b3de-4ba5-4167-8a9d-527cc36910f3 · outbound

This paper cites Slow Learners are Fast.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Slow Learners are Fast

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.514940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.514940Z digest=sha256:e6baa1ee800d0de1a3ea07052d4272fe9fd73880cd3f5b74b1935aa25f875552

Observation 1b8d4b9e-3e89-4994-974a-f694be776ac0 · outbound

This paper cites Amp: Automatically finding model parallel strategies with heterogeneity awareness.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Amp: Automatically finding model parallel strategies with heterogeneity awareness

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.432174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.519385Z digest=sha256:d1748a028627f14b03204c2d1b032b8f5e86bff631113014b305eafd29a9bfd6

Observation 3f21350b-6d89-4e14-80f5-df3d8bdeeb2b · outbound

This paper cites Fednar: Federated optimization with normalized annealing regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Fednar: Federated optimization with normalized annealing regularization

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.417124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.523654Z digest=sha256:ec7ec32dd246f9715ad227b7a8e8e980f55fb0dc5a52c7093fabd156427720fe

Observation 6bffd1a3-e126-4dcb-bd21-007970d65797 · outbound

This paper cites G., Park, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Park, J

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.403430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.527727Z digest=sha256:6bc12c643dac742014bc0e3c0045824be340cc40411e6a086fa44752bdb7ee77

Observation e7736bb6-3255-42e5-9752-152aeb9e5858 · outbound

This paper cites K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.531887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.531887Z digest=sha256:ff672ed6fa4da08667998ad9137fc96cd321722dbf399ac09ae4c224097c4f14

Observation 3261fdbd-1c8c-41cb-a03c-dd1e27ebf29f · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.382058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.536204Z digest=sha256:5a459435d56281e5f5c7db770a3e0e4e936c23517c5ee477f9c83e35a4969e09

Observation 02ff7cc4-9a31-4000-89e0-e1cd70153de6 · outbound

This paper cites Don't Use Large Mini-Batches, Use Local SGD.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Don't Use Large Mini-Batches, Use Local SGD

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.540979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.540979Z digest=sha256:4b6bef8d5946b557fa515c49e95a785cf5927761f878a3f740fdec1840edddf2

Observation 44a85517-bbc4-4de7-9cac-fd334735de04 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Local-SGD Training for Language Modeling

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.545546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.545546Z digest=sha256:d3fe095d4cdf0913c22eb6581295fad94135d7a30af7d3a4b2eed8250c8b7c01

Observation 35639ddb-bc58-40b0-8655-f200645a9705 · outbound

This paper cites An improved analysis of stochastic gradient descent with momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training An improved analysis of stochastic gradient descent with momentum

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.368999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.549864Z digest=sha256:9705b2db0ed28093116e9e66ba93803ca3e58c7a466c61d00412a804f068dee3

Observation 537bb3ed-9ee9-432f-a11c-abc5475b7593 · outbound

This paper cites Decoupled Weight Decay Regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Decoupled Weight Decay Regularization

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.554007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.554007Z digest=sha256:ef89d213c8e59cdd8d0be835d5d0cf2b87b8e05ea491b79bfed796df2af8e766

Observation b36412e9-5d56-4c00-a1cc-e0215694c667 · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.558982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.558982Z digest=sha256:d8ff4d40ae82e26d5e96a548775700c84330156a783e1249137270741f8d5b68

Observation 273bddff-6fb4-44da-a491-669bb0f35e2a · outbound

This paper cites Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.563160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.563160Z digest=sha256:da14ca5486e0bfd3ca7fd083d7a1063bd02995e42cbb4b0258733c8f0a84fcfc

Observation 79540e1c-29d9-4026-9a6a-a3c7909ab5ca · outbound

This paper cites Mixed Precision Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Mixed Precision Training

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.567529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.567529Z digest=sha256:27430984f4ccd205e855a09bfaf3076ba9e9d23c5c6e17ca4d622ed7edb822e5

Observation d2ec98a8-9bfd-44e3-8968-4096fd4687da · outbound

This paper cites and Ulukus, S.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Ulukus, S

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.345128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.571738Z digest=sha256:248a5193dd459fe06df1d9217c69abd832db1d092844eb489e770b6436a8fc18

Observation 84bc9a37-a73c-41db-9144-c95d768817b3 · outbound

This paper cites Efficient large-scale language model training on gpu clusters using megatron-lm.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Efficient large-scale language model training on gpu clusters using megatron-lm

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.331632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.575872Z digest=sha256:94abe3e56760e743e2e5a1a30c0834749e7b71fea0f41ac6a35957058171906a

Observation 49d1d773-396d-4101-9f74-a60169bd6857 · outbound

This paper cites Federated learning with buffered asynchronous aggregation.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Federated learning with buffered asynchronous aggregation

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.318396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.579826Z digest=sha256:fdde86feec2bbcd8e3824481b714684e73cb68bae79df58b096a2d4e6d0678a4

Observation 2525ef75-a894-4941-8cea-9381966464f1 · outbound

This paper cites Trade-offs of Local SGD at Scale: An Empirical Study.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Trade-offs of Local SGD at Scale: An Empirical Study

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.583881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.583881Z digest=sha256:464f1ea66e226d600fa21c1ea7b258cab0153dcc26b3433c1a5e0ddd149d8265

Observation afba612f-fdf6-4ea3-8656-6e2eafb7ea23 · outbound

This paper cites Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.304917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.587959Z digest=sha256:37a6fd794e4e569705287c51b40f3c8d21fdf97c6041160ea01c50720e67d8c8

Observation 6a58490a-c2da-4670-98af-7904d1a49ff1 · outbound

This paper cites Automatic mixed precision package - torch.amp.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Automatic mixed precision package - torch.amp

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.291281Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.591966Z digest=sha256:1c3811616c9bc8fdc0b54f11e2d721f83927566299918b610f0a778b650b59eb

Observation a2717fc3-ac89-4364-9715-7f3359dee362 · outbound

This paper cites L., Bhagavatula, C., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Bhagavatula, C., and Choi, Y

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.596049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.596049Z digest=sha256:0700429744f761a4ca3c1c635ca1bc837f09af005c14f95338357cd877c8b339

Observation 699cca50-5590-4211-bf8c-18eb009170d8 · outbound

This paper cites Local SGD Converges Fast and Communicates Little.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Local SGD Converges Fast and Communicates Little

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.600071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.600071Z digest=sha256:eeda04bf41ebbe3c5d1155fe2f8b609828c3dc41e037fb4c815171699c90ada9

Observation 88cfd329-67ed-4856-943e-98279e748666 · outbound

This paper cites Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.269324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.604480Z digest=sha256:ff93095c214a4467255fe64b1574f4a47623ea8cc4d4d9e87dc44746b88b09f0

Observation 95238f27-483a-4835-9220-b84b38a96561 · outbound

This paper cites CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.608870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.608870Z digest=sha256:9c33c14b1f3bfb0f03746c660bce91309008a3b7bab1ee3060382819ce2cb2c7

Observation a6656838-2a7a-4416-998a-f1a277d48c5e · outbound

This paper cites H., and Zhang, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training H., and Zhang, J

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.255841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.613266Z digest=sha256:7b60443644d68f8aa5c8e09905a1e2713cc7c7a91115c8d7f62ac83c289b07bc

Observation 6189058a-67ed-433a-a0d6-478ce4200ebc · outbound

This paper cites On the importance of initialization and momentum in deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the importance of initialization and momentum in deep learning

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.243135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.617316Z digest=sha256:b4e38a6eed81b7838de2985bd99f67978505b6289c895074b510ebb3329d700a

Observation 6ccdea98-c0bf-4551-ad60-9bbd5aeea7c6 · outbound

This paper cites FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.621574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.621574Z digest=sha256:2ecafff57d1671db37f47bfa280b212392a4f2b5c74ae759741c744448c2630d

Observation c22ac7c7-f870-4664-a531-3e146bf76c3f · outbound

This paper cites Optimization of collective communication operations in mpich.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Optimization of collective communication operations in mpich

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.229093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.626213Z digest=sha256:c937999685ff0028abe9989c818a4c9925cc1ec31a4b8d94c8eff07d76c01f27

Observation 24384d89-4a6b-40bc-aa21-14b8d738190d · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.214357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.630309Z digest=sha256:f22d61401415841739fe0298f10ca037e87aa8f3233f394fa9b8657772b0fdbb

Observation 737e0187-f050-438d-a86b-f7fd9d35a8e6 · outbound

This paper cites and Joshi, G.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Joshi, G

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.198660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.634425Z digest=sha256:29e52df95d5404624bd041141c898a6c87ad7515709ff07bd3382daa24ef2e9c

Observation c79c6f55-67ad-49b6-9528-6e98935ee3bf · outbound

This paper cites SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.638357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.638357Z digest=sha256:4e27aa9bac376a9b6b20d7bcdf3eeb60c4a9b3a68ab545dccd06a7bbbca5448f

Observation bf7e4ae6-c427-4c87-8d7c-af088e0b397e · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.184384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.642753Z digest=sha256:2c773ef2751156438bdf8b77382ebe69e24cb9b5f6800d34d453811e17ad2b37

Observation 59b52d04-4e0f-4d3d-8a33-4274223034e0 · outbound

This paper cites Asynchronous Hierarchical Federated Learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Hierarchical Federated Learning

Reference 52

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:46:06.784740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.646548Z digest=sha256:5a1697c390121c4c092d60a2c05dd2d3d9dffe2fb8ab22a34843da1592cfbce6

Observation 2f18f26b-a863-4fdb-9cf0-fe13ed98c8f8 · outbound

This paper cites F., and Gardner, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training F., and Gardner, M

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.650844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.650844Z digest=sha256:d83495bae7a0c73a9926e9a15705441ad5d77da3928b964f83dd8802f198b939

Observation 1ad8ad91-94f0-43e9-802b-acff48e72d75 · outbound

This paper cites Asynchronous Federated Optimization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Federated Optimization

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.655253Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.655253Z digest=sha256:48e20f02884e96e6d9e50d0d00218a1c51c5d9023e3812eacfd7da8b68064f27

Observation a8e3185b-aaa5-463f-8da3-8abff6b47b04 · outbound

This paper cites Hierarchical global asynchronous federated learning across multi-center.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hierarchical global asynchronous federated learning across multi-center

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.169945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.659681Z digest=sha256:fb6928bc05dc26139f8fb62b62b3010e57b7b8d6cbe15848374e8f096a616fdd

Observation b7610af2-5f14-43a9-ae0e-398ceb3d562f · outbound

This paper cites Qwen3 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Qwen3 Technical Report

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.663683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.663683Z digest=sha256:e41f428d17a596112ef04a29bb6b83c5985b902cebab88de3b2412fbd5d541b6

Observation 51191fdb-9d3e-460c-99eb-0685035090ab · outbound

This paper cites Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.156426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.668243Z digest=sha256:168da16b83755315dacfd577bfc4682159fa87761f723e5d9e8041987af6ab3f

Observation d57a8550-0e7a-48d4-85a1-fdb19a209639 · outbound

This paper cites S., Re, C., and Zhang, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training S., Re, C., and Zhang, C

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.143017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.672356Z digest=sha256:f8ecb50c3e327716bbc9444a93c3f532a2c056f49c01af49758407c61885319f

Observation dd7386b0-8461-44c1-9b2e-23a322d8f8aa · outbound

This paper cites Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.676676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.676676Z digest=sha256:8664c12367019cda827d47358c1b2079dc10eb9dd7af3ae468e8a6706b7236e0

Observation f73681d9-649b-4e63-b675-484757c415c5 · outbound

This paper cites E., and LeCun, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training E., and LeCun, Y

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.120749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.681158Z digest=sha256:2b58ebebc5774f793aefefeadd08d64451d9e6d538cff239bcc65df4f9022788

Observation 549790fa-ed03-41d3-b02c-60da6f815395 · outbound

This paper cites Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

Reference 61

Resolution
metadata mismatch
local_arxiv, observed 2026-08-07T10:46:06.737552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.685339Z digest=sha256:f6957aac91c6395a2cd0705338b64cb8095528a2d4eac51b31a82d6d6036b794

Pith citing papers

No inbound Pith citation observations are available.