Pith. sign in

Paper Citation Record · LEDGER

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training

As of 8 August 2026, this Paper Citation Record lists 61 of 61 outbound references and 0 inbound Pith citation observations for arXiv:2506.04531.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.04531 v1

Coverage vector

measured 61 of 61 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:46:06.685339Z

measured 61 of 61 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

61 of 61 outbound references displayed

  • verified exact1
  • verified fuzzy26
  • unresolved33
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2ac87bf3-fe11-4f5d-8145-440dab3a0dab · outbound

This paper cites write newline.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.420751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.420751Z digest=sha256:5d9de58b294f3cb319756dde47df5e629d241543ca58ec520767426d0d99ebfd

Observation f8f47d13-e59b-45e4-afae-347526e25eb3 · outbound

This paper cites GPT-4 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training GPT-4 Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.426612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.426612Z digest=sha256:e0f64d68f46766e10f0293410d576e99de547baad464dbd93513ce2304b639d5

Observation 00f16575-a363-4033-aff5-1b339f2a1de0 · outbound

This paper cites On the choice of learning rate for local sgd.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the choice of learning rate for local sgd

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.560463Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.432013Z digest=sha256:14f8b3a98400a7af1b727189791904661cb026de5b2d47e7821c76746dd4cc16

Observation 26ecb27f-ed11-4482-816d-2a24f0bbebf8 · outbound

This paper cites G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.436385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.436385Z digest=sha256:de9e9239d9d537df9510088bf7b66bb7a752731685f974980c70ab0b987307bb

Observation ec89d5cc-1f69-444d-ab7e-2d9f9a34faf3 · outbound

This paper cites L., Gao, J., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Gao, J., and Choi, Y

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.441028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.441028Z digest=sha256:e6dba655c4be5ba34a9885e4a1bc74ba8fcf947975ccff41da17b78f279d853a

Observation 68dc5e3c-4d4b-48ce-9f99-9ee51f8cd146 · outbound

This paper cites LEAF: A Benchmark for Federated Settings.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training LEAF: A Benchmark for Federated Settings

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.445477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.445477Z digest=sha256:d0fdc8d60de629a9d45da8893eb3ed4200a4cbe63bb7e19d797c40c2b5bf6201

Observation 90e05d00-5118-4e00-914e-ad30f66d0988 · outbound

This paper cites Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.529418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.450151Z digest=sha256:fc0f93fe2c36698aeee22dd68cab2c09a71e3450f8f6e65eab836fe85bb866c0

Observation d9442a6c-000d-48d4-b524-fa4aa748ada1 · outbound

This paper cites Asynchronous online federated learning for edge devices with non-iid data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous online federated learning for edge devices with non-iid data

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.515918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.454938Z digest=sha256:6a5f51ed917787090fc4d72f77d380f9ea613a2e5fa7b1d158dd5be23b86a1a7

Observation e39444a7-3c0f-43aa-ac33-9e6a5203e745 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.459202Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.459202Z digest=sha256:da964a96a6b228ebcd640f531a4215bf8b3929b796dfb7b4d519ad6e46168a0a

Observation dad22139-1e59-466c-b8e4-2e8b4ae64195 · outbound

This paper cites Large scale distributed deep networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Large scale distributed deep networks

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.502116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.463751Z digest=sha256:cf79f48a7de68e078942ff5443ffd63eb25106aa6846a5d866a0f9d8e1af87b9

Observation 416f7470-76d8-4077-8710-3ab49683b68f · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training DiLoCo: Distributed Low-Communication Training of Language Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.468296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.468296Z digest=sha256:3e049c2f116b90227e058b47e2601365fa6806022cd01011bd40ef39d6c12246

Observation b3e578e4-b346-4654-964f-47b0319965b9 · outbound

This paper cites The Llama 3 Herd of Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.472885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.472885Z digest=sha256:955d1a56134616f10c2ddcce0fc2afa02f0d0623bf06f937397947ef6bcd65ae

Observation 2ecc8cc8-b082-43c9-858f-98285f36c311 · outbound

This paper cites N., et al.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training N., et al

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.477265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.477265Z digest=sha256:5277bd6c508a6009b861034f7b1c568f440e3eb557dbc4f4fb1db2128b21d03d

Observation 1926c09d-f5c9-4036-86f2-f3f270ee961d · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.481712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.481712Z digest=sha256:39633a156538060b5dc8e855630d825d0039fe1fdf1ba5dce26617fedb8dcd80

Observation 2d5fd34e-e590-48dd-950d-11b5d29c8612 · outbound

This paper cites M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.488168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.486456Z digest=sha256:0cc92db3b48278005b9da1ef666db9cac15a445a7d2ede5cfd57e34d41665583

Observation e6995cb0-cce3-45e5-98c2-1169e9dbcbe0 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Measuring Massive Multitask Language Understanding

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.490714Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.490714Z digest=sha256:bcdb45cd671e490e45434e9fcb8ef395b3c41c974855182828f97fc5e396b871

Observation 3eb051e4-c1d3-4861-8b23-c97c2cf39f00 · outbound

This paper cites OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.495371Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.495371Z digest=sha256:a7e70f250695e7e469cd1ed64de7da4d53fe4d62d3b2a8cb6f889613ea332987

Observation 43874f70-0f92-41e3-b5b0-df147ae4cf6e · outbound

This paper cites MegaScale : Scaling large language model training to more than 10,000 gpus.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training MegaScale : Scaling large language model training to more than 10,000 gpus

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.474677Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.500093Z digest=sha256:3b15216ddbc28ca9ade9b4d523b791946fe73f876d3bedce89f6232955545a59

Observation 1a84a432-08b5-4fb5-be17-de251fa0e80f · outbound

This paper cites Tighter theory for local sgd on identical and heterogeneous data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Tighter theory for local sgd on identical and heterogeneous data

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.459720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.505985Z digest=sha256:9ebe142c82ba3bd0c2beebaa71aaf74f8e7c70e039d0fad8dea0259b38b814b6

Observation 53416eec-8621-40a5-ab27-02d4213d8aac · outbound

This paper cites A unified theory of decentralized sgd with changing topology and local updates.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training A unified theory of decentralized sgd with changing topology and local updates

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.445958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.510534Z digest=sha256:a0e5ffa1fc444cae38bd92201a3204c78d86862d95a584e1f0a2296a79acf6f2

Observation 26c6b3de-4ba5-4167-8a9d-527cc36910f3 · outbound

This paper cites Slow Learners are Fast.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Slow Learners are Fast

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.514940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.514940Z digest=sha256:e6baa1ee800d0de1a3ea07052d4272fe9fd73880cd3f5b74b1935aa25f875552

Observation 1b8d4b9e-3e89-4994-974a-f694be776ac0 · outbound

This paper cites Amp: Automatically finding model parallel strategies with heterogeneity awareness.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Amp: Automatically finding model parallel strategies with heterogeneity awareness

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.432174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.519385Z digest=sha256:d4619455fcb1b7c32721cf97c15aed79528d777438ca0176983d449d44be9574

Observation 3f21350b-6d89-4e14-80f5-df3d8bdeeb2b · outbound

This paper cites Fednar: Federated optimization with normalized annealing regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Fednar: Federated optimization with normalized annealing regularization

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.417124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.523654Z digest=sha256:376c35ceb35feab5d53e8bd8f4ed4ec3a5f71a5d8b40a241e4d5539bf607617c

Observation 6bffd1a3-e126-4dcb-bd21-007970d65797 · outbound

This paper cites G., Park, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Park, J

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.403430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.527727Z digest=sha256:10215f16a2e3d3271b1bdfacbd5a97a863fd32743ec0c23ac8fee31c2bec2ce5

Observation e7736bb6-3255-42e5-9752-152aeb9e5858 · outbound

This paper cites K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.531887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.531887Z digest=sha256:ff672ed6fa4da08667998ad9137fc96cd321722dbf399ac09ae4c224097c4f14

Observation 3261fdbd-1c8c-41cb-a03c-dd1e27ebf29f · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.382058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.536204Z digest=sha256:1ddaebab322100596bd34ea20cfe134a14ff98a4d6f8d1b92368275b560a7546

Observation 02ff7cc4-9a31-4000-89e0-e1cd70153de6 · outbound

This paper cites Don't Use Large Mini-Batches, Use Local SGD.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Don't Use Large Mini-Batches, Use Local SGD

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.540979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.540979Z digest=sha256:4b6bef8d5946b557fa515c49e95a785cf5927761f878a3f740fdec1840edddf2

Observation 44a85517-bbc4-4de7-9cac-fd334735de04 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Local-SGD Training for Language Modeling

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.545546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.545546Z digest=sha256:d3fe095d4cdf0913c22eb6581295fad94135d7a30af7d3a4b2eed8250c8b7c01

Observation 35639ddb-bc58-40b0-8655-f200645a9705 · outbound

This paper cites An improved analysis of stochastic gradient descent with momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training An improved analysis of stochastic gradient descent with momentum

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.368999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.549864Z digest=sha256:153e78de0fb89ced906b9ed29f6bd2cafdd9b86ca3b57b48e9573e80fb72cc94

Observation 537bb3ed-9ee9-432f-a11c-abc5475b7593 · outbound

This paper cites Decoupled Weight Decay Regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Decoupled Weight Decay Regularization

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.554007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.554007Z digest=sha256:ef89d213c8e59cdd8d0be835d5d0cf2b87b8e05ea491b79bfed796df2af8e766

Observation b36412e9-5d56-4c00-a1cc-e0215694c667 · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.558982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.558982Z digest=sha256:d8ff4d40ae82e26d5e96a548775700c84330156a783e1249137270741f8d5b68

Observation 273bddff-6fb4-44da-a491-669bb0f35e2a · outbound

This paper cites Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.563160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.563160Z digest=sha256:da14ca5486e0bfd3ca7fd083d7a1063bd02995e42cbb4b0258733c8f0a84fcfc

Observation 79540e1c-29d9-4026-9a6a-a3c7909ab5ca · outbound

This paper cites Mixed Precision Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Mixed Precision Training

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.567529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.567529Z digest=sha256:27430984f4ccd205e855a09bfaf3076ba9e9d23c5c6e17ca4d622ed7edb822e5

Observation d2ec98a8-9bfd-44e3-8968-4096fd4687da · outbound

This paper cites and Ulukus, S.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Ulukus, S

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.345128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.571738Z digest=sha256:d323ef4f50909a8df206966e1f368e563dd68d9a6c951415ccf4d6a65dcecd67

Observation 84bc9a37-a73c-41db-9144-c95d768817b3 · outbound

This paper cites Efficient large-scale language model training on gpu clusters using megatron-lm.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Efficient large-scale language model training on gpu clusters using megatron-lm

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.331632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.575872Z digest=sha256:0df5b91a234faf13610d3aa14b572cebe75a02be2a9c9072fd2cdb195774df08

Observation 49d1d773-396d-4101-9f74-a60169bd6857 · outbound

This paper cites Federated learning with buffered asynchronous aggregation.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Federated learning with buffered asynchronous aggregation

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.318396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.579826Z digest=sha256:b1a99a92484ad0d9a5eca77f3771f2b62357c7fad7f02b776324db7900eb3564

Observation 2525ef75-a894-4941-8cea-9381966464f1 · outbound

This paper cites Trade-offs of Local SGD at Scale: An Empirical Study.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Trade-offs of Local SGD at Scale: An Empirical Study

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.583881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.583881Z digest=sha256:464f1ea66e226d600fa21c1ea7b258cab0153dcc26b3433c1a5e0ddd149d8265

Observation afba612f-fdf6-4ea3-8656-6e2eafb7ea23 · outbound

This paper cites Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.304917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.587959Z digest=sha256:3d51a1cb0b98dce8c1eb283093f31df1d1311bd1af89757177e377e8ef2d8373

Observation 6a58490a-c2da-4670-98af-7904d1a49ff1 · outbound

This paper cites Automatic mixed precision package - torch.amp.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Automatic mixed precision package - torch.amp

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.291281Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.591966Z digest=sha256:3364eb21c9678cbf106f0c4fda3fac2d67828d36a998b07a5605cc4e6f9fd011

Observation a2717fc3-ac89-4364-9715-7f3359dee362 · outbound

This paper cites L., Bhagavatula, C., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Bhagavatula, C., and Choi, Y

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.596049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.596049Z digest=sha256:0700429744f761a4ca3c1c635ca1bc837f09af005c14f95338357cd877c8b339

Observation 699cca50-5590-4211-bf8c-18eb009170d8 · outbound

This paper cites Local SGD Converges Fast and Communicates Little.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Local SGD Converges Fast and Communicates Little

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.600071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.600071Z digest=sha256:eeda04bf41ebbe3c5d1155fe2f8b609828c3dc41e037fb4c815171699c90ada9

Observation 88cfd329-67ed-4856-943e-98279e748666 · outbound

This paper cites Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.269324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.604480Z digest=sha256:2d2f779fa36ca16aa45f110e21994707562bb7f072890136f9b53be9092caaa2

Observation 95238f27-483a-4835-9220-b84b38a96561 · outbound

This paper cites CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.608870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.608870Z digest=sha256:9c33c14b1f3bfb0f03746c660bce91309008a3b7bab1ee3060382819ce2cb2c7

Observation a6656838-2a7a-4416-998a-f1a277d48c5e · outbound

This paper cites H., and Zhang, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training H., and Zhang, J

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.255841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.613266Z digest=sha256:695dbd93c0840fdba9ae26d0cca12d2396149c569909324ebc80404afe29d38d

Observation 6189058a-67ed-433a-a0d6-478ce4200ebc · outbound

This paper cites On the importance of initialization and momentum in deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the importance of initialization and momentum in deep learning

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.243135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.617316Z digest=sha256:a1aea1cfa071d038d979da105f1542375ac41f64d7f8407be72de289f5d1d9f1

Observation 6ccdea98-c0bf-4551-ad60-9bbd5aeea7c6 · outbound

This paper cites FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.621574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.621574Z digest=sha256:2ecafff57d1671db37f47bfa280b212392a4f2b5c74ae759741c744448c2630d

Observation c22ac7c7-f870-4664-a531-3e146bf76c3f · outbound

This paper cites Optimization of collective communication operations in mpich.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Optimization of collective communication operations in mpich

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.229093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.626213Z digest=sha256:01ea4bdba9532bd21d0221f7b48e00b60ffb6d6deb62efaa2f830a4032b3fcf7

Observation 24384d89-4a6b-40bc-aa21-14b8d738190d · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.214357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.630309Z digest=sha256:3508ca8567e8633c351b3062c94155ff541b119811ef1d9eefdc1a591300c2a1

Observation 737e0187-f050-438d-a86b-f7fd9d35a8e6 · outbound

This paper cites and Joshi, G.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Joshi, G

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.198660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.634425Z digest=sha256:7ec8f2b43dce0bcc311c455372db3c475e6b5bbc3c73c7036fcb3ab9d551a303

Observation c79c6f55-67ad-49b6-9528-6e98935ee3bf · outbound

This paper cites SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.638357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.638357Z digest=sha256:4e27aa9bac376a9b6b20d7bcdf3eeb60c4a9b3a68ab545dccd06a7bbbca5448f

Observation bf7e4ae6-c427-4c87-8d7c-af088e0b397e · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.184384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.642753Z digest=sha256:cf19c7284d6df6e4c4ea9bfabf3b1f6c94529041d8a2e8c557c1c1f4e6867ef6

Observation 59b52d04-4e0f-4d3d-8a33-4274223034e0 · outbound

This paper cites Asynchronous Hierarchical Federated Learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Hierarchical Federated Learning

Reference 52

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:46:06.784740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.646548Z digest=sha256:048f730d7f5be9ec98ac965fec26961e624cb2bda090c1eef5f8f77e2c0ff521

Observation 2f18f26b-a863-4fdb-9cf0-fe13ed98c8f8 · outbound

This paper cites F., and Gardner, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training F., and Gardner, M

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.650844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.650844Z digest=sha256:d83495bae7a0c73a9926e9a15705441ad5d77da3928b964f83dd8802f198b939

Observation 1ad8ad91-94f0-43e9-802b-acff48e72d75 · outbound

This paper cites Asynchronous Federated Optimization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Federated Optimization

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.655253Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.655253Z digest=sha256:48e20f02884e96e6d9e50d0d00218a1c51c5d9023e3812eacfd7da8b68064f27

Observation a8e3185b-aaa5-463f-8da3-8abff6b47b04 · outbound

This paper cites Hierarchical global asynchronous federated learning across multi-center.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hierarchical global asynchronous federated learning across multi-center

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.169945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.659681Z digest=sha256:82bf449b93bc78fcdbf4379d864ece43d270b3723014857d207236964d3da379

Observation b7610af2-5f14-43a9-ae0e-398ceb3d562f · outbound

This paper cites Qwen3 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Qwen3 Technical Report

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.663683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.663683Z digest=sha256:e41f428d17a596112ef04a29bb6b83c5985b902cebab88de3b2412fbd5d541b6

Observation 51191fdb-9d3e-460c-99eb-0685035090ab · outbound

This paper cites Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.156426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.668243Z digest=sha256:465e36755ce1bc726344cc7b801c23fc06f4894a7b5edb3decfe6bb6b95a8862

Observation d57a8550-0e7a-48d4-85a1-fdb19a209639 · outbound

This paper cites S., Re, C., and Zhang, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training S., Re, C., and Zhang, C

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.143017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.672356Z digest=sha256:2b4ab9f354455ac72923fef52ca925bc73186b9a37b5e9fd5a6c9a0fa1dbedc3

Observation dd7386b0-8461-44c1-9b2e-23a322d8f8aa · outbound

This paper cites Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.676676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.676676Z digest=sha256:8664c12367019cda827d47358c1b2079dc10eb9dd7af3ae468e8a6706b7236e0

Observation f73681d9-649b-4e63-b675-484757c415c5 · outbound

This paper cites E., and LeCun, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training E., and LeCun, Y

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.120749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.681158Z digest=sha256:b08fd0677d9dc93930b170555be3268096519bcd38ac7cd60edf68d075e8b921

Observation 549790fa-ed03-41d3-b02c-60da6f815395 · outbound

This paper cites Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

Reference 61

Resolution
metadata mismatch
local_arxiv, observed 2026-08-07T10:46:06.737552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.685339Z digest=sha256:d516da10efe61eee765296d9b4efa0f2cd3002c9dfe876eea00b7abf4f29728a

Pith citing papers

No inbound Pith citation observations are available.