Pith. sign in

Title resolution pending

For the iterates {xt,0} in Algorithm 1 with β1 = β2 = β, λ= 0, it satisfies that 1 T T −1X t=0 E ∥∇f (xt,0) ∥1 ≤ f (x0,0) − f∗ ηγT + 2 √ d τ T T −1X t=0 E ∥ϵt+1∥ + ηγdL 2 · 2023

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
browse 1 citing papers

Title metadata for this work has not finished resolving. The hub is built from the citation graph; the title resolver retries DOI and OpenAlex on its next pass.

fields

cs.LG 1

years

2024 1

verdicts

CONDITIONAL 1

representative citing papers

Distributed Sign Momentum with Local Steps for Training Transformers

cs.LG · 2024-11-26 · conditional · novelty 4.0

Distributed sign momentum with local steps matches or beats SlowMo on GPT-2 pretraining at 12x-36x lower communication and has a stated O(1/T^{1/4}) convergence rate, though the printed theorem has algebra inconsistencies.

citing papers explorer

Showing 1 of 1 citing paper.

  • Distributed Sign Momentum with Local Steps for Training Transformers cs.LG · 2024-11-26 · conditional · none · ref 15

    Distributed sign momentum with local steps matches or beats SlowMo on GPT-2 pretraining at 12x-36x lower communication and has a stated O(1/T^{1/4}) convergence rate, though the printed theorem has algebra inconsistencies.