Pith. sign in

Gated delta networks: Improving mamba2 with delta rule

3 Pith papers cite this work. Polarity classification is still indexing.

3 Pith papers citing it

citation-role summary

background 3

citation-polarity summary

fields

cs.LG 3

years

2026 3

verdicts

UNVERDICTED 3

roles

background 3

polarities

background 3

representative citing papers

MinMax Recurrent Neural Cascades

cs.LG · 2026-05-07 · unverdicted · novelty 6.0 · 3 refs

MinMax RNCs are recurrent networks over the min-max semiring that achieve regular language expressivity, log-depth parallel scan, uniformly bounded states, and non-vanishing state gradients while showing competitive empirical performance.

Kaczmarz Linear Attention

cs.LG · 2026-05-09 · unverdicted · novelty 5.0

Kaczmarz Linear Attention replaces the empirical coefficient in Gated DeltaNet with a key-norm-normalized step size derived from the online regression objective, yielding lower perplexity and better needle-in-haystack performance.

citing papers explorer

Showing 3 of 3 citing papers.

  • LoopUS: Recasting Pretrained LLMs into Looped Latent Refinement Models cs.LG · 2026-05-10 · unverdicted · none · ref 41

    LoopUS converts pretrained LLMs into looped latent refinement models via block decomposition, selective gating, random deep supervision, and confidence-based early exiting to improve reasoning performance.

  • MinMax Recurrent Neural Cascades cs.LG · 2026-05-07 · unverdicted · none · ref 30 · 3 links

    MinMax RNCs are recurrent networks over the min-max semiring that achieve regular language expressivity, log-depth parallel scan, uniformly bounded states, and non-vanishing state gradients while showing competitive empirical performance.

  • Kaczmarz Linear Attention cs.LG · 2026-05-09 · unverdicted · none · ref 49

    Kaczmarz Linear Attention replaces the empirical coefficient in Gated DeltaNet with a key-norm-normalized step size derived from the online regression objective, yielding lower perplexity and better needle-in-haystack performance.