pith:JY2T5G5D
Improving the Performance and Learning Stability of Parallelizable RNNs Designed for Ultra-Low Power Applications
The cumulative update formulation in CMRU and αCMRU restores gradient flow while preserving bistable memory for ultra-low power RNNs.
arxiv:2605.11855 v2 · 2026-05-12 · cs.LG · cs.AI · cs.AR
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{JY2T5G5DNIZKCVUDOA4ENRN7YX}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Experiments show that the cumulative formulation dramatically improves convergence stability and reduces initialization sensitivity. The CMRU and αCMRU match or outperform Linear Recurrent Units (LRUs) and minimal Gated Recurrent Units (minGRUs) across diverse benchmarks at small model sizes, with particular advantages on tasks requiring discrete long-range retention, while the CMRU retains quantized states, persistent memory, and noise-resilient dynamics essential for analog implementation.
That the cumulative update formulation preserves the quantized states with hysteresis, persistent memory, and noise-resilient dynamics required for direct analog hardware mapping while restoring gradient flow.
Cumulative state updates in CMRU restore gradient flow through time in quantized bistable RNNs, yielding more stable convergence and competitive or superior performance versus LRUs and minGRUs on long-range sequence tasks.
Cited by
Receipt and verification
| First computed | 2026-06-09T01:05:19.089260Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
4e353e9ba36a32a15683703846c5bfc5f6d32f01c5d74d5665387df61e95ffc6
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/JY2T5G5DNIZKCVUDOA4ENRN7YX \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 4e353e9ba36a32a15683703846c5bfc5f6d32f01c5d74d5665387df61e95ffc6
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "df8bc267d63eb68ba85c3b83def5c2d9be5652246fc94fde32e8cf9556e8d928",
"cross_cats_sorted": [
"cs.AI",
"cs.AR"
],
"license": "http://creativecommons.org/licenses/by-nc-nd/4.0/",
"primary_cat": "cs.LG",
"submitted_at": "2026-05-12T09:39:33Z",
"title_canon_sha256": "e57ee3fe3e48df1b2c310a9378a729f935ff1efbb5bd2560a3c2656b2363be70"
},
"schema_version": "1.0",
"source": {
"id": "2605.11855",
"kind": "arxiv",
"version": 2
}
}