OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention | Paper Citation Record

Observation 4f01d78d-e5c3-429a-bae9-5f55efbd6c15 · outbound

This paper cites What learning algorithm is in-context learning? investigations with linear models.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention What learning algorithm is in-context learning? investigations with linear models

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.991827Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 4130b2f2-c369-4701-92c8-17251c0f8426 · outbound

This paper cites Zoology: Measuring and Improving Recall in Efficient Language Models.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Zoology: Measuring and Improving Recall in Efficient Language Models

Reference 2

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.183550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation b70d82d9-3a87-4cb7-acb2-f4473fd7138f · outbound

This paper cites Simple linear attention language models balance the recall-throughput tradeoff.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Simple linear attention language models balance the recall-throughput tradeoff

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.283089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e38bb359-6662-46c6-8417-47f9135820ca · outbound

This paper cites Just read twice: closing the recall gap for recurrent language models.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Just read twice: closing the recall gap for recurrent language models

Reference 4

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T19:09:23.225904Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation c2cfc2a3-208e-4645-a033-3f52ef4553c1 · outbound

This paper cites Hinton, V olodymyr Mnih, Joel Z.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Hinton, V olodymyr Mnih, Joel Z

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.949163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 90d7d37b-aeab-4297-a2e9-f35227bb54a8 · outbound

This paper cites LongBench: A bilingual, multitask benchmark for long context understanding.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention LongBench: A bilingual, multitask benchmark for long context understanding

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.953091Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 14002096-691d-4596-a78a-17805a1fc268 · outbound

This paper cites Online learning rate adaptation with hypergradient descent.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Online learning rate adaptation with hypergradient descent

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.014234Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation bb2fe9b5-60b8-4dea-bc30-330ce6385353 · outbound

This paper cites xLSTM: extended long short-term memory.Advances in Neural Infor- mation Processing Systems, 37:107547–107603, December 2024.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention xLSTM: extended long short-term memory.Advances in Neural Infor- mation Processing Systems, 37:107547–107603, December 2024

Reference 8

Resolution: malformed identifier; raw_fallback, observed 2026-05-14T19:09:23.998702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 44e8179c-f409-4d4d-bf8d-ca44c9cbd078 · outbound

This paper cites Titans: Learning to memorize at test time.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Titans: Learning to memorize at test time

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.936901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 237f0fb9-9ee6-4cd7-a77e-813b0bfb362d · outbound

This paper cites Titans: Learning to Memorize at Test Time.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Titans: Learning to Memorize at Test Time

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-05-14T22:08:15.778565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 5fd9483a-c6aa-4b2c-8e1e-7c934fb8e84f · outbound

This paper cites ATLAS: Learning to Optimally Memorize the Context at Test Time.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention ATLAS: Learning to Optimally Memorize the Context at Test Time

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.240619Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 15c6c278-0837-4c55-b10b-fd2e35b0dce1 · outbound

This paper cites PIQA: Reasoning about physical commonsense in natural language.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention PIQA: Reasoning about physical commonsense in natural language

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.949794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 8a3da680-25c4-4eca-b9f0-7258c23ba42c · outbound

This paper cites Rethinking attention with performers.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Rethinking attention with performers

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.990982Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 62474e95-37bd-4868-90cf-fc891def6f33 · outbound

This paper cites BoolQ: Exploring the surprising difficulty of natural yes/no questions.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention BoolQ: Exploring the surprising difficulty of natural yes/no questions

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.917970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation affad8e8-2458-4085-97d6-e245a498668f · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 15

Resolution: verified exact; local_arxiv, observed 2026-05-14T19:09:23.235003Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation c3699eb8-3392-46ab-9ec8-56c6370f882d · outbound

This paper cites Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.908365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 9302ae87-b557-4940-b9e7-9d7ba4f41f7b · outbound

This paper cites DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.912864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 261f0bdb-ea38-4673-a90e-3a50b79ad56a · outbound

This paper cites Adaptive subgradient methods for online learning and stochastic optimization.Journal of Machine Learning Research, 12:2121–2159.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Adaptive subgradient methods for online learning and stochastic optimization.Journal of Machine Learning Research, 12:2121–2159

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.064661Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 179524cd-0c4a-4d1c-8fd8-5fd2e8f6b635 · outbound

This paper cites Gradient Methods with Online Scaling.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Gradient Methods with Online Scaling

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.271819Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation d39c2aca-6146-4d45-8312-18a2e3589c15 · outbound

This paper cites Mamba: linear-time sequence modeling with selective state spaces.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Mamba: linear-time sequence modeling with selective state spaces

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.932409Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation ded44fa2-29b2-4507-b841-b664f1650f56 · outbound

This paper cites Efficiently modeling long sequences with structured state spaces.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Efficiently modeling long sequences with structured state spaces

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.048416Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 18483f44-47da-4b99-b044-4a32aedd418e · outbound

This paper cites Shampoo: Preconditioned stochastic tensor optimization.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Shampoo: Preconditioned stochastic tensor optimization

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.052506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation d2d86100-448d-4c90-bf2a-7c6ed1c0da7f · outbound

This paper cites Foundations and Trends in Optimiza- tion.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Foundations and Trends in Optimiza- tion

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.894539Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 8ab7e298-0eac-48b6-868f-43ebd07c5798 · outbound

This paper cites Logarithmic regret algorithms for online convex optimization.Machine Learning, 69(2–3):169–192.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Logarithmic regret algorithms for online convex optimization.Machine Learning, 69(2–3):169–192

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.966456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e827a593-b678-41e4-b8a5-15afeea5ad62 · outbound

This paper cites Repeat After Me: Transformers are Better than State Space Models at Copying.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Repeat After Me: Transformers are Better than State Space Models at Copying

Reference 25

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T19:09:23.228532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation c25b78e0-5af9-4fa5-9386-00c3081af1f2 · outbound

This paper cites Weld, and Luke Zettlemoyer.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Weld, and Luke Zettlemoyer

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.940588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e8c3b7dd-ee92-4eef-b3ea-9abab9a1f675 · outbound

This paper cites booktitle =.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention booktitle =

Reference 27

Resolution: verified exact; doi, observed 2026-05-14T19:09:22.586143Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 3ee733c8-aef7-48f8-ab4b-f9e3181b24bc · outbound

This paper cites Transformers are RNNs: fast autoregressive transformers with linear attention.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Transformers are RNNs: fast autoregressive transformers with linear attention

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:23.974524Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation d219082e-92e4-44d8-bf8e-46034e0185f5 · outbound

This paper cites Kingma and Jimmy Ba.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Kingma and Jimmy Ba

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.073306Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation c40e62bd-8d76-44cc-b068-d1c085ad3a5b · outbound

This paper cites Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.077458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 0abf3c40-dc84-46f5-bb25-9da99d2d1d29 · outbound

This paper cites Li, Berlin Chen, Caitlin Wang, Aviv Bick, J.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Li, Berlin Chen, Caitlin Wang, Aviv Bick, J

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.196712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 10393e13-0256-4df2-9522-87773b16eea1 · outbound

This paper cites Longhorn: State Space Models are Amortized Online Learners.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Longhorn: State Space Models are Amortized Online Learners

Reference 32

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T19:09:23.289556Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 65e95bc5-4b78-41f3-b131-ea9bde0c8076 · outbound

This paper cites In: Zong, C., Xia, F., Li, W., Navigli, R.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention In: Zong, C., Xia, F., Li, W., Navigli, R

Reference 33

Resolution: malformed identifier; doi_truncated, observed 2026-05-14T19:09:22.579443Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 4790f5bf-e1cd-4e5c-a8bb-5b990fbab71f · outbound

This paper cites Pointer sentinel mixture models.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Pointer sentinel mixture models

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.056090Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 43e6314e-b06a-481e-a568-123b7e7c592b · outbound

This paper cites In-context learning and induction heads.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention In-context learning and induction heads

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.028750Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 2db4ac37-a74c-4a38-a03a-9436ea3e6c61 · outbound

This paper cites Smith, Albert Gu, Anushan Fernando, Caglar Gulcehre, Razvan Pascanu, and Soham De.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Smith, Albert Gu, Anushan Fernando, Caglar Gulcehre, Razvan Pascanu, and Soham De

Reference 36

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.041138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 7eae3ae3-d960-45f9-a90b-c91c4bac1fdd · outbound

This paper cites The LAMBADA dataset: Word prediction requiring a broad discourse context.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention The LAMBADA dataset: Word prediction requiring a broad discourse context

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.096467Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 0a991653-d5d0-49f1-b695-27d69f554c88 · outbound

This paper cites Eagle and finch: RWKV with matrix-valued states and dynamic recurrence.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Eagle and finch: RWKV with matrix-valued states and dynamic recurrence

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.044428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 253eead6-9ef8-4bb2-af6b-8f8835b8f9d3 · outbound

This paper cites RWKV-7 "Goose" with Expressive Dynamic State Evolution.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention RWKV-7 "Goose" with Expressive Dynamic State Evolution

Reference 39

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.295141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 90ff2b7d-c1e7-4477-a917-4d1171c6bee3 · outbound

This paper cites Random feature attention.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Random feature attention

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.006203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation fb995803-ed8f-4864-befe-b9bda40fc0ef · outbound

This paper cites an unresolved cited work.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Unresolved cited work

Reference 41

Resolution: unresolved; raw_fallback, observed 2026-05-14T19:09:24.029107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 859c6f3c-9a96-4af4-b80b-a18c542fd3a7 · outbound

This paper cites Fu, Tri Dao, Stephen Baccus, Yoshua Bengio, Stefano Ermon, and Christopher Ré.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Fu, Tri Dao, Stephen Baccus, Yoshua Bengio, Stefano Ermon, and Christopher Ré

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.033820Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 7f7c4942-5d6a-49ab-8c8c-810f9225274b · outbound

This paper cites HGRN2: gated linear RNNs with state expansion.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention HGRN2: gated linear RNNs with state expansion

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.037342Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 160af0ae-55de-4745-a0d8-725a7434f862 · outbound

This paper cites Compressive Transformers for Long-Range Sequence Modelling.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Compressive Transformers for Long-Range Sequence Modelling

Reference 44

Resolution: metadata mismatch; arxiv_id, observed 2026-05-18T10:46:17.004740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e6512fbf-d4f7-4c70-adac-4f66723b4756 · outbound

This paper cites Hopfield networks is all you need.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Hopfield networks is all you need

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.091782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 00e198ec-794f-4367-ae0f-14b44fa56640 · outbound

This paper cites WinoGrande: An adversarial winograd schema challenge at scale.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention WinoGrande: An adversarial winograd schema challenge at scale

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.008839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation dd31857a-82b6-4847-806a-db47e63430f6 · outbound

This paper cites SocialIQA: Commonsense reasoning about social interactions.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention SocialIQA: Commonsense reasoning about social interactions

Reference 47

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.004235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 816370a2-13b1-4911-bc69-e6aba7ff2658 · outbound

This paper cites Linear Transformers Are Secretly Fast Weight Programmers.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Linear Transformers Are Secretly Fast Weight Programmers

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.016829Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 75f7db42-803c-4edf-a751-c531c7d76ea1 · outbound

This paper cites Learning to control fast-weight memories: An alternative to dynamic recurrent networks.Neural Computation, 4(1):131–139.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Learning to control fast-weight memories: An alternative to dynamic recurrent networks.Neural Computation, 4(1):131–139

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.040732Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation ed84d608-d368-4412-b36a-e11d03aabf11 · outbound

This paper cites Deltaproduct: Increasing the expressivity of DeltaNet through products of householders.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Deltaproduct: Increasing the expressivity of DeltaNet through products of householders

Reference 50

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.082072Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 26dc1ab6-5a67-4805-b536-5d68d649c88a · outbound

This paper cites Deltaproduct: Im- proving state-tracking in linear rnns via householder products.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Deltaproduct: Im- proving state-tracking in linear rnns via householder products

Reference 51

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.238354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 817d1e65-64db-4cd0-b883-d27f292d2fbc · outbound

This paper cites an unresolved cited work.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Unresolved cited work

Reference 52

Resolution: unresolved; raw_fallback, observed 2026-05-14T19:09:23.979209Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 8af78a6c-adc6-4c04-99d8-2e553be7b690 · outbound

This paper cites Smith, Andrew Warrington, and Scott Linderman.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Smith, Andrew Warrington, and Scott Linderman

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.010548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e6240edb-6b75-4970-979e-c063b8ff49cf · outbound

This paper cites Learning to (Learn at Test Time): RNNs with Expressive Hidden States.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Learning to (Learn at Test Time): RNNs with Expressive Hidden States

Reference 54

Resolution: verified exact; arxiv_id, observed 2026-05-15T05:20:12.625336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation a6fe2de6-eb62-493e-a282-cc49789afb42 · outbound

This paper cites Retentive Network: A Successor to Transformer for Large Language Models.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Retentive Network: A Successor to Transformer for Large Language Models

Reference 55

Resolution: verified exact; local_arxiv, observed 2026-05-14T19:09:23.250096Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation e761d600-933a-4fc7-852b-31713ddfe9d3 · outbound

This paper cites an unresolved cited work.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Unresolved cited work

Reference 56

Resolution: unresolved; raw_fallback, observed 2026-05-14T19:09:24.024821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 8ca0cdfa-c49d-4bc3-99bc-77bc73338eed · outbound

This paper cites Kimi Linear: An Expressive, Efficient Attention Architecture.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Kimi Linear: An Expressive, Efficient Attention Architecture

Reference 57

Resolution: verified exact; local_arxiv, observed 2026-05-14T19:09:23.258512Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 1361d8a7-4695-4e9b-8bb3-1fc76ada41be · outbound

This paper cites Transformers learn in-context by gradient descent.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Transformers learn in-context by gradient descent

Reference 58

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.049149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation a94d68b2-39ea-47a2-b82f-ffad56a48db6 · outbound

This paper cites Uncovering mesa-optimization algorithms in Transformers.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Uncovering mesa-optimization algorithms in Transformers

Reference 59

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T19:09:23.215404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 06ad3dd2-d404-4424-93ae-3790f54cf6ff · outbound

This paper cites MesaNet: Sequence Modeling by Locally Optimal Test-Time Training.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention MesaNet: Sequence Modeling by Locally Optimal Test-Time Training

Reference 60

Resolution: metadata mismatch; arxiv_id, observed 2026-06-04T02:07:39.171975Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation d27565d6-7a06-4351-b610-aceb41d9680a · outbound

This paper cites Test-time regression: a unifying framework for designing sequence models with associative memory.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Test-time regression: a unifying framework for designing sequence models with associative memory

Reference 61

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.253251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 078f8a98-665b-4ea6-94d4-91229a475bdf · outbound

This paper cites RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention RNNs are not Transformers (Yet): The Key Bottleneck on In-context Retrieval

Reference 62

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:09:23.202619Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation a98f0758-2165-4080-96a3-83058677a9de · outbound

This paper cites Gated Delta Networks: Improving Mamba2 with Delta Rule.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Gated Delta Networks: Improving Mamba2 with Delta Rule

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.037014Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 5cc6ed81-97c8-4b93-9656-21626eacdcc4 · outbound

This paper cites Gated Linear Attention Transformers with Hardware-Efficient Training.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Gated Linear Attention Transformers with Hardware-Efficient Training

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.053148Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 82f73bdf-b230-40b8-8b64-3994c7252bd2 · outbound

This paper cites Parallelizing linear transformers with the delta rule over sequence length.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Parallelizing linear transformers with the delta rule over sequence length

Reference 65

Resolution: verified exact; doi, observed 2026-05-14T19:09:22.584072Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation d7ebc376-0fc1-4393-804b-cf6ef047b5cb · outbound

This paper cites HellaSwag: Can a machine really finish your sentence? InAnnual Meeting of the Association for Computational Linguistics.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention HellaSwag: Can a machine really finish your sentence? InAnnual Meeting of the Association for Computational Linguistics

Reference 66

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.060990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 29449d3a-20c7-4455-9524-cc5fde0b5d70 · outbound

This paper cites Gated slot attention for efficient linear-time sequence modeling.Advances in Neural In- formation Processing Systems, 37:116870–116898, December 2024.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Gated slot attention for efficient linear-time sequence modeling.Advances in Neural In- formation Processing Systems, 37:116870–116898, December 2024

Reference 67

Resolution: malformed identifier; raw_fallback, observed 2026-05-14T19:09:24.069176Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation f6b706fa-e28f-483c-9104-1b30d3d72178 · outbound

This paper cites Online convex programming and generalized infinitesimal gradient ascent.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Online convex programming and generalized infinitesimal gradient ascent

Reference 68

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.057086Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 4a2d5b75-d98d-44e6-b79b-2435ce7907fe · outbound

This paper cites Since βt ∈(0,1) , the power-mean inequality givesP i(kt)4 i ≤ P i(kt)2 i 2 = 1.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Since βt ∈(0,1) , the power-mean inequality givesP i(kt)4 i ≤ P i(kt)2 i 2 = 1

Reference 69

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.021041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 096ded70-b4ed-4e4f-b10d-d6fbf0199858 · outbound

This paper cites Conditional algorithmic regret.Let D ⊂R K be a closed convex set containing the algorithmic iterates {dt}.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Conditional algorithmic regret.Let D ⊂R K be a closed convex set containing the algorithmic iterates {dt}

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T19:09:24.060482Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 18fe0eb5-af9c-4db4-a87f-fc26f6cbab0e · outbound

This paper cites an unresolved cited work.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Unresolved cited work

Reference 71

Resolution: unresolved; raw_fallback, observed 2026-05-14T19:09:24.087457Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 2b1e93e9-eaf7-48b3-bdcc-db00b5279902 · outbound

This paper cites an unresolved cited work.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention Unresolved cited work

Reference 72

Resolution: unresolved; raw_fallback, observed 2026-05-14T19:09:24.017926Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Observation 51724e93-1463-40e9-a015-4d167799979e · outbound

This paper cites single” averages FDA, SWDE, and SQuAD, while “repeated.

OSDN: Improving Delta Rule with Provable Online Preconditioning in Linear Attention single” averages FDA, SWDE, and SQuAD, while “repeated

Reference 73

Resolution: malformed identifier; arxiv_id, observed 2026-05-14T19:09:23.216187Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-06T06:34:29.942622+00:00.

Coverage vector

Reference resolution

Outbound references

Pith citing papers