REVIEW 2 major objections 2 minor 39 cited by
From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs
T0 review · 2 major / 2 minor · reviewed 2026-05-17 · grok-4.3
Pith's one-line read This survey connects categories of human memory to memory in LLM-based AI systems and introduces a three-dimension eight-quadrant framework to organize the field.
desk verdict A useful but modest survey that maps human memory categories onto LLM techniques and offers a three-dimension eight-quadrant taxonomy without strong evidence that the scheme is independent or generative. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The three dimensions of object, form, and time, which divide memory mechanisms into eight quadrants, serving as the organizing framework that links human memory insights to AI memory implementations.
What would settle it
An experiment showing that LLM memory designs based on this human memory mapping and quadrant categorization do not outperform existing ad-hoc approaches in retaining and using past information effectively.
Extended reading notes
Core claim
By conducting a detailed analysis of human memory categories and relating them directly to the memory of AI systems, and by systematically organizing existing memory-related work into a categorization based on three dimensions of object, form, and time that results in eight quadrants, this survey provides a comprehensive view that can inspire the construction of more powerful memory mechanisms for LLM-driven AI systems.
Load-bearing premise
That analyzing human memory categories and mapping them to AI memory, along with the proposed three-dimension eight-quadrant categorization, will lead to actionable insights for building improved memory mechanisms in large language models.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript surveys memory mechanisms in LLM-driven AI systems. It first analyzes categories of human memory (episodic, semantic, procedural, short-term, long-term) and relates them to AI memory components such as context windows, parametric knowledge, RAG, and external stores. It then organizes existing literature via a proposed three-dimension (object, form, time) eight-quadrant taxonomy and concludes with open problems and future directions for memory design inspired by human cognition.
Significance. If the taxonomy proves robust and the human-to-AI mapping yields design guidance beyond existing enumerations of context extension and retrieval methods, the survey could help structure research on persistent, adaptive memory in LLMs. The explicit bridging of cognitive categories to engineered mechanisms is a potential strength, provided the framework demonstrates independence of dimensions and identifies implementable improvements.
major comments (2)
- [Abstract and §2] Abstract and §2 (human memory analysis): the direct mapping of human categories (e.g., episodic memory) onto LLM mechanisms (e.g., context windows or external vector stores) is presented as inspirational without addressing core mismatches in consolidation and interference mechanisms; this mapping is load-bearing for the claim that human memory can guide construction of more powerful AI systems.
- [§3] §3 (proposed categorization): the assertion that the three dimensions (object, form, time) are sufficiently independent to generate eight meaningful quadrants lacks explicit justification or empirical check for orthogonality; if form is largely determined by object or time in current LLM architectures (parametric vs. retrieval-based), the scheme reduces to fewer effective dimensions and undermines the organizational contribution.
minor comments (2)
- [Introduction] The literature search protocol, databases, and inclusion/exclusion criteria are not stated, which is required for a systematic survey to allow assessment of coverage and bias.
- [§3] Figure or table illustrating the eight quadrants would improve clarity; currently the dimensions are described only textually.
Simulated Author's Rebuttal
We thank the referee for the constructive and detailed feedback. We address each major comment below and indicate where we will revise the manuscript to strengthen the presentation of the human-to-AI mapping and the proposed taxonomy.
read point-by-point responses
-
Referee: [Abstract and §2] Abstract and §2 (human memory analysis): the direct mapping of human categories (e.g., episodic memory) onto LLM mechanisms (e.g., context windows or external vector stores) is presented as inspirational without addressing core mismatches in consolidation and interference mechanisms; this mapping is load-bearing for the claim that human memory can guide construction of more powerful AI systems.
Authors: We agree that the current treatment would be improved by explicitly discussing mismatches between biological and artificial memory. While the mapping is intended as inspirational rather than literal, we will revise §2 to add a short subsection on limitations of the analogy. This subsection will cover differences in consolidation (e.g., human offline replay and synaptic consolidation versus LLM fine-tuning or retrieval augmentation) and interference management (e.g., biological forgetting curves versus LLM techniques such as memory editing or selective context truncation). The revision will clarify the scope of the design guidance while preserving the high-level parallels that motivate the survey. revision: yes
-
Referee: [§3] §3 (proposed categorization): the assertion that the three dimensions (object, form, time) are sufficiently independent to generate eight meaningful quadrants lacks explicit justification or empirical check for orthogonality; if form is largely determined by object or time in current LLM architectures (parametric vs. retrieval-based), the scheme reduces to fewer effective dimensions and undermines the organizational contribution.
Authors: We thank the referee for highlighting the need for stronger justification. In the revised §3 we will add a paragraph explaining the conceptual independence of the three dimensions: 'object' concerns the nature of the stored content, 'form' concerns the representation mechanism, and 'time' concerns retention duration. We will also provide an empirical check by tabulating the distribution of the surveyed papers across the eight quadrants, showing that all quadrants contain distinct contributions and are not trivially reducible. Where current architectures exhibit correlations between dimensions, we will note these as open challenges rather than assuming perfect orthogonality. revision: yes
Circularity Check
Survey proposes taxonomy with no derivation chain or self-referential reduction
full rationale
This is a literature survey paper with no mathematical derivations, equations, fitted parameters, or predictions. The core contribution is an analysis of human memory categories mapped to AI systems plus a proposed three-dimension (object, form, time) eight-quadrant organizational scheme for existing work. These are descriptive and constructive proposals resting on external citations rather than any internal definition that reduces to itself or a self-citation load-bearing premise. No step in the provided abstract or described structure exhibits the enumerated circularity patterns; the taxonomy is presented as an independent organizing framework, not derived from or equivalent to its inputs by construction.
Assumptions & free parameters
assumptions (1)
- domain assumption Human memory categories can be meaningfully related to memory mechanisms in LLM-driven AI systems.
Cite this review
Pith. "Pith review of From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs." pith.science (2026). https://pith.science/paper/6NNSXFBK
@misc{pith2026250415965,
author = {Pith},
title = {Pith review of: From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs},
year = {2026},
howpublished = {\url{https://pith.science/paper/6NNSXFBK}},
note = {Machine review of arXiv:2504.15965}
}
read the original abstract
Memory is the process of encoding, storing, and retrieving information, allowing humans to retain experiences, knowledge, skills, and facts over time, and serving as the foundation for growth and effective interaction with the world. It plays a crucial role in shaping our identity, making decisions, learning from past experiences, building relationships, and adapting to changes. In the era of large language models (LLMs), memory refers to the ability of an AI system to retain, recall, and use information from past interactions to improve future responses and interactions. Although previous research and reviews have provided detailed descriptions of memory mechanisms, there is still a lack of a systematic review that summarizes and analyzes the relationship between the memory of LLM-driven AI systems and human memory, as well as how we can be inspired by human memory to construct more powerful memory systems. To achieve this, in this paper, we propose a comprehensive survey on the memory of LLM-driven AI systems. In particular, we first conduct a detailed analysis of the categories of human memory and relate them to the memory of AI systems. Second, we systematically organize existing memory-related work and propose a categorization method based on three dimensions (object, form, and time) and eight quadrants. Finally, we illustrate some open problems regarding the memory of current AI systems and outline possible future directions for memory in the era of large language models.
Forward citations
Cited by 39 Pith papers
-
Recalling Too Well: Sycophancy Evaluation and Mitigation in Memory-Augmented Models
Memory augmentation in LLMs amplifies sycophancy up to 25x compared to in-context baselines due to lossy memory extraction, with two lightweight mitigations that reduce the effect while preserving recall.
-
Insecure Coding Preferences in Long-Term Memory: Security Risks for LLM-based Code Generation
Injected insecure coding preferences in LLM long-term memory raise vulnerability rates by 2.7-50.3 pp and suppress warnings; memory-level filtering restores safe behavior in the tested set.
-
User as Engram: Internalizing Per-User Memory as Local Parametric Edits
User facts are internalized as surgical local edits to a hash-keyed Engram memory table with reasoning skill held in a shared adapter, claimed to match LoRA recall, improve indirect reasoning 5.6x on average, and comp...
-
Goal-Oriented Reasoning for RAG-based Memory in Conversational Agentic LLM Systems
Goal-Mem improves RAG memory retrieval in agentic LLMs by explicit goal decomposition and backward chaining via Natural Language Logic, outperforming nine baselines on multi-hop and implicit inference tasks.
-
Memory in the Loop: In-Process Retrieval as Extended Working Memory for Language Agents
Store latency, not architecture, gates per-step memory access; in-process ~100 µs stores make memory-in-the-loop feasible and causally reduce redundant agent actions.
-
MESA:Task-Adaptive Multi-Structure Evidence Selection for Long-Horizon Agent Memory
MESA learns a query-adaptive subset of five memory structures for long-horizon agents, beating AMA-Agent by 8.5 points on AMA-Bench while using 41% fewer evidence tokens than reading all structures.
-
Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
Injecting hierarchical teacher memories (workflow, subtask, function) into small agents improves tool-use accuracy by 27.2pp, 11.2pp, and 3.4pp on AppWorld, BFCL V3, and ToolSandbox without training.
-
FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory
FocusMem factorizes latent GUI memory into a role-aware content basis, a state-conditioned readout, and a trust gate, improving frozen-policy web-agent success rates over fixed latent-memory baselines on five benchmarks.
-
LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
By routing dialogue segments into profile, event, and record memory, updating only events, and planning retrieval per query, LeanMem reports accuracy gains up to 15.1 points over memory baselines at lower cost.
-
MemSIF: From Structured Interactions to Dual-Track Fact Memory for LLM Agents
MemSIF improves long-term LLM agent memory by combining structured interaction organization with dual-track fact memory, reporting top Total ACC on LoCoMo and LongMemEval-S across five backbones.
-
Do Agents Dream of False Memories? Black-box Visual Attacks on Long-term Memory in Multimodal AI Agents
Lucid shows that imperceptible image perturbations can make multimodal agents misremember past events with 61.6% poisoning and 58.4% injection success.
-
IFCMemoryBench: Evaluating Long-Term Memory of LLM-Based Agents in BIM Information Retrieval
IFCMemoryBench gives LLM agents 4,016 prior chat sessions plus live IFC model queries; the best vector-, graph-, or file-based memory system reaches only 32.4% answer accuracy, versus 83.2% when all relevant user mess...
-
MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference
Region-labeled tokens in LLM agent traces have order-of-magnitude different attention lifetimes, and a decay-plus-pinning eviction policy preserves system facts under fixed KV budgets while recency collapses as context grows.
-
NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
Repurposing a VLA’s vision encoder to emit one action-supervised memory token per historical frame-view yields long-horizon manipulation with large success gains and low latency.
-
AgentMemBench: A Systematic Benchmark for Evaluating Long-Term Memory Management Strategies in Conversational AI Agents
A benchmark comparing five memory strategies for conversational agents on three public datasets finds dense vector retrieval alone maintains long-range recall, at roughly 25 times the token cost of recency windows.
-
The Containment Gap: How Deployed Agentic AI Frameworks Fail Public-Facing Safety Requirements
No major agentic AI framework complies with six safety containment principles; a memory poisoning attack on LangChain causes persistent targeted errors up to 88.9% wrongful denials and 3.5x increase under complex poli...
-
REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs
REAL represents long-term LLM memory as a temporal confidence-aware directed property graph with non-destructive updates and uses evaluator-guided beam search plus counterfactual inference for retrieval, reporting 22....
-
DeferMem: Query-Time Evidence Distillation via Reinforcement Learning for Long-Term Memory QA
DeferMem decouples memory QA into high-recall retrieval and RL-based query-conditioned evidence distillation, outperforming baselines on LoCoMo and LongMemEval-S with highest accuracy, fastest runtime, and zero API to...
-
Remembering More, Risking More: Longitudinal Safety Risks in Memory-Equipped LLM Agents
Memory-equipped LLM agents exhibit increasing safety violation rates as memory accumulates across independent tasks, termed temporal memory contamination, detected via a new trigger-probe protocol.
-
Sycophantic AI makes human interaction feel more effortful and less satisfying over time
Sycophantic AI delivers quick emotional support like friends but over weeks shifts users toward AI for advice and reduces satisfaction with real human interactions.
-
Position: Modular Memory is the Key to Continual Learning Agents
A modular memory combining in-context learning and in-weight learning is proposed as the key to continual learning agents.
-
The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
Survey that defines agentic RL for LLMs via POMDPs, introduces a taxonomy of planning/tool-use/memory/reasoning capabilities and domains, and compiles open environments from over 500 papers.
-
StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns
StoryBench introduces a branching interactive-fiction benchmark with immediate-feedback and self-recovery modes, and shows that current LLMs fail at long-term memory tasks, especially self-correction.
-
On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models
A PRISMA-based survey of 85 papers shows agentic LLM security research is attack-heavy and perception-focused, leaving action-layer and code-execution risks understudied.
-
MemTxn: A Transaction Boundary for Source-Supported Updates and Complete-State Recovery in Agent Memory
MemTxn places a transaction boundary around agent memory, validating writes against their source, resolving conflicts by chronology, and snapshotting state for full recovery.
-
PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
An append-only game log searched by a coding agent with grep/Python matches specialized ARC-AGI-3 harnesses while using 4-6x fewer tokens.
-
PriorEye: Geospatial Visual Priors for End-to-End Autonomous Driving
PriorEye augments end-to-end driving models with a dual-memory architecture that stores and gates geospatial visual priors to improve performance and robustness to sensor corruption on NAVSIM-v2.
-
MemSlides: A Hierarchical Memory Driven Agent Framework for Personalized Slide Generation with Multi-turn Local Revision
MemSlides introduces a three-part memory hierarchy (user profile, working, tool) with scoped local revision for multi-turn personalized slide generation.
-
MOSAIC: Efficient Mixture-of-Agent Scheduling via Adaptive Aggregation and Inference Concurrency
MOSAIC uses an Integer Linear Program scheduler for expert placement and prompt assignment plus adaptive aggregation to achieve 1.7-2.3x end-to-end speedup on 4-GPU MoA workloads while keeping accuracy within 0.1pp.
-
Code as Agent Harness
A survey that organizes existing work on LLM-based agents around code as the central harness, structured in three layers of interfaces, mechanisms, and multi-agent scaling, with applications across domains and listed ...
-
VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
VLAMotor exposes VLA failures via distance-aware uncertainty testing and synthesizes agent-planned repair data to fine-tune models, reporting 49.25% success rate gains in simulation and 57.5% on hardware.
-
MemTool: Optimizing Short-Term Memory Management for Dynamic Tool Calling in LLM Agent Multi-Turn Conversations
MemTool is a short-term memory framework with three modes (autonomous, workflow, hybrid) that lets LLM agents add and remove tools across multi-turn conversations, evaluated over 100 turns on 13+ models.
-
Memory OS of AI Agent
A hierarchical short/mid/long-term memory system with OS-style segmented paging and heat-based eviction improves LLM response accuracy on long-conversation benchmarks.
-
Applying Cognitive Design Patterns to General LLM Agents
Cognitive design patterns from classic architectures reveal that mainstream LLM agents lack explicit commitment, encoding-specific episodic memory, and online knowledge compilation, pointing to concrete research directions.
-
Memory for Large Language Models
The paper organizes LLM memory architectures along three axes—implicit vs explicit representation, offline vs online update, and short vs long-term persistence—plus finer-grained update rules.
-
Contextual Memory Intelligence -- A Foundational Paradigm for Human-AI Collaboration and Reflective Generative AI Systems
Contextual Memory Intelligence reframes memory as dynamic infrastructure and proposes the Insight Layer to preserve decision rationale, detect semantic drift, and support human-in-the-loop reflection.
-
MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
A unified memory-operating-system design for LLMs, built around a MemCube abstraction, is presented without any experimental validation.
-
Rethinking Agentic Reinforcement Learning In Large Language Models
This review synthesizes conceptual foundations, methods, challenges, and future directions for agentic reinforcement learning in large language models.
-
Memory-Augmented Transformers: A Systematic Review from Neuroscience Principles to Enhanced Model Architectures
Memory-augmented Transformer research is organized into a three-axis taxonomy bridging neuroscience memory concepts to network designs, but no new result is produced.
Reference graph
Works this paper leans on
-
[1]
A survey on large language model based autonomous agents
Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6):186345, 2024
work page 2024
-
[2]
Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, et al. Personal llm agents: Insights and survey about the capability, efficiency and security. arXiv preprint arXiv:2401.05459, 2024
work page Pith review arXiv 2024
-
[3]
A Survey of Large Language Models
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. A survey of large language models. arXiv preprint arXiv:2303.18223, 1(2), 2023
work page Pith review arXiv 2023
-
[4]
A survey on evaluation of large language models
Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, et al. A survey on evaluation of large language models. ACM transactions on intelligent systems and technology, 15(3):1–45, 2024
work page 2024
-
[5]
All roads lead to rome: Unveiling the trajectory of recommender systems across the llm era
Bo Chen, Xinyi Dai, Huifeng Guo, Wei Guo, Weiwen Liu, Yong Liu, Jiarui Qin, Ruiming Tang, Yichao Wang, Chuhan Wu, et al. All roads lead to rome: Unveiling the trajectory of recommender systems across the llm era. arXiv preprint arXiv:2407.10081, 2024
-
[6]
Chen Zhang, Xinyi Dai, Yaxiong Wu, Qu Yang, Yasheng Wang, Ruiming Tang, and Yong Liu. A survey on multi-turn interaction capabilities of large language models. arXiv preprint arXiv:2501.09959, 2025
-
[7]
A Survey on the Memory Mechanism of Large Language Model based Agents
Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. A survey on the memory mechanism of large language model based agents. arXiv preprint arXiv:2404.13501, 2024
work page Pith review arXiv 2024
-
[8]
arXiv preprint arXiv:2410.15665 , year=
Xun Jiang, Feng Li, Han Zhao, Jiaying Wang, Jun Shao, Shihao Xu, Shu Zhang, Weiling Chen, Xavier Tang, Yize Chen, et al. Long term memory: The foundation of ai self-evolution. arXiv preprint arXiv:2410.15665, 2024
Show all 155 references
-
[9]
Human physiology: from cells to systems
Lauralee Sherwood, Robert Thomas Kell, and Christopher Ward. Human physiology: from cells to systems. Thomson/Brooks/Cole, 2004
2004
-
[10]
Llm-powered autonomous agents
Lilian Weng. Llm-powered autonomous agents. lilianweng.github.io, Jun 2023
2023
-
[11]
Why we forget and how to remember better: the science behind memory
Andrew E Budson and Elizabeth A Kensinger. Why we forget and how to remember better: the science behind memory. Oxford University Press, 2023
2023
-
[12]
Working memory, thought, and action, volume 45
Alan Baddeley. Working memory, thought, and action, volume 45. OuP Oxford, 2007. 17
2007
-
[13]
Hipporag: Neurobiologically inspired long-term memory for large language models
Bernal Jiménez Gutiérrez, Yiheng Shu, Yu Gu, Michihiro Yasunaga, and Yu Su. Hipporag: Neurobiologically inspired long-term memory for large language models. arXiv preprint arXiv:2405.14831, 2024
2024
-
[14]
Exploring synaptic resonance in large language models: A novel approach to contextual memory integration
George Applegarth, Christian Weatherstone, Maximilian Hollingsworth, Henry Middlebrook, and Marcus Irvin. Exploring synaptic resonance in large language models: A novel approach to contextual memory integration. arXiv preprint arXiv:2502.10699, 2025
2025
-
[15]
Key-value memory in the brain.arXiv preprint arXiv:2501.02950, 2025
Samuel J Gershman, Ila Fiete, and Kazuki Irie. Key-value memory in the brain.arXiv preprint arXiv:2501.02950, 2025
2025
-
[16]
Ad- vances and challenges in foundation agents: From brain-inspired intelligence to evolutionary, collaborative, and safe systems, 2025
Bang Liu, Xinfeng Li, Jiayi Zhang, Jinlin Wang, Tanjin He, Sirui Hong, Hongzhang Liu, Shaokun Zhang, Kaitao Song, Kunlun Zhu, Yuheng Cheng, Suyuchen Wang, Xiaoqiang Wang, Yuyu Luo, Haibo Jin, Peiyan Zhang, Ollie Liu, Jiaqi Chen, Huan Zhang, Zhaoyang Yu, Haochen Shi, Boyan Li, ...
2025
-
[17]
Memorybank: Enhanc- ing large language models with long-term memory
Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang. Memorybank: Enhanc- ing large language models with long-term memory. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19724–19731, 2024
2024
-
[18]
Memory and new controls for chatgpt
OpenAI. Memory and new controls for chatgpt. openai.com, February 2024
2024
-
[19]
Introducing apple intelligence, the personal intelligence system that puts powerful generative models at the core of iphone, ipad, and mac
Apple. Introducing apple intelligence, the personal intelligence system that puts powerful generative models at the core of iphone, ipad, and mac. apple.com, June 2024
2024
-
[20]
mem0: The memory layer for personalized ai
mem0ai. mem0: The memory layer for personalized ai. mem0.ai, July 2024
2024
-
[21]
Memoryscope: Equip your llm chatbot with a powerful and flexible long term memory system
ModelScope. Memoryscope: Equip your llm chatbot with a powerful and flexible long term memory system. github.com, September 2024
2024
-
[22]
Human memory: A proposed system and its control processes
Richard C Atkinson and Richard M Shiffrin. Human memory: A proposed system and its control processes. In Psychology of learning and motivation, volume 2, pages 89–195. Else- vier, 1968
1968
-
[23]
Chain-of-thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824–24837, 2022
2022
-
[24]
React: Synergizing reasoning and acting in language models
Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629, 2022
2022 arXiv
-
[25]
Retrieval- augmented generation for knowledge-intensive nlp tasks
Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. Retrieval- augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing system...
2020
-
[26]
Introducing chatgpt
OpenAI. Introducing chatgpt. openai.com, November 2022
2022
-
[27]
Deepseek-v3 technical report
Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et al. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437, 2024
2024 arXiv
-
[28]
Introducing claude
Anthropic. Introducing claude. anthropic.com, March 2023
2023
-
[29]
Qwen technical report.arXiv preprint arXiv:2309.16609, 2023
Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. Qwen technical report.arXiv preprint arXiv:2309.16609, 2023. 18
2023 arXiv
-
[30]
Llama 2: Open foundation and fine-tuned chat models
Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023
2023 arXiv
-
[31]
Gemini: a family of highly capable multimodal models
Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Sori- cut, Johan Schalkwyk, Andrew M Dai, Anja Hauth, Katie Millican, et al. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805, 2023
2023 arXiv
-
[32]
Pangu-bot: Efficient generative dialogue pre-training from pre-trained language model
Fei Mi, Yitong Li, Yulong Zeng, Jingyan Zhou, Yasheng Wang, Chuanfei Xu, Lifeng Shang, Xin Jiang, Shiqi Zhao, and Qun Liu. Pangu-bot: Efficient generative dialogue pre-training from pre-trained language model. arXiv preprint arXiv:2203.17090, 2022
2022
-
[33]
Chatglm: A family of large language models from glm-130b to glm-4 all tools
Team GLM, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Dan Zhang, Diego Rojas, Guanyu Feng, Hanlin Zhao, et al. Chatglm: A family of large language models from glm-130b to glm-4 all tools. arXiv preprint arXiv:2406.12793, 2024
2024 arXiv
-
[34]
Openas- sistant conversations-democratizing large language model alignment
Andreas Köpf, Yannic Kilcher, Dimitri V on Rütte, Sotiris Anagnostidis, Zhi Rui Tam, Keith Stevens, Abdullah Barhoum, Duc Nguyen, Oliver Stanley, Richárd Nagyfi, et al. Openas- sistant conversations-democratizing large language model alignment. Advances in Neural Information P...
2023
-
[35]
Recall overview
Microsoft. Recall overview. microsoft.com, February 2025
2025
-
[36]
Ai-native memory: A pathway from llms towards agi
Jingbo Shang, Zai Zheng, Jiale Wei, Xiang Ying, Felix Tao, and Mindverse Team. Ai-native memory: A pathway from llms towards agi. arXiv preprint arXiv:2406.18312, 2024
2024
-
[37]
Beyond short-term memory: How memary makes chatbots remember
Memary. Beyond short-term memory: How memary makes chatbots remember. github.com, April 2024
2024
-
[38]
Langgraph memory service
langchain ai. Langgraph memory service. github.com, October 2024
2024
-
[39]
Charlie mnemonic
GoodAI. Charlie mnemonic. github.com, March 2024
2024
-
[40]
Memobase: User profile-based memory for genai apps
memodb io. Memobase: User profile-based memory for genai apps. memobase.io, January 2025
2025
-
[41]
Letta-AI. Letta. github.com, September 2024
2024
-
[42]
Cognee.ai. Cognee. github.com, October 2024
2024
-
[43]
Prompted llms as chatbot modules for long open-domain conversation
Gibbeum Lee, V olker Hartmann, Jongho Park, Dimitris Papailiopoulos, and Kangwook Lee. Prompted llms as chatbot modules for long open-domain conversation. arXiv preprint arXiv:2305.04533, 2023
2023
-
[44]
Ret-llm: Towards a general read-write memory for large language models
Ali Modarressi, Ayyoob Imani, Mohsen Fayyaz, and Hinrich Schütze. Ret-llm: Towards a general read-write memory for large language models. arXiv preprint arXiv:2305.14322, 2023
2023
-
[45]
Memgpt: Towards llms as operating systems
Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G Patil, Ion Stoica, and Joseph E Gonzalez. Memgpt: Towards llms as operating systems. arXiv preprint arXiv:2310.08560, 2023
2023 arXiv
-
[46]
Knowledge graph tuning: Real-time large language model personalization based on human feedback
Jingwei Sun, Zhixu Du, and Yiran Chen. Knowledge graph tuning: Real-time large language model personalization based on human feedback. arXiv preprint arXiv:2405.19686, 2024
2024
-
[47]
Person- alized large language model assistant with evolving conditional memory
Ruifeng Yuan, Shichao Sun, Yongqi Li, Zili Wang, Ziqiang Cao, and Wenjie Li. Person- alized large language model assistant with evolving conditional memory. arXiv preprint arXiv:2312.17257, 2023
2023
-
[48]
On memory construction and retrieval for personalized conversational agents
Zhuoshi Pan, Qianhui Wu, Huiqiang Jiang, Xufang Luo, Hao Cheng, Dongsheng Li, Yuqing Yang, Chin-Yew Lin, H Vicky Zhao, Lili Qiu, et al. On memory construction and retrieval for personalized conversational agents. arXiv preprint arXiv:2502.05589, 2025. 19
2025
-
[49]
Memory3: Language modeling with explicit memory
Hongkang Yang, Zehao Lin, Wenjin Wang, Hao Wu, Zhiyu Li, Bo Tang, Wenqiang Wei, Jinbo Wang, Zeyun Tang, Shichao Song, et al. Memory3: Language modeling with explicit memory. arXiv preprint arXiv:2407.01178, 2024
2024
-
[50]
Meminsight: Autonomous memory augmentation for llm agents
Rana Salama, Jason Cai, Michelle Yuan, Anna Currey, Monica Sunkara, Yi Zhang, and Yassine Benajiba. Meminsight: Autonomous memory augmentation for llm agents. arXiv preprint arXiv:2503.21760, 2025
2025
-
[51]
Memochat: Tuning llms to use memos for consistent long-range open-domain conversation
Junru Lu, Siyu An, Mingbao Lin, Gabriele Pergola, Yulan He, Di Yin, Xing Sun, and Yun- sheng Wu. Memochat: Tuning llms to use memos for consistent long-range open-domain conversation. arXiv preprint arXiv:2308.08239, 2023
2023
-
[52]
In prospect and retrospect: Reflective memory manage- ment for long-term personalized dialogue agents
Zhen Tan, Jun Yan, I Hsu, Rujun Han, Zifeng Wang, Long T Le, Yiwen Song, Yanfei Chen, Hamid Palangi, George Lee, et al. In prospect and retrospect: Reflective memory manage- ment for long-term personalized dialogue agents. arXiv preprint arXiv:2503.08026, 2025
2025
-
[53]
Hello again! llm-powered personalized agent for long-term dialogue
Hao Li, Chenghao Yang, An Zhang, Yang Deng, Xiang Wang, and Tat-Seng Chua. Hello again! llm-powered personalized agent for long-term dialogue. arXiv preprint arXiv:2406.05925, 2024
2024
-
[54]
A-mem: Agentic memory for llm agents
Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, and Yongfeng Zhang. A-mem: Agentic memory for llm agents. arXiv preprint arXiv:2502.12110, 2025
2025 arXiv
-
[55]
Generative agents: Interactive simulacra of human behavior
Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Pro- ceedings of the 36th annual acm symposium on user interface software and technology, pages 1–22, 2023
2023
-
[56]
Crafting personalized agents through retrieval-augmented generation on editable memory graphs
Zheng Wang, Zhongyang Li, Zeren Jiang, Dandan Tu, and Wei Shi. Crafting personalized agents through retrieval-augmented generation on editable memory graphs. arXiv preprint arXiv:2409.19401, 2024
2024
-
[57]
Recursively summarizing enables long-term dialogue memory in large language models
Qingyue Wang, Liang Ding, Yanan Cao, Zhiliang Tian, Shi Wang, Dacheng Tao, and Li Guo. Recursively summarizing enables long-term dialogue memory in large language models. arXiv preprint arXiv:2308.15022, 2023
2023
-
[58]
Compress to im- press: Unleashing the potential of compressive memory in real-world long-term conversa- tions
Nuo Chen, Hongguang Li, Juhua Huang, Baoyuan Wang, and Jia Li. Compress to im- press: Unleashing the potential of compressive memory in real-world long-term conversa- tions. arXiv preprint arXiv:2402.11975, 2024
2024
-
[59]
Chatdb: Aug- menting llms with databases as their symbolic memory
Chenxu Hu, Jie Fu, Chenzhuang Du, Simian Luo, Junbo Zhao, and Hang Zhao. Chatdb: Aug- menting llms with databases as their symbolic memory. arXiv preprint arXiv:2306.03901 , 2023
2023
-
[60]
my agent understands me better
Yuki Hou, Haruki Tamoto, and Homei Miyashita. " my agent understands me better": In- tegrating dynamic human-like memory recall and consolidation in llm-based agents. In Ex- tended Abstracts of the CHI Conference on Human Factors in Computing Systems, pages 1–7, 2024
2024
-
[61]
From rag to memory: Non-parametric continual learning for large language models
Bernal Jiménez Gutiérrez, Yiheng Shu, Weijian Qi, Sizhe Zhou, and Yu Su. From rag to memory: Non-parametric continual learning for large language models. arXiv preprint arXiv:2502.14802, 2025
2025 arXiv
-
[62]
Egolife: Towards egocentric life assistant
Jingkang Yang, Shuai Liu, Hongming Guo, Yuhao Dong, Xiamengwei Zhang, Sicheng Zhang, Pengyun Wang, Zitang Zhou, Binzhu Xie, Ziyue Wang, et al. Egolife: Towards egocentric life assistant. arXiv preprint arXiv:2503.03803, 2025
2025
-
[63]
Memocrs: Memory-enhanced sequential conversational recommender systems with large language models
Yunjia Xi, Weiwen Liu, Jianghao Lin, Bo Chen, Ruiming Tang, Weinan Zhang, and Yong Yu. Memocrs: Memory-enhanced sequential conversational recommender systems with large language models. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Manage...
2024
-
[64]
Recmind: Large language model powered agent for recommendation
Yancheng Wang, Ziyan Jiang, Zheng Chen, Fan Yang, Yingxue Zhou, Eunah Cho, Xing Fan, Xiaojiang Huang, Yanbin Lu, and Yingzhen Yang. Recmind: Large language model powered agent for recommendation. arXiv preprint arXiv:2308.14296, 2023
2023
-
[65]
Recagent: A novel simulation paradigm for recommender systems
Lei Wang, Jingsen Zhang, Xu Chen, Yankai Lin, Ruihua Song, Wayne Xin Zhao, and Ji-Rong Wen. Recagent: A novel simulation paradigm for recommender systems. arXiv preprint arXiv:2306.02552, 2023
2023
-
[66]
Recommender ai agent: Integrating large language models for interactive recommendations
Xu Huang, Jianxun Lian, Yuxuan Lei, Jing Yao, Defu Lian, and Xing Xie. Recommender ai agent: Integrating large language models for interactive recommendations. arXiv preprint arXiv:2308.16505, 2023
2023
-
[67]
Enhancing large language model with self-controlled memory frame- work
Bing Wang, Xinnian Liang, Jian Yang, Hui Huang, Shuangzhi Wu, Peihao Wu, Lu Lu, Zejun Ma, and Zhoujun Li. Enhancing large language model with self-controlled memory frame- work. arXiv preprint arXiv:2304.13343, 2023
2023
-
[68]
Chatdev: Communicative agents for software develop- ment, 2024
Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, et al. Chatdev: Communicative agents for software develop- ment, 2024. URL https://arxiv. org/abs/2307, 7924, 2024
2024
-
[69]
Metaagents: Simulating interactions of human behaviors for llm-based task-oriented coordination via collaborative generative agents
Yuan Li, Yixuan Zhang, and Lichao Sun. Metaagents: Simulating interactions of human behaviors for llm-based task-oriented coordination via collaborative generative agents. arXiv preprint arXiv:2310.06500, 2023
2023
-
[70]
S 3: Social-network simulation system with large language model- empowered agents
Chen Gao, Xiaochong Lan, Zhihong Lu, Jinzhu Mao, Jinghua Piao, Huandong Wang, De- peng Jin, and Yong Li. S 3: Social-network simulation system with large language model- empowered agents. arXiv preprint arXiv:2307.14984, 2023
2023
-
[71]
Tradinggpt: Multi- agent system with layered memory and distinct characters for enhanced financial trading per- formance
Yang Li, Yangyang Yu, Haohang Li, Zhi Chen, and Khaldoun Khashanah. Tradinggpt: Multi- agent system with layered memory and distinct characters for enhanced financial trading per- formance. arXiv preprint arXiv:2309.03736, 2023
2023
-
[72]
Memolet: Reifying the reuse of user-ai conversational memories
Ryan Yen and Jian Zhao. Memolet: Reifying the reuse of user-ai conversational memories. In Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, pages 1–22, 2024
2024
-
[73]
Memreasoner: A memory-augmented llm architecture for multi-hop reasoning
Ching-Yun Ko, Sihui Dai, Payel Das, Georgios Kollias, Subhajit Chaudhury, and Aurelie Lozano. Memreasoner: A memory-augmented llm architecture for multi-hop reasoning. In The First Workshop on System-2 Reasoning at Scale, NeurIPS’24, 2024
2024
-
[74]
Madial- bench: Towards real-world evaluation of memory-augmented dialogue generation
Junqing He, Liang Zhu, Rui Wang, Xi Wang, Reza Haffari, and Jiaxing Zhang. Madial- bench: Towards real-world evaluation of memory-augmented dialogue generation. arXiv preprint arXiv:2409.15240, 2024
2024
-
[75]
Evaluating very long-term conversational memory of llm agents.arXiv preprint arXiv:2402.17753, 2024
Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang. Evaluating very long-term conversational memory of llm agents.arXiv preprint arXiv:2402.17753, 2024
2024 arXiv
-
[76]
Memsim: A bayesian simulator for evaluating memory of llm-based personal assistants
Zeyu Zhang, Quanyu Dai, Luyu Chen, Zeren Jiang, Rui Li, Jieming Zhu, Xu Chen, Yi Xie, Zhenhua Dong, and Ji-Rong Wen. Memsim: A bayesian simulator for evaluating memory of llm-based personal assistants. arXiv preprint arXiv:2409.20163, 2024
2024
-
[77]
Inter- personal memory matters: A new task for proactive dialogue utilizing conversational history
Bowen Wu, Wenqing Wang, Haoran Li, Ying Li, Jingsong Yu, and Baoxun Wang. Inter- personal memory matters: A new task for proactive dialogue utilizing conversational history. arXiv preprint arXiv:2503.05150, 2025
2025
-
[78]
Beyond goldfish memory: Long-term open- domain conversation
Jing Xu, Arthur Szlam, and Jason Weston. Beyond goldfish memory: Long-term open- domain conversation. In Smaranda Muresan, Preslav Nakov, and Aline Villavicencio, edi- tors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguis- tics (Volume 1: Lo...
2022
-
[79]
Mmrc: A large-scale benchmark for understanding multimodal large language model in real-world conversation
Haochen Xue, Feilong Tang, Ming Hu, Yexin Liu, Qidong Huang, Yulong Li, Chengzhi Liu, Zhongxing Xu, Chong Zhang, Chun-Mei Feng, et al. Mmrc: A large-scale benchmark for understanding multimodal large language model in real-world conversation. arXiv preprint arXiv:2502.11903, 2025
2025
-
[80]
Ego4d: Around the world in 3,000 hours of egocentric video
Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Ro- hit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al. Ego4d: Around the world in 3,000 hours of egocentric video. In Proceedings of the IEEE/CVF conference on computer visio...
2022
-
[81]
Babilong: Testing the limits of llms with long context reasoning-in-a- haystack, 2024
Yuri Kuratov, Aydar Bulatov, Petr Anokhin, Ivan Rodkin, Dmitry Sorokin, Artyom Sorokin, and Mikhail Burtsev. Babilong: Testing the limits of llms with long context reasoning-in-a- haystack, 2024
2024
-
[82]
In search of needles in a 10m haystack: Recurrent memory finds what llms miss, 2024
Yuri Kuratov, Aydar Bulatov, Petr Anokhin, Dmitry Sorokin, Artyom Sorokin, and Mikhail Burtsev. In search of needles in a 10m haystack: Recurrent memory finds what llms miss, 2024
2024
-
[83]
Prompt cache: Modular attention reuse for low-latency inference
In Gim, Guojun Chen, Seung-seob Lee, Nikhil Sarda, Anurag Khandelwal, and Lin Zhong. Prompt cache: Modular attention reuse for low-latency inference. Proceedings of Machine Learning and Systems, 6:325–338, 2024
2024
-
[84]
Introducing contextual retrieval
Anthropic. Introducing contextual retrieval. anthropic.com, September 2024
2024
-
[85]
Character-llm: A trainable agent for role-playing
Yunfan Shao, Linyang Li, Junqi Dai, and Xipeng Qiu. Character-llm: A trainable agent for role-playing. arXiv preprint arXiv:2310.10158, 2023
2023
-
[86]
Memorag: Moving towards next-gen rag via memory-inspired knowledge discovery
Hongjin Qian, Peitian Zhang, Zheng Liu, Kelong Mao, and Zhicheng Dou. Memorag: Moving towards next-gen rag via memory-inspired knowledge discovery. arXiv preprint arXiv:2409.05591, 2024
2024
-
[87]
Echo: A large language model with temporal episodic memory
WenTao Liu, Ruohua Zhang, Aimin Zhou, Feng Gao, and JiaLi Liu. Echo: A large language model with temporal episodic memory. arXiv preprint arXiv:2502.16090, 2025
2025
-
[88]
Digital Zettelkasten: Principles, Methods, & Examples
David Kadavy. Digital Zettelkasten: Principles, Methods, & Examples. Kadavy, Inc., 2021
2021
-
[89]
Replication and analysis of ebbinghaus’ forgetting curve
Jaap MJ Murre and Joeri Dros. Replication and analysis of ebbinghaus’ forgetting curve. PloS one, 10(7):e0120644, 2015
2015
-
[90]
Dense passage retrieval for open-domain question answering
Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick SH Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. Dense passage retrieval for open-domain question answering. In EMNLP (1), pages 6769–6781, 2020
2020
-
[91]
Billion-scale similarity search with gpus
Jeff Johnson, Matthijs Douze, and Hervé Jégou. Billion-scale similarity search with gpus. IEEE Transactions on Big Data, 7(3):535–547, 2019
2019
-
[92]
Knowl- edge editing for large language models: A survey
Song Wang, Yaochen Zhu, Haochen Liu, Zaiyi Zheng, Chen Chen, and Jundong Li. Knowl- edge editing for large language models: A survey. ACM Computing Surveys , 57(3):1–37, 2024
2024
-
[93]
Parameter-efficient fine-tuning for large models: A comprehensive survey
Zeyu Han, Chao Gao, Jinyang Liu, Jeff Zhang, and Sai Qian Zhang. Parameter-efficient fine-tuning for large models: A comprehensive survey. arXiv preprint arXiv:2403.14608 , 2024
2024 arXiv
-
[94]
Reasoning with language model is planning with world model
Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhit- ing Hu. Reasoning with language model is planning with world model. arXiv preprint arXiv:2305.14992, 2023
2023 arXiv
-
[95]
Reflexion: Language agents with verbal reinforcement learning
Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. Advances in Neural Infor- mation Processing Systems, 36, 2024
2024
-
[96]
Agents thinking fast and slow: A talker-reasoner architecture
Konstantina Christakopoulou, Shibl Mourad, and Maja Matari ´c. Agents thinking fast and slow: A talker-reasoner architecture. arXiv preprint arXiv:2410.08328, 2024. 22
2024
-
[97]
Tptu: large language model-based ai agents for task planning and tool usage
Jingqing Ruan, Yihong Chen, Bin Zhang, Zhiwei Xu, Tianpeng Bao, Guoqing Du, Shiwei Shi, Hangyu Mao, Ziyue Li, Xingyu Zeng, et al. Tptu: large language model-based ai agents for task planning and tool usage. arXiv preprint arXiv:2308.03427, 2023
2023
-
[98]
Buffer of thoughts: Thought-augmented reasoning with large lan- guage models
Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E Gonzalez, and Bin Cui. Buffer of thoughts: Thought-augmented reasoning with large lan- guage models. arXiv preprint arXiv:2406.04271, 2024
2024
-
[99]
Agent workflow mem- ory
Zora Zhiruo Wang, Jiayuan Mao, Daniel Fried, and Graham Neubig. Agent workflow mem- ory. arXiv preprint arXiv:2409.07429, 2024
2024 arXiv
-
[100]
Think-in-memory: Recalling and post-thinking enable llms with long-term memory
Lei Liu, Xiaoyan Yang, Yue Shen, Binbin Hu, Zhiqiang Zhang, Jinjie Gu, and Guannan Zhang. Think-in-memory: Recalling and post-thinking enable llms with long-term memory. arXiv preprint arXiv:2311.08719, 2023
2023
-
[101]
Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory
Xizhou Zhu, Yuntao Chen, Hao Tian, Chenxin Tao, Weijie Su, Chenyu Yang, Gao Huang, Bin Li, Lewei Lu, Xiaogang Wang, et al. Ghost in the minecraft: Generally capable agents for open-world environments via large language models with text-based knowledge and memory. arXiv preprin...
2023 arXiv
-
[102]
V oyager: An open-ended embodied agent with large language models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. V oyager: An open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291, 2023
2023 arXiv
-
[103]
Retroformer: Retrospective large language agents with policy gradient optimization
Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh Murthy, Zeyuan Chen, Jianguo Zhang, Devansh Arpit, et al. Retroformer: Retrospective large language agents with policy gradient optimization. arXiv preprint arXiv:2308.02151, 2023
2023
-
[104]
Expel: Llm agents are experiential learners
Andrew Zhao, Daniel Huang, Quentin Xu, Matthieu Lin, Yong-Jin Liu, and Gao Huang. Expel: Llm agents are experiential learners. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19632–19642, 2024
2024
-
[105]
Synapse: Trajectory-as-exemplar prompting with memory for computer control
Longtao Zheng, Rundong Wang, Xinrun Wang, and Bo An. Synapse: Trajectory-as-exemplar prompting with memory for computer control. In The Twelfth International Conference on Learning Representations, 2023
2023
-
[106]
Metagpt: Meta programming for multi-agent collaborative framework
Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, et al. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 2023
2023 arXiv
-
[107]
Enhancing reasoning with col- laboration and memory
Julie Michelman, Nasrin Baratalipour, and Matthew Abueg. Enhancing reasoning with col- laboration and memory. arXiv preprint arXiv:2503.05944, 2025
2025
-
[108]
M+: Extending memoryllm with scalable long-term memory
Yu Wang, Dmitry Krotov, Yuanzhe Hu, Yifan Gao, Wangchunshu Zhou, Julian McAuley, Dan Gutfreund, Rogerio Feris, and Zexue He. M+: Extending memoryllm with scalable long-term memory. arXiv preprint arXiv:2502.00592, 2025
2025
-
[109]
Lookupffn: making transformers compute-lite for cpu inference
Zhanpeng Zeng, Michael Davies, Pranav Pulijala, Karthikeyan Sankaralingam, and Vikas Singh. Lookupffn: making transformers compute-lite for cpu inference. In International Conference on Machine Learning, pages 40707–40718. PMLR, 2023
2023
-
[110]
Chunkkv: Semantic-preserving kv cache compression for efficient long-context llm infer- ence
Xiang Liu, Zhenheng Tang, Peijie Dong, Zeyu Li, Bo Li, Xuming Hu, and Xiaowen Chu. Chunkkv: Semantic-preserving kv cache compression for efficient long-context llm infer- ence. arXiv preprint arXiv:2502.00299, 2025
2025
-
[111]
Efficient memory management for large lan- guage model serving with pagedattention
Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, and Ion Stoica. Efficient memory management for large lan- guage model serving with pagedattention. In Proceedings of the 29th Symposium on Operat- ing Systems Principle...
2023
-
[112]
Fast distributed inference serving for large language models
Bingyang Wu, Yinmin Zhong, Zili Zhang, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, and Xin Jin. Fast distributed inference serving for large language models. arXiv preprint arXiv:2305.05920, 2023. 23
2023
-
[113]
Efficient stream- ing language models with attention sinks
Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. Efficient stream- ing language models with attention sinks. arXiv preprint arXiv:2309.17453, 2023
2023 arXiv
-
[114]
Orca: A distributed serving system for {Transformer-Based} generative models
Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, and Byung-Gon Chun. Orca: A distributed serving system for {Transformer-Based} generative models. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) , pages 521–538, 2022
2022
-
[115]
{DistServe}: Disaggregating prefill and decoding for goodput-optimized large language model serving
Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu, Yibo Zhu, Xuanzhe Liu, Xin Jin, and Hao Zhang. {DistServe}: Disaggregating prefill and decoding for goodput-optimized large language model serving. In 18th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2...
2024
-
[116]
Tim Dettmers, Mike Lewis, Younes Belkada, and Luke Zettlemoyer. Gpt3. int8 (): 8-bit matrix multiplication for transformers at scale. Advances in neural information processing systems, 35:30318–30332, 2022
2022
-
[117]
Model tells you what to discard: Adaptive kv cache compression for llms
Suyu Ge, Yunan Zhang, Liyuan Liu, Minjia Zhang, Jiawei Han, and Jianfeng Gao. Model tells you what to discard: Adaptive kv cache compression for llms. arXiv preprint arXiv:2310.01801, 2023
2023
-
[118]
Train big, then compress: Rethinking model size for efficient training and inference of transformers
Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, and Joey Gon- zalez. Train big, then compress: Rethinking model size for efficient training and inference of transformers. In International Conference on machine learning , pages 5958–5968. PMLR, 2020
2020
-
[119]
Scissorhands: Exploiting the persistence of importance hypothesis for llm kv cache compression at test time
Zichang Liu, Aditya Desai, Fangshuo Liao, Weitao Wang, Victor Xie, Zhaozhuo Xu, Anas- tasios Kyrillidis, and Anshumali Shrivastava. Scissorhands: Exploiting the persistence of importance hypothesis for llm kv cache compression at test time. Advances in Neural Infor- mation Pro...
2023
-
[120]
H2o: Heavy-hitter oracle for efficient generative inference of large language models
Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark Barrett, et al. H2o: Heavy-hitter oracle for efficient generative inference of large language models. Advances in Neural Information Processing Syste...
2023
-
[121]
Mooncake: A kvcache-centric disaggregated architecture for llm serving
Ruoyu Qin, Zheming Li, Weiran He, Mingxing Zhang, Yongwei Wu, Weimin Zheng, and Xinran Xu. Mooncake: A kvcache-centric disaggregated architecture for llm serving. arXiv preprint arXiv:2407.00079, 2024
2024
-
[122]
Memserve: Context caching for disaggregated llm serving with elastic memory pool
Cunchen Hu, Heyang Huang, Junhao Hu, Jiang Xu, Xusheng Chen, Tao Xie, Chenxi Wang, Sa Wang, Yungang Bao, Ninghui Sun, et al. Memserve: Context caching for disaggregated llm serving with elastic memory pool. arXiv preprint arXiv:2406.17565, 2024
2024
-
[123]
Towards pareto optimal throughput in small language model serving
Pol G Recasens, Yue Zhu, Chen Wang, Eun Kyung Lee, Olivier Tardieu, Alaa Youssef, Jordi Torres, and Josep Ll Berral. Towards pareto optimal throughput in small language model serving. In Proceedings of the 4th Workshop on Machine Learning and Systems, pages 144– 152, 2024
2024
-
[124]
In 23rd USENIX Conference on File and Storage Technologies (FAST 25), pages 187–201, 2025
Weijian Chen, Shuibing He, Haoyang Qu, Ruidong Zhang, Siling Yang, Ping Chen, Yi Zheng, Baoxing Huai, and Gang Chen.{IMPRESS}: An {Importance-Informed}{Multi-Tier} prefix {KV} storage system for large language model inference. In 23rd USENIX Conference on File and Storage Tech...
2025
-
[125]
Adaserve: Slo-customized llm serving with fine-grained speculative decoding
Zikun Li, Zhuofu Chen, Remi Delacourt, Gabriele Oliaro, Zeyu Wang, Qinghan Chen, Shuhuai Lin, April Yang, Zhihao Zhang, Zhuoming Chen, et al. Adaserve: Slo-customized llm serving with fine-grained speculative decoding. arXiv preprint arXiv:2501.12162, 2025
2025
-
[126]
Mpic: Position- independent multimodal context caching system for efficient mllm serving
Shiju Zhao, Junhao Hu, Rongxiao Huang, Jiaqi Zheng, and Guihai Chen. Mpic: Position- independent multimodal context caching system for efficient mllm serving. arXiv preprint arXiv:2502.01960, 2025
2025
-
[127]
IntelLLM: Little hints make a big difference for LLM KV cache compression, 2024
TingLong Li and Qiuyu Shao. IntelLLM: Little hints make a big difference for LLM KV cache compression, 2024. 24
2024
-
[128]
Efficiently scaling transformer inference
Reiner Pope, Sholto Douglas, Aakanksha Chowdhery, Jacob Devlin, James Bradbury, Jonathan Heek, Kefan Xiao, Shivani Agrawal, and Jeff Dean. Efficiently scaling transformer inference. Proceedings of Machine Learning and Systems, 5:606–624, 2023
2023
-
[129]
Cachegen: Fast context loading for language model applications
Yuhan Liu, Hanchen Li, Kuntai Du, Jiayi Yao, Yihua Cheng, Yuyang Huang, Shan Lu, Michael Maire, Henry Hoffmann, Ari Holtzman, et al. Cachegen: Fast context loading for language model applications. CoRR, 2023
2023
-
[130]
Chunkattention: Efficient self-attention with prefix-aware kv cache and two-phase partition
Lu Ye, Ze Tao, Yong Huang, and Yang Li. Chunkattention: Efficient self-attention with prefix-aware kv cache and two-phase partition. arXiv preprint arXiv:2402.15220, 2024
2024
-
[131]
Ragcache: Efficient knowledge caching for retrieval-augmented generation
Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, and Xin Jin. Ragcache: Efficient knowledge caching for retrieval-augmented generation. arXiv preprint arXiv:2404.12457, 2024
2024
-
[132]
Gonzalez, Clark Barrett, and Ying Sheng
Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark Barrett, and Ying Sheng. Sglang: Efficient execution of structured language model programs, 2024
2024
-
[133]
Ada-kv: Optimizing kv cache eviction by adaptive budget allocation for efficient llm inference
Yuan Feng, Junlin Lv, Yukun Cao, Xike Xie, and S Kevin Zhou. Ada-kv: Optimizing kv cache eviction by adaptive budget allocation for efficient llm inference. arXiv preprint arXiv:2407.11550, 2024
2024
-
[134]
Fast state restoration in llm serving with hcache
Shiwei Gao, Youmin Chen, and Jiwu Shu. Fast state restoration in llm serving with hcache. arXiv preprint arXiv:2410.05004, 2024
2024
-
[135]
Compute or load kv cache? why not both? arXiv preprint arXiv:2410.03065, 2024
Shuowei Jin, Xueshen Liu, Qingzhao Zhang, and Z Morley Mao. Compute or load kv cache? why not both? arXiv preprint arXiv:2410.03065, 2024
2024
-
[136]
Epic: Efficient position-independent context caching for serving large language models
Junhao Hu, Wenrui Huang, Haoyi Wang, Weidong Wang, Tiancheng Hu, Qin Zhang, Hao Feng, Xusheng Chen, Yizhou Shan, and Tao Xie. Epic: Efficient position-independent context caching for serving large language models. arXiv preprint arXiv:2410.15332, 2024
2024
-
[137]
Relayattention for efficient large language model serving with long system prompts
Lei Zhu, Xinjiang Wang, Wayne Zhang, and Rynson WH Lau. Relayattention for efficient large language model serving with long system prompts. arXiv preprint arXiv:2402.14808, 2024
2024
-
[138]
Marconi: Prefix caching for the era of hybrid llms
Rui Pan, Zhuang Wang, Zhen Jia, Can Karakus, Luca Zancato, Tri Dao, Yida Wang, and Ravi Netravali. Marconi: Prefix caching for the era of hybrid llms. arXiv preprint arXiv:2411.19379, 2024
2024
-
[139]
Accelerating retrieval-augmented generation
Derrick Quinn, Mohammad Nouri, Neel Patel, John Salihu, Alireza Salemi, Sukhan Lee, Hamed Zamani, and Mohammad Alian. Accelerating retrieval-augmented generation. arXiv preprint arXiv:2412.15246, 2024
2024
-
[140]
Fastcache: Optimizing multimodal llm serving through lightweight kv-cache compression framework
Jianian Zhu, Hang Wu, Haojie Wang, Yinghui Li, Biao Hou, Ruixuan Li, and Jidong Zhai. Fastcache: Optimizing multimodal llm serving through lightweight kv-cache compression framework. arXiv preprint arXiv:2503.08461, 2025
2025
-
[141]
Cache-craft: Managing chunk-caches for efficient retrieval-augmented generation
Shubham Agarwal, Sai Sundaresan, Subrata Mitra, Debabrata Mahapatra, Archit Gupta, Rounak Sharma, Nirmal Joshua Kapu, Tong Yu, and Shiv Saini. Cache-craft: Managing chunk-caches for efficient retrieval-augmented generation. arXiv preprint arXiv:2502.15734, 2025
2025
-
[142]
Kvlink: Accelerating large language models via efficient kv cache reuse
Jingbo Yang, Bairu Hou, Wei Wei, Yujia Bao, and Shiyu Chang. Kvlink: Accelerating large language models via efficient kv cache reuse. arXiv preprint arXiv:2502.16002, 2025
2025
-
[143]
Ragserve: Fast quality-aware rag systems with configuration adaptation
Siddhant Ray, Rui Pan, Zhuohan Gu, Kuntai Du, Ganesh Ananthanarayanan, Ravi Netravali, and Junchen Jiang. Ragserve: Fast quality-aware rag systems with configuration adaptation. arXiv preprint arXiv:2412.10543, 2024
2024
-
[144]
Bumblebee: Dynamic kv-cache streaming submodular summarization for infinite-context transformers
Lilly Kumari, Shengjie Wang, Tianyi Zhou, Nikhil Sarda, Anthony Rowe, and Jeff Bilmes. Bumblebee: Dynamic kv-cache streaming submodular summarization for infinite-context transformers. In First Conference on Language Modeling, 2024. 25
2024
-
[145]
Memorizing trans- formers
Yuhuai Wu, Markus N Rabe, DeLesley Hutchins, and Christian Szegedy. Memorizing trans- formers. arXiv preprint arXiv:2203.08913, 2022
2022
-
[146]
Focused transformer: Contrastive training for context scal- ing
Szymon Tworkowski, Konrad Staniszewski, Mikołaj Pacek, Yuhuai Wu, Henryk Michalewski, and Piotr Miło´s. Focused transformer: Contrastive training for context scal- ing. Advances in Neural Information Processing Systems, 36, 2024
2024
-
[147]
Online adaptation of language models with a memory of amor- tized contexts
Jihoon Tack, Jaehyung Kim, Eric Mitchell, Jinwoo Shin, Yee Whye Teh, and Jonathan Richard Schwarz. Online adaptation of language models with a memory of amor- tized contexts. arXiv preprint arXiv:2403.04317, 2024
2024
-
[148]
Memoryllm: Towards self-updatable large language models
Yu Wang, Yifan Gao, Xiusi Chen, Haoming Jiang, Shiyang Li, Jingfeng Yang, Qingyu Yin, Zheng Li, Xian Li, Bing Yin, et al. Memoryllm: Towards self-updatable large language models. arXiv preprint arXiv:2402.04624, 2024
2024
-
[149]
Wise: Rethinking the knowledge memory for lifelong model editing of large language models
Peng Wang, Zexi Li, Ningyu Zhang, Ziwen Xu, Yunzhi Yao, Yong Jiang, Pengjun Xie, Fei Huang, and Huajun Chen. Wise: Rethinking the knowledge memory for lifelong model editing of large language models. arXiv preprint arXiv:2405.14768, 2024
2024
-
[150]
Augmenting language models with long-term memory.Advances in Neural Information Processing Systems, 36:74530–74543, 2023
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, and Furu Wei. Augmenting language models with long-term memory.Advances in Neural Information Processing Systems, 36:74530–74543, 2023
2023
-
[151]
Lm2: Large memory models for long context reasoning
Jikun Kang, Wenqi Wu, Filippos Christianos, Alex James Chan, Fraser David Greenlee, George Thomas, Marvin Purtorab, and Andrew Toulis. Lm2: Large memory models for long context reasoning. In Workshop on Reasoning and Planning for Large Language Models , 2025
2025
-
[152]
Titans: Learning to memorize at test time
Ali Behrouz, Peilin Zhong, and Vahab Mirrokni. Titans: Learning to memorize at test time. arXiv preprint arXiv:2501.00663, 2024
2024 arXiv
-
[153]
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural informa- tion processing systems, 30, 2017
2017
-
[154]
Memoro: Using large language models to realize a concise interface for real-time memory augmentation
Wazeer Deen Zulfikar, Samantha Chan, and Pattie Maes. Memoro: Using large language models to realize a concise interface for real-time memory augmentation. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, pages 1–18, 2024
2024
-
[155]
Unveiling privacy risks in llm agent memory
Bo Wang, Weiyi He, Pengfei He, Shenglai Zeng, Zhen Xiang, Yue Xing, and Jiliang Tang. Unveiling privacy risks in llm agent memory. arXiv preprint arXiv:2502.13172, 2025. 26
2025
Reviewed May 17, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.