Pith. sign in

REVIEW 47 cited by

G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2506.07398 v2 pith:WZRYOMZY submitted 2025-06-09 cs.MA cs.CLcs.LG

G-Memory: Tracing Hierarchical Memory for Multi-Agent Systems

classification cs.MA cs.CLcs.LG
keywords memoryg-memoryinteractiontrajectoriesuponagentscollaborationcross-trial
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Large language model (LLM)-powered multi-agent systems (MAS) have demonstrated cognitive and execution capabilities that far exceed those of single LLM agents, yet their capacity for self-evolution remains hampered by underdeveloped memory architectures. Upon close inspection, we are alarmed to discover that prevailing MAS memory mechanisms (1) are overly simplistic, completely disregarding the nuanced inter-agent collaboration trajectories, and (2) lack cross-trial and agent-specific customization, in stark contrast to the expressive memory developed for single agents. To bridge this gap, we introduce G-Memory, a hierarchical, agentic memory system for MAS inspired by organizational memory theory, which manages the lengthy MAS interaction via a three-tier graph hierarchy: insight, query, and interaction graphs. Upon receiving a new user query, G-Memory performs bi-directional memory traversal to retrieve both $\textit{high-level, generalizable insights}$ that enable the system to leverage cross-trial knowledge, and $\textit{fine-grained, condensed interaction trajectories}$ that compactly encode prior collaboration experiences. Upon task execution, the entire hierarchy evolves by assimilating new collaborative trajectories, nurturing the progressive evolution of agent teams. Extensive experiments across five benchmarks, three LLM backbones, and three popular MAS frameworks demonstrate that G-Memory improves success rates in embodied action and accuracy in knowledge QA by up to $20.89\%$ and $10.12\%$, respectively, without any modifications to the original frameworks. Our codes are available at https://github.com/bingreeky/GMemory.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 47 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Co-Evolving Skill Generation and Policy Optimization

    cs.CL 2026-06 unverdicted novelty 7.0

    Framework estimates context-dependent marginal utility of candidate skills via reward gaps in matched base vs. skill-augmented rollouts to filter skills and co-train policy as generator.

  2. Beyond Semantic Organization: Memory as Execution State Management for Long-Horizon Agents

    cs.AI 2026-06 unverdicted novelty 7.0

    MAGE manages agent memory via a hierarchical state tree with Grow, Compress, Maintain, and Revise operations, raising success rates 7.8-20.4 pp and cutting tokens 55.1% on MemoryArena.

  3. EXG: Self-Evolving Agents with Experience Graphs

    cs.AI 2026-05 unverdicted novelty 7.0

    EXG is an experience graph framework for self-evolving LLM agents that supports online real-time growth and offline reuse to enhance solution quality and efficiency on code generation and reasoning benchmarks.

  4. ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents

    cs.AI 2026-05 unverdicted novelty 7.0

    ClawForge is a generator framework that creates reproducible executable benchmarks for command-line agents under state conflict, with ClawForge-Bench showing frontier models reach at most 45.3% strict accuracy and tha...

  5. ClawForge: Generating Executable Interactive Benchmarks for Command-Line Agents

    cs.AI 2026-05 conditional novelty 7.0

    ClawForge supplies a generator that turns scenario templates into reproducible command-line tasks testing state conflict handling, where the strongest frontier model scores only 45.3 percent strict accuracy.

  6. EquiMem: Calibrating Shared Memory in Multi-Agent Debate via Game-Theoretic Equilibrium

    cs.AI 2026-05 unverdicted novelty 7.0

    EquiMem calibrates shared memory in multi-agent debate by computing a game-theoretic equilibrium from agent queries and paths, outperforming heuristics and LLM validators across benchmarks while remaining robust to ad...

  7. MemCompiler: Compile, Don't Inject -- State-Conditioned Memory for Embodied Agents

    cs.RO 2026-05 unverdicted novelty 7.0

    MemCompiler introduces state-conditioned memory compilation that dynamically selects and compiles relevant memory into text and latent guidance, yielding up to 129% gains over no-memory baselines and 60% lower latency...

  8. MemCompiler: Compile, Don't Inject -- State-Conditioned Memory for Embodied Agents

    cs.RO 2026-05 unverdicted novelty 7.0

    MemCompiler reframes memory use as state-conditioned compilation, delivering relevant guidance via text and latent channels to improve embodied agent performance up to 129% and cut latency 60% versus static injection.

  9. MemSearcher: Training LLMs to Reason, Search and Manage Memory via End-to-End Reinforcement Learning

    cs.CL 2025-11 unverdicted novelty 7.0

    MemSearcher trains LLMs to manage compact memory in multi-turn searches via multi-context GRPO for end-to-end RL, outperforming ReAct-style baselines with stable token counts.

  10. Knowledge-Centric Self-Improvement

    cs.AI 2026-07 conditional novelty 6.0

    A protocol that keeps agents generic and disposable while improving a persistent curated knowledge base outperforms agent-centric self-improvement baselines on ARC, coding, and terminal benchmarks.

  11. Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents

    cs.CL 2026-07 conditional novelty 6.0

    A tabular UCB controller trained on task success improves LLM-agent memory use over fixed heuristics, without extra LLM calls.

  12. Mosaic: Runtime-Efficient Multi-Agent Embodied Planning

    cs.MA 2026-07 accept novelty 6.0

    Mosaic delivers 27-32% faster multi-agent embodied execution and 4-10 point higher success via agent-centric relative memory plus per-step ILP action allocation.

  13. What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

    cs.LG 2026-07 conditional novelty 6.0

    KV-cache eviction, prompt compression, recurrent state bounding, and agent memory consolidation are unified as one rate-distortion problem with a shared lower bound, shared failure mode, and transferable mechanisms.

  14. MetaPS: Adaptive Programmatic Strategy Selection for Market Agents

    cs.AI 2026-06 unverdicted novelty 6.0

    MetaPS trains models via simulation rollouts to select from programmatic strategy libraries for market agents, yielding better performance than fixed or direct LLM baselines across model sizes.

  15. How Much Coordination Gain Is Real? A Paired Noise-Floor Protocol for Multi-Agent LLM Benchmarks

    cs.MA 2026-06 unverdicted novelty 6.0

    Paired configuration-equivalent trials on Claude Haiku 4.5 yield a noise floor of roughly [-3, +18]pp with no significant coordination contrast after correction, placing most recent multi-agent papers inside or below ...

  16. Rethinking Memory as Continuously Evolving Connectivity

    cs.CL 2026-05 unverdicted novelty 6.0

    FluxMem evolves memory as a heterogeneous graph via three refinement stages and reports consistent state-of-the-art results on LoCoMo, Mind2Web, and GAIA benchmarks.

  17. Self-Evolving Multi-Agent Systems via Decentralized Memory

    cs.MA 2026-05 unverdicted novelty 6.0

    DecentMem is a decentralized dual-pool memory framework for self-evolving multi-agent systems that provides O(log T) regret guarantees and yields up to 23.8% accuracy gains over centralized baselines.

  18. AgentKVShift: Efficient KV Cache Reuse for Agentic Memory Systems

    cs.AI 2026-05 conditional novelty 6.0

    AgentKVShift corrects all reused KV cache entries in agentic memory by estimating a chunk-level residual offset from a small probe set, recovering near-fresh accuracy at 10–30% recompute ratios.

  19. MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning

    cs.AI 2026-05 unverdicted novelty 6.0

    MAP improves LLM agent reasoning by constructing a structured cognitive map of the environment before task execution, yielding performance gains on benchmarks like ARC-AGI-3 and superior training data via the new MAP-...

  20. SAGE: A Self-Evolving Agentic Graph-Memory Engine for Structure-Aware Associative Memory

    cs.AI 2026-05 unverdicted novelty 6.0

    SAGE is a self-evolving agentic graph-memory engine that dynamically constructs and refines structured memory graphs via writer-reader feedback, yielding performance gains on multi-hop QA, open-domain retrieval, and l...

  21. PREPING: Building Agent Memory without Tasks

    cs.AI 2026-05 unverdicted novelty 6.0

    Preping builds agent memory via proposer-guided synthetic practice and selective validation, matching offline/online methods at 2-3x lower deployment cost.

  22. The Trap of Trajectory: Towards Understanding and Mitigating Spurious Correlations in Agentic Memory

    cs.LG 2026-05 unverdicted novelty 6.0

    Agentic memory improves clean reasoning but worsens performance when spurious patterns are present in stored trajectories; CAMEL calibration reduces this reliance while preserving clean performance.

  23. GAM: Hierarchical Graph-based Agentic Memory for LLM Agents

    cs.AI 2026-04 unverdicted novelty 6.0

    GAM decouples event-level memory encoding from topic-level consolidation in LLM agents using hierarchical graphs to reduce interference and improve long-term coherence and retrieval.

  24. Task-Adaptive Retrieval over Agentic Multi-Modal Web Histories via Learned Graph Memory

    cs.IR 2026-04 unverdicted novelty 6.0

    ACGM learns task-adaptive sparse graphs over multi-modal agent histories via policy-gradient optimization, reaching 82.7 nDCG@10 and 89.2% Precision@10 on WebShop, VisualWebArena, and Mind2Web while outperforming 19 b...

  25. ActMem: Bridging the Gap Between Memory Retrieval and Reasoning in LLM Agents

    cs.CL 2026-02 conditional novelty 6.0

    ActMem stores agent dialogue as a causal and semantic knowledge graph and uses LLM counterfactual reasoning to retrieve implicit constraints, outperforming RAG-style baselines on a new reasoning benchmark.

  26. Context Learning for Multi-Agent Discussion

    cs.AI 2026-02 unverdicted novelty 6.0

    M2CL trains per-agent context generators with a self-adaptive mechanism to maintain coherence and reduce output discrepancies in multi-LLM discussions, yielding 20-50% gains on reasoning, embodied, and mobile control tasks.

  27. EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle

    cs.CL 2025-10 unverdicted novelty 6.0

    EvolveR enables LLM agents to self-evolve via a closed loop of distilling interaction trajectories into strategic principles offline and retrieving them to guide online decisions with policy reinforcement, yielding be...

  28. Governed Shared Memory for Multi-Agent LLM Systems

    cs.AI 2026-06 unverdicted novelty 5.0

    The paper defines four governance primitives for shared memory in multi-agent LLM fleets and reports evaluation results from a live production service.

  29. ConMem: Structured Memory-Guided Adaptation in Training-Free Multi-Agent Systems

    cs.AI 2026-06 unverdicted novelty 5.0

    ConMem distills agent trajectories into structured memory cards organized in a relation-aware graph to enable training-free, relation-coordinated adaptation in LLM-based multi-agent systems.

  30. Memory-R2: Fair Credit Assignment for Long-Horizon Memory-Augmented LLM Agents

    cs.LG 2026-05 unverdicted novelty 5.0

    Memory-R2 proposes LoGo-GRPO to fix unfair trajectory comparisons in RL training of memory-augmented LLM agents by combining global end-to-end rewards with local rerollouts from identical memory states.

  31. A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications

    cs.IR 2026-05 unverdicted novelty 5.0

    A survey that taxonomizes agent skills for LLM-based agents across representation, acquisition, retrieval, and evolution stages while reviewing methods, resources, and open challenges.

  32. Web2BigTable: A Bi-Level Multi-Agent LLM System for Internet-Scale Information Search and Extraction

    cs.AI 2026-04 unverdicted novelty 5.0

    Web2BigTable introduces a bi-level multi-agent system that achieves new state-of-the-art results on wide-coverage and deep web-to-table search benchmarks through orchestration, coordination, and closed-loop reflection.

  33. Hierarchical Long-Term Semantic Memory for LinkedIn's Hiring Agent

    cs.IR 2026-04 unverdicted novelty 5.0

    HLTM structures textual data into a schema-aligned memory tree for scalable ingestion and low-latency retrieval in LinkedIn's Hiring Assistant, reporting over 5% higher answer correctness, over 10% higher retrieval F1...

  34. MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thought

    cs.MA 2026-04 unverdicted novelty 5.0

    MemCoT redefines long-context reasoning as iterative stateful search with zoom-in/zoom-out memory perception and dual short-term memories, claiming SOTA results on LoCoMo and LongMemEval-S benchmarks.

  35. MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thought

    cs.MA 2026-04 unverdicted novelty 5.0

    MemCoT transforms long-context LLM reasoning into an iterative stateful search using multi-view memory for evidence localization and dual short-term memory for guiding decisions, achieving SOTA on LoCoMo and LongMemEv...

  36. Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models

    cs.IR 2026-01 reject novelty 5.0

    A two-framework testbed comparison claims mem0 is Pareto-optimal over Graphiti for distributed LLM agents because its lower cost is paired with accuracy that is not significantly different.

  37. EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle

    cs.CL 2025-10 unverdicted novelty 5.0

    EvolveR proposes a closed-loop self-evolution system for LLM agents that distills experiences into principles offline and applies reinforcement during online task interactions to achieve better performance on multi-ho...

  38. What Deserves Memory: Adaptive Memory Distillation for LLM Agents

    cs.AI 2025-08 unverdicted novelty 5.0

    NEMORI is an adaptive memory distillation framework for LLM agents that transforms raw interactions into narratives and extracts insights via prediction error to decide what deserves retention.

  39. R$^2$-Searcher: Calibrating Retrieval and Reasoning Boundaries for Agentic Search

    cs.IR 2026-06 unverdicted novelty 4.0

    R²-Searcher introduces fine-grained evidence modeling, retrieval reflection, and R²PO RL to calibrate retrieval-reasoning boundaries and improve multi-hop QA performance.

  40. A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications

    cs.IR 2026-05 unverdicted novelty 4.0

    The paper surveys agent skills for LLM agents, organizing the literature into a four-stage lifecycle of representation, acquisition, retrieval, and evolution while highlighting their role in system scalability.

  41. Hierarchical Long-Term Semantic Memory for LinkedIn's Hiring Agent

    cs.IR 2026-04 unverdicted novelty 4.0

    HLTM builds a hierarchical memory tree from longitudinal data to enable scalable, private, low-latency retrieval, delivering over 10% gains in answer correctness and retrieval F1 for LinkedIn's Hiring Assistant while ...

  42. RGMem: Renormalization Group-inspired Memory Evolution for Language Agents

    cs.AI 2025-10 conditional novelty 4.0

    RGMem, a hierarchical memory framework with thresholded updates inspired by renormalization group ideas, reports state-of-the-art scores on the LOCOMO long-term conversational memory benchmark.

  43. A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligence

    cs.AI 2025-07 accept novelty 4.0

    The paper delivers the first systematic review of self-evolving agents, structured around what components evolve, when adaptation occurs, and how it is implemented.

  44. Token-Operations-Oriented Inference Optimization Techniques for Large Models

    cs.SE 2026-06 unverdicted novelty 3.0

    The paper introduces a four-layer technical architecture for token-operations-oriented inference optimization in large models and reviews key technologies and industry status at each layer.

  45. Token-Operations-Oriented Inference Optimization Techniques for Large Models

    cs.SE 2026-06 conditional novelty 3.0

    A survey of large-model inference optimization, organized as a four-layer 'token-operations' taxonomy: multi-model fusion, model optimization, compute-model fusion, and compute-network-model fusion.

  46. A Comprehensive Survey on Agent Skills: Taxonomy, Techniques, and Applications

    cs.IR 2026-05 unverdicted novelty 3.0

    A survey that defines agent skills as reusable procedural artifacts and reviews methods, resources, and applications across their representation, acquisition, retrieval, and evolution stages.

  47. Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security

    cs.AI 2026-05 unverdicted novelty 2.0

    A survey that maps risks along the agent workflow and consolidates metrics and benchmarks for safety, robustness, privacy, and security in agentic AI.