Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance Graph

Akash Vishwakarma; Hojin Lee; Mohith Suresh; Priyam Shankar Sharma; Rahul Vishwakarma; Sparsh Gupta; Yuvraj Anupam Chauhan

REVIEW 4 major objections 5 minor 1 cited by

Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance Graph

T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Cognitive Weave claims that a spatio-temporal resonance graph memory with LLM-synthesized insight aggregates lifts agent task completion by 34 percent and cuts mean query latency by 42 percent over existing memory systems.

desk verdict A coherent memory-architecture synthesis whose headline empirical claims are currently unverifiable because the comparisons are overstated and the artifacts are missing. read the letter →

arxiv 2506.08098 v1 pith:RTRN24DF submitted 2025-06-09 cs.AI

Akash Vishwakarma , Hojin Lee , Mohith Suresh , Priyam Shankar Sharma , Rahul Vishwakarma , Sparsh Gupta , Yuvraj Anupam Chauhan This is my paper

classification cs.AI

keywords LLMagentmemoryspatio-temporalknowledgegraphinsightsynthesisarchitecturetemporalreasoningretrieval-augmentedgenerationlong-horizonplanningmulti-sessiondialogue

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that an LLM agent's memory should be an active, evolving knowledge structure, not a passive retrieval store. It presents Cognitive Weave, whose spatio-temporal resonance graph stores memories as structured Insight Particles linked by typed relationships and periodically compresses clusters of related particles into higher-level Insight Aggregates. On long-horizon planning, evolving question answering, and multi-session dialogue benchmarks, the authors report a 34 percent average improvement in task completion over the strongest baseline and a 42 percent reduction in mean query latency. The claim matters because it suggests that memory architectures that synthesize abstracted knowledge, rather than merely retrieve raw traces, can make agents more adaptive and coherent over long interactions.

What carries the argument

The load-bearing object is the Spatio-Temporal Resonance Graph (STRG), a hybrid store with four layers: a Core Particle Store, a Vectorial Resonance Subsystem for embedding similarity, a Temporal Index Layer for time-range queries, and a Relational Strand Graph Layer whose typed edges (supports, contradicts, elaborates, causes, precedes, derivedFrom) connect Insight Particles. Insight Particles (IPs) are the atomic memory units, each carrying core data, resonance keys, signifiers, situational imprint, temporal metadata, relational strands, and importance metrics. The Cognitive Refinement process, orchestrated by a Nexus Weaver and a Semantic Oracle Interface backed by an LLM, periodically clusters related IPs and synthesizes Insight Aggregates (IAs) that abstract higher-level knowledge and act as retrieval shortcuts. This mechanism lets the system retrieve along semantic, temporal, and relational dimensions simultaneously and then consolidate what it has learned.

What would settle it

Re-running the three benchmarks with publicly released code, exact hyperparameters, and a released Evolving-QA dataset would settle it: if a well-tuned RAG or A-MEM matches the 34 percent task-completion gain and 92 ms latency, the central claim fails; if the gap persists under controlled tuning parity, it stands.

Watch

Extended reading notes

Core claim

The central claim is that representing agent memory as a multi-layered spatio-temporal resonance graph, combining vector embeddings, temporal indices, and typed relational strands, and enriching it with LLM-synthesized Insight Aggregates yields measurable gains over existing memory systems. The authors report that Cognitive Weave outperformed standard RAG, MemGPT, A-MEM, and Mem0 on all three benchmarks: a 34 percent average improvement in task completion on Robotouille long-horizon planning; higher F1, temporal accuracy, and update adaptability on their Evolving-QA dataset with 92 ms average query latency; and better automated and human-rated dialogue coherence on LoCoMo. Insight Aggregate synthesis is presented as the key mechanism that lets memory move beyond fact storage toward abstracted, reusable understanding.

Load-bearing premise

The load-bearing premise is that the comparison is fair: the baselines were implemented and tuned as carefully as Cognitive Weave, and the unreleased Evolving-QA dataset validly measures temporal reasoning.

Editorial extensions

If this is right

If the reported results hold, agent memory systems can move beyond flat retrieval: the STRG lets queries be filtered temporally, then semantically, then relationally, pruning the search space at each step.
Insight Aggregate synthesis would let long-lived agents reuse abstracted strategies and sub-plans rather than replaying raw memories, which is where the Robotouille gains are claimed to come from.
The Temporal Index Layer, including event-time indexing, would allow agents to answer time-sensitive questions and track evolving facts, the capability measured by the Evolving-QA dataset.
The reported sub-200 ms query latency at one million stored Insight Particles suggests the hybrid indexing design can support interactive applications at scale.
The claimed 34 and 42 percent figures position Cognitive Weave as a unified alternative to memory systems that specialize in only one of vector retrieval, graph structure, temporal awareness, or dynamic evolution.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

A natural extension the authors do not develop is cross-agent transfer: if Insight Aggregates are shareable subgraphs, agents could exchange abstracted knowledge without exposing raw memories.
The paper calls contradiction detection rudimentary, so a direct test would be whether the graph maintains coherent beliefs when fed deliberately conflicting statements over multiple sessions.
Because Evolving-QA is custom and unreleased, an independent public version of it would be the quickest way for others to verify the temporal-reasoning claims.
The importance-recalibration and decay machinery could be evaluated as a forgetting policy: whether pruning improves or degrades performance over very long agent lifetimes compared with no pruning.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Bottom line: this is a coherent architectural contribution that overstates its empirical case. The STRG with Insight Particles and Aggregates is a reasonable synthesis of A-MEM, Mem0, Graphiti, and MemInsight, and the writing is clear about what is and isn't implemented. The abstract's '34% vs state-of-the-art baselines' and '42% latency reduction' do not survive contact with Section 4: the 34% is against A-MEM only, the 42% is against the slowest baseline, and no baselines are pinned to versions, hyperparameters, or prompts. The custom Evolving-QA dataset is not released, Figures 4 and 6 lack error bars, and there are no significance tests. The central claim is unverified, not because of fraud but because the controls are missing.

What is actually new: the exact integration of vector, temporal, and relational layers with LLM-synthesized insight aggregates is absent from the cited prior systems. The architecture description is detailed enough to reimplement in principle, and the authors are candid about limitations (Section 6.3.1). The human evaluation of IA quality is a useful step, though annotator selection and the IA sample are undescribed. The formal section is thin: Theorem 5.1 defines an objective and the proof sketch restates it, but Remark 5.2 honestly says LLMs do not optimize it. That is framing, not a mathematical result. The reference list is appropriate and covers the relevant recent work.

The soft spots are exactly where the stress-test note lands. The abstract overstates the comparisons; Section 4.1.2 says baselines were 'optimized' without saying how; the GitHub link lacks configuration details. The latency comparison may also be confounded by extra LLM calls in the SOI, and reporting retrieval-only latency would address that. Figure 6 has no error bars and only compares two baselines. These are fixable with a proper artifact release and re-benchmarking; they do not invalidate the architectural idea.

Who this is for: people working on LLM agent memory will find the taxonomy and design worth discussing. It deserves a serious referee, but the referee should focus on reproducibility. I'd recommend engaging conditionally: ask for code, dataset, pinned baselines, corrected claims, and then reassess.

Referee Report

4 major / 5 minor

Summary. The paper proposes Cognitive Weave, a memory architecture for LLM-based agents built around a Spatio-Temporal Resonance Graph (STRG) with four layers: a core particle store, a vectorial subsystem, a temporal index, and a relational graph. Memory is organized into Insight Particles (IPs) enriched by a Semantic Oracle Interface (SOI), and the Cognitive Refinement process synthesizes higher-level Insight Aggregates (IAs) from clusters of related IPs. The authors claim substantial empirical gains on long-horizon planning (Robotouille), an evolving question-answering dataset (Evolving-QA), and multi-session dialogue (LoCoMo), including a 34% improvement in task completion and a 42% reduction in query latency over baselines. The paper also includes theoretical sections on information-theoretic IA synthesis, temporal decay, relational strand strength, and graph complexity, plus a discussion of ethics, limitations, and future directions.

Significance. If the empirical claims are reproducible, the STRG architecture and the IA-synthesis mechanism would be a meaningful contribution to LLM agent memory, combining vector, temporal, and relational layers in one system and addressing long-horizon and dynamic-knowledge tasks beyond what standard RAG or MemGPT-style methods offer. The paper also usefully distinguishes its approach from graph-based memories such as A-MEM and Mem0, and its careful enumeration of IP/IA structures and the Cognitive Refinement pipeline provides a concrete design other researchers could build on. The authors provide a GitHub link and report human evaluation of IA quality with inter-rater agreement, which are positive signs. However, the central empirical claims currently rest on a custom unreleased dataset, unpinned baseline implementations, missing statistical tests, and headline numbers that are stated more strongly than the experimental sections support.

major comments (4)

[§4.1.2, §4.2] The central empirical comparison is not verifiable from the manuscript as written. Section 4.1.2 says baselines were implemented by 'endeavor[ing] to use publicly available implementations or closely follow the architectural descriptions' and were 'optimized' for each task, but the manuscript gives no repository commits, hyperparameter settings, prompts, retrieval configurations, or evaluation harness details. Because Cognitive Weave's Semantic Oracle Interface performs additional LLM-based synthesis and structuring calls, the reported task-completion and latency advantages could partly reflect extra inference compute rather than the memory architecture itself. Please pin baseline versions, document all configurations, report LLM-call counts for every system, and release the evaluation harness so the comparisons in Figures 4–6 and Table 2 can be independently reproduced.
[§4.2.1, §4.2.2, Table 2] The abstract's headline numbers do not match what the experiments actually report. Section 4.2.1 states the 34% improvement is over 'the next best baseline (A-MEM)', not over all state-of-the-art systems, and Section 4.2.2 states the '42% reduction' is relative to 'the slowest baseline in this specific test' (A-MEM), not to state-of-the-art baselines generally. Table 2 shows Cognitive Weave at 92±5 ms versus A-MEM at 156±9 ms, which is about a 41% reduction, and about 35% versus Mem0 at 142±7 ms. The abstract and conclusion should state the exact comparison basis, and the results should report the full pairwise margins, confidence intervals, and statistical tests across all baselines.
[§4.1.1, §4.2.2] Evolving-QA, the dataset used to support the temporal-reasoning claims, is custom and not released. The manuscript does not define operationally how Temporal Accuracy and Update Adaptability are computed, what the fact-update schedule is, how questions referencing specific times are generated, or how answer correctness is judged. Without a dataset specification and public release, the temporal reasoning results in Table 2 and the associated conclusions cannot be reproduced or audited. Please provide a full dataset card, release the data, and include the exact question-construction and scoring protocols.
[Figure 4, Figure 6, §4.2] Figures 4 and 6 present performance and latency curves without error bars, standard deviations, or the number of runs, even though Table 2 reports mean±standard deviation. Figure 4 also omits Mem0 despite Section 4.2.1 saying all baseline systems were compared. Error bars or confidence bands, run counts, and statistical tests (for example, paired tests across scenarios) are needed before the claimed superiority over baselines can be assessed.

minor comments (5)

[§5.1, Theorem 5.1] Theorem 5.1 is not a theorem in the usual sense: Equation (6) defines an objective with unspecified Rel, Comp, and λ_comp, and the proof sketch merely restates the trade-off between relevance and complexity. Please reframe it as a design objective or provide formal existence, uniqueness, or optimality results under concrete instantiations.
[§3.4.3, Equation (5)] The text says 'extending the one in the original text' and later 'The original paper's formula', which is confusing because this manuscript is the original source; the linear formula I_new = α·I_old + β·f_access + γ·IA_links is introduced without definitions of α, β, and γ. Please clean up the self-reference and define all coefficients.
[§5.3, Equation (8)] The weights θ_1 through θ_4 are described as 'learned', but no learning procedure, training data, or experimental evidence is provided. Please state clearly whether this probabilistic model is implemented in the system or only proposed as a future extension.
[§5.2, §6.3.1] The temporal decay model depends on λ_decay, I_base, and the importance-recalibration coefficients, but the paper gives no default values or sensitivity analysis. Please report the parameter settings used in the experiments and discuss their influence on the main results.
[References] Reference [30] is informal and contains speculative parenthetical text about 'o4-mini' and 'gpt-4 omni mini'; please cite the official Azure OpenAI model documentation and remove the shorthand caveat.

Circularity Check

1 steps flagged · score 2.0 of 10

The empirical claims are external measurements; the only circular step is a definitional 'theorem' that is not load-bearing.

self definitional [Section 5.1, Eq. (6) and Theorem 5.1]
"Theorem 5.1 (Optimal Insight Aggregate Synthesis). Given a cluster of Insight Particles C={I1,...,In}, an optimal Insight Aggregate, IA*, is one that minimizes the objective function L(IA): L(IA) = ... Proof Sketch. The objective function in Equation 6 seeks a balance. The first term encourages the IA to capture as much relevant information as possible from the constituent I_i's. ... The second term acts as a regularizer, penalizing overly complex or verbose IAs, thereby promoting abstraction and conciseness."

The theorem is true by construction: 'optimal' is declared to be the minimizer of L(IA), and the proof restates the two terms of that same objective. No independent optimality result is derived. Remark 5.2 further concedes that the LLM-based SOI does not actually optimize L(IA), so the theorem is not the mechanism behind the reported 34% task-completion or 42% latency numbers. Because those numbers come from comparisons to external baselines and datasets, this definitional restatement does not make the paper's central empirical claims circular.

full rationale

The central claims of the paper are empirical comparisons against external, published systems (RAG, MemGPT, A-MEM, Mem0) on Robotouille, LoCoMo, and a custom Evolving-QA benchmark. These are measurements, not quantities derived from the architecture's equations or fitted from its parameters, so they are not circular in the sense of this review. Baseline under-specification and choice of comparison points in Section 4.2 are reproducibility and fairness concerns, not circularity. The one genuinely definitional step is Theorem 5.1 / Eq. (6), where 'optimal IA' is identified with the minimizer of a newly defined objective; the proof sketch only unpacks the definition. Since the theorem is explicitly not what the system optimizes, it does not carry the paper's main results. I found no load-bearing self-citation chain, no imported uniqueness theorem, and no ansatz smuggled in via citation. The paper's formal apparatus is largely illustrative, and its empirical contribution stands independently of it.

Assumptions & free parameters 6 free parameters · 5 assumptions · 4 invented entities

The central claims rest on several unstated or weakly supported choices: multiple decay and weighting parameters with no reported values in Equations 5, 7, 8, and Algorithm 1, a custom unreleased dataset, and an assumption that baselines were tuned fairly. The architecture also introduces named units whose value is only demonstrated through self-designed evaluations, not external benchmarks. No formal verification is provided.

free parameters (6)

lambda_decay = not specified
Controls temporal decay of importance in Equation 7; Section 6.3.1 admits performance depends on tuning such rates, but no value or fitting procedure is reported.
I_base = not specified
Residual importance floor in Equation 7; set by hand without reported calibration.
alpha, beta, gamma = not specified
Linear importance update weights in Section 3.4.3; no values or learning procedure are given.
tau_cluster and Omega_synth = not specified
Clustering threshold and synthesis trigger in Algorithm 1; no values, ranges, or tuning method are provided.
lambda_comp = not specified
Regularization constant in the IA synthesis objective, Equation 6; not instantiated in the implementation.
theta_1 through theta_4 = not specified
Weights in probabilistic strand strength, Equation 8; stated as 'could be learned' but no learning method or results are given.

assumptions (5)

domain assumption The LLM-based Semantic Oracle Interface can reliably extract resonance keys, signifiers, situational imprints, and core data from raw input, and can synthesize coherent Insight Aggregates from clusters.
Used throughout Sections 3.1.2 and 3.4.1; if LLM extraction and synthesis are unreliable, the whole memory fabric degrades, but no error analysis of SOI outputs is provided.
domain assumption Semantic similarity between embeddings is a sufficient proxy for relevance in clustering and retrieval.
Section 3.3.2 and Algorithm 1 rely on cosine similarity and ANN search; no evaluation of embedding failure modes is given.
domain assumption The custom Evolving-QA dataset and its Temporal Accuracy and Update Adaptability metrics validly measure temporal reasoning.
Section 4.1.1 introduces the dataset without release or benchmark validation; the headline temporal results depend on it.
domain assumption Baseline systems were implemented and tuned to comparable strength.
Section 4.1.2 states an effort to follow public implementations, but exact versions and hyperparameters are absent; the 34% and latency claims depend on baseline parity.
domain assumption Human ratings on 1 to 5 scales and Krippendorff's alpha capture IA quality and dialogue coherence.
Sections 4.2.3 and 4.2.5 use human evaluation; annotation instructions and rater selection are not described.

invented entities (4)

Insight Particle (IP)
purpose: Atomic memory unit holding core data, resonance keys, signifiers, situational imprint, temporal metadata, relational strands, and importance metrics.
In-house construct; no external benchmark or released implementation demonstrates its superiority.
Insight Aggregate (IA)
purpose: Higher-level synthesized summary produced from clusters of IPs by the Semantic Oracle Interface.
Quality is measured only through the self-designed 500-sample human evaluation in Table 3; no independent downstream metric is given.
Relational Strand
purpose: Typed directed edge such as supports, contradicts, elaborates, causes, precedes, or derivedFrom, linking IPs and IAs.
Equivalent to typed knowledge-graph edges used in prior work such as Graphiti and TOBUGraph; no separate external evidence beyond this paper's experiments.
Semantic Oracle Interface (SOI)
purpose: LLM-powered component that converts raw data into structured IPs and synthesizes IAs.
A wrapper around existing LLM APIs; no independent evidence that the interface, rather than the underlying LLM, is responsible for the reported gains.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance Graph." pith.science (2026). https://pith.science/paper/RTRN24DF

@misc{pith2026250608098,
  author       = {Pith},
  title        = {Pith review of: Cognitive Weave: Synthesizing Abstracted Knowledge with a Spatio-Temporal Resonance Graph},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/RTRN24DF}},
  note         = {Machine review of arXiv:2506.08098}
}

read the original abstract

The emergence of capable large language model (LLM) based agents necessitates memory architectures that transcend mere data storage, enabling continuous learning, nuanced reasoning, and dynamic adaptation. Current memory systems often grapple with fundamental limitations in structural flexibility, temporal awareness, and the ability to synthesize higher-level insights from raw interaction data. This paper introduces Cognitive Weave, a novel memory framework centered around a multi-layered spatio-temporal resonance graph (STRG). This graph manages information as semantically rich insight particles (IPs), which are dynamically enriched with resonance keys, signifiers, and situational imprints via a dedicated semantic oracle interface (SOI). These IPs are interconnected through typed relational strands, forming an evolving knowledge tapestry. A key component of Cognitive Weave is the cognitive refinement process, an autonomous mechanism that includes the synthesis of insight aggregates (IAs) condensed, higher-level knowledge structures derived from identified clusters of related IPs. We present comprehensive experimental results demonstrating Cognitive Weave's marked enhancement over existing approaches in long-horizon planning tasks, evolving question-answering scenarios, and multi-session dialogue coherence. The system achieves a notable 34% average improvement in task completion rates and a 42% reduction in mean query latency when compared to state-of-the-art baselines. Furthermore, this paper explores the ethical considerations inherent in such advanced memory systems, discusses the implications for long-term memory in LLMs, and outlines promising future research trajectories.

Figures

Figures reproduced from arXiv: 2506.08098 by the authors.

**Figure 1.** High-level architecture of the Cognitive Weave system, illustrating the interplay between its principal compo [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗

**Figure 2.** The Cognitive Weave System Architecture • Refinement Process Management: Triggering Cognitive Refinement processes based on a set of configurable conditions. These conditions might include temporal triggers (e.g., periodic refinement), event-based triggers (e.g., ingestion of a significant new piece of information), resource availability, or metrics indicating memory saturation or fragmentation. • Integrity and Conc… view at source ↗

**Figure 3.** Conceptual example of a Relational Strand Graph fragment within Cognitive Weave. Insight Particles ( [PITH_FULL_IMAGE:figures/full_fig_p009_3.png] view at source ↗

Figures from the paper (3 more)

**Figure 4.** Figure 4: Task completion rates on the Robotouille dataset across varying levels of task complexity. Cognitive Weave [PITH_FULL_IMAGE:figures/full_fig_p013_4.png]

**Figure 5.** Figure 5: Dialogue coherence metrics on the LoCoMo dataset. Cognitive Weave consistently scores higher across au [PITH_FULL_IMAGE:figures/full_fig_p014_5.png]

**Figure 6.** Figure 6: Query latency scaling with the size of the memory store (number of [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives
cs.AI 2025-06 conditional novelty 4.0 of 10

A survey proposes a macro-meso-micro value framework for agentic AI alignment and maps applications, methods, and benchmarks onto it.

Reference graph

Works this paper leans on

37 extracted references · 23 canonical work pages · cited by 1 Pith paper

[1]

Attention is all you need,

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” inAdvances in Neural Information Processing Systems 30 (NIPS 2017), 2017, pp. 5998–6008

work page 2017
[2]

Language models are few-shot learners,

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-V oss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Rad- ford, I. Sutskever, and D. A...

work page 2020
[3]

GPT-4 technical report,

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, R. Avila, I. Babuschkin, S. Balaji, V . Balcom, P. Baltescu, H. Bao, H. P. Barboza, S. Barta, V . Biskupic, C. McLeavey, postmodern.ai, N. Ryder, A. Lowe, K. O’Bryan, B. McGrew, J. Pachocki, and OpenAI, “GPT-4 technical report,”arXiv pre...

arXiv 2023
[4]

Generative agents: Interactive simulacra of human behavior,

J. S. Park, J. C. O’Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein, “Generative agents: Interactive simulacra of human behavior,” inProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23), 2023, pp. 1–22

work page 2023
[5]

A survey on large language model based autonomous agents,

L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, D. Selsam, J.-F. Gu, H. Purohit, K. Tatwawadi, J. Huang, S. Wang, and Q. Sun, “A survey on large language model based autonomous agents,”arXiv preprint arXiv:2308.11432, 2023

arXiv 2023
[6]

The rise and potential of large language model based agents: A survey,

Z. Xi, W. Chen, X. Wang, Y . Dou, C. Zhang, Z. Wang, Y . Wang, Y . Li, F. Jin, H. Zhao, Y . Yu, S. Sun, Y . Liu, Y . Yang, D. Xie, Y . Tian, Y . Su, C. Yan, Y . Huang, S. Huang, H. Zhao, Z. Ma, Z. Wang, P. Yu, Z. Wang, Y . Liu, H. Liu, K. Miao, W. Ma, J. Li, Z. Chen, Y . Zhao, Q. Zhang, K. Zhang, G. Shen, Z. Song, Z. Li, C. Chen, Y . Ye, Z. Li, Y . Zhang,...

arXiv 2023
[7]

React: Synergizing reasoning and acting in language models,

S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y . Cao, “React: Synergizing reasoning and acting in language models,” inInternational Conference on Learning Representations (ICLR), 2023. 21

work page 2023
[8]

Reflexion: Language agents with verbal reinforcement learning,

N. Shinn, F. Cassano, E. Berman, A. Gopinath, K. Narasimhan, and S. Yao, “Reflexion: Language agents with verbal reinforcement learning,”arXiv preprint arXiv:2303.11366, 2023

arXiv 2023

Show all 37 references

[9]

Retrieval-augmented generation for knowledge-intensive NLP tasks,

P. Lewis, E. Perez, A. Piktus, F. Petroni, V . Karpukhin, N. Goyal, H. Küttler, M. Lewis, W. tau Yih, T. Rocktäschel, S. Riedel, and D. Kiela, “Retrieval-augmented generation for knowledge-intensive NLP tasks,” inAdvances in Neu- ral Information Processing Systems 33 (NeurIPS ...

2020
[10]

Dense passage retrieval for open-domain question answering,

V . Karpukhin, B. O ˘guz, S. Min, P. Lewis, L. Wu, S. Edunov, D. Chen, and W. tau Yih, “Dense passage retrieval for open-domain question answering,” inProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020, pp. 6769–6781

2020
[11]

Improving language models by retrieving from trillions of tokens,

S. Borgeaud, A. Mensch, J. Hoffmann, T. Cai, E. Rutherford, K. Millican, G. van den Driessche, J.-B. Lespiau, B. Damoc, A. Clark, D. de Las Casas, A. Guy, J. Menick, R. Ring, T. Hennigan, S. Huang, L. Maggiore, C. Jones, A. Cassirer, A. Brock, M. Paganini, G. Irving, O. Vinyal...

2022
[12]

Memgpt: Towards llms as operating systems,

C. Packer, V . Fang, S. G. Lin, S. Compton, L. Gao, P. Abbeel, J. E. Gonzalez, I. Stoica, and M. I. Jordan, “Memgpt: Towards llms as operating systems,”arXiv preprint arXiv:2310.08560, 2023

2023 arXiv
[13]

Revisiting agent memory: What are the limitations of current memory systems for llm-based agents?

S. Lee, S. Lee, S. Kim, and M. Kim, “Revisiting agent memory: What are the limitations of current memory systems for llm-based agents?”arXiv preprint arXiv:2402.02632, 2024

2024 arXiv
[14]

Locomo: Long conversational memory for multi-session dialogue,

A. Maharana, V . Rawte, H. Nahata, D. Raghu, G. Shah, M. Kumar, and R. R. Shah, “Locomo: Long conversational memory for multi-session dialogue,”arXiv preprint arXiv:2402.05720, 2024

2024 arXiv
[15]

A-MEM: An agentic memory system for llm-based agents,

C. Xu, J. Li, Q. Wang, Y . Zhang, and W. X. Chang, “A-MEM: An agentic memory system for llm-based agents,” arXiv preprint arXiv:2405.16725, 2024

2024 arXiv
[16]

Memory-augmented large language models for long-term interaction and reasoning: A survey,

S. Sun, W. Chen, X. Wang, Y . Zhao, Y . Dou, Y . Wang, Y . Tian, C. Yan, Y . Liu, Y . Yu, and Z. Xi, “Memory-augmented large language models for long-term interaction and reasoning: A survey,”arXiv preprint arXiv:2405.02889, 2024

2024 arXiv
[17]

Memorybank: Enhancing large language models with long-term memory,

Q. Zhong, H. Zhang, Z. Wang, J. Wang, W. Wang, H. Zhao, J. Huang, Q. Du, H. Yan, M. Zhu, B. Chen, and M. Yang, “Memorybank: Enhancing large language models with long-term memory,”arXiv preprint arXiv:2311.09032, 2023

2023 arXiv
[18]

Mem0: A memory layer for ai agents,

R. Wang, Z. Zhang, W. Zhao, Y . Chen, Z. Wang, X. Yang, Y . Wang, L. Yuan, Z. Yao, Y . Zhuang, B. Hooi, P. Zhao, Y . Bengio, and Y . Zhang, “Mem0: A memory layer for ai agents,”arXiv preprint arXiv:2401.17603, 2024

2024 arXiv
[19]

Kadavy,Digital Zettelkasten: Principles, Methods, & Examples

D. Kadavy,Digital Zettelkasten: Principles, Methods, & Examples. Kadavy, Inc., 2021

2021
[20]

Graphiti: Temporal knowledge graphs for llm applications,

Zep Authors, “Graphiti: Temporal knowledge graphs for llm applications,” https://www.getzep.com/blog/ graphiti-temporal-knowledge-graphs-for-llm-applications, 2024

2024
[21]

Spatio-temporal memory system,

J. C. Hawkins, S. Ahmad, and Y . Cui, “Spatio-temporal memory system,” Patent US 8,515,899 B2, Aug 20, 2013

2013
[22]

Memlong: Memory-augmented retrieval for long text modeling,

W. Liu, Z. Tang, J. Li, K. Chen, and M. Zhang, “Memlong: Memory-augmented retrieval for long text modeling,” arXiv preprint arXiv:2408.16967, 2024

2024 arXiv
[23]

Focused transformer: Contrastive training for context scaling,

S. Tworkowski, K. Staniszewski, M. Pacek, Y . Wu, H. Michalewski, and P. Miło´s, “Focused transformer: Contrastive training for context scaling,”Advances in neural information processing systems, vol. 36, pp. 42 661–42 688, 2023

2023
[24]

A graph- based approach for conversational ai-driven personal memory capture and retrieval in a real-world application,

S. Kashmira, J. L. Dantanarayana, J. Brodsky, A. Mahendra, Y . Kang, K. Flautner, L. Tang, and J. Mars, “A graph- based approach for conversational ai-driven personal memory capture and retrieval in a real-world application,” arXiv preprint arXiv:2412.05447, 2024

2024
[25]

A survey on the memory mechanism of large language model based agents,

Z. Zhang, X. Bo, C. Ma, R. Li, X. Chen, Q. Dai, J. Zhu, Z. Dong, and J.-R. Wen, “A survey on the memory mechanism of large language model based agents,”arXiv preprint arXiv:2404.13501, 2024

2024 arXiv
[26]

Meminsight: Autonomous memory augmentation for llm agents,

R. Salama, J. Cai, M. Yuan, A. Currey, M. Sunkara, Y . Zhang, and Y . Benajiba, “Meminsight: Autonomous memory augmentation for llm agents,”arXiv preprint arXiv:2503.21760, 2025. 22

2025 arXiv
[27]

" my agent understands me better

Y . Hou, H. Tamoto, and H. Miyashita, “" my agent understands me better": Integrating dynamic human-like memory recall and consolidation in llm-based agents,” inExtended Abstracts of the CHI Conference on Human Factors in Computing Systems, 2024, pp. 1–7

2024
[28]

Agent workflow memory,

Z. Z. Wang, J. Mao, D. Fried, and G. Neubig, “Agent workflow memory,”arXiv preprint arXiv:2409.07429, 2024

2024 arXiv
[29]

Arigraph: Learning knowledge graph world models with episodic memory for llm agents,

P. Anokhin, N. Semenov, A. Sorokin, D. Evseev, A. Kravchenko, M. Burtsev, and E. Burnaev, “Arigraph: Learning knowledge graph world models with episodic memory for llm agents,”arXiv preprint arXiv:2407.04363, 2024

2024 arXiv
[30]

Azure openai service models - gpt-4 and gpt-4 turbo (o4 mini is often an internal/shorthand reference for gpt-4 omni mini if it exists, or a similar compact gpt-4 variant),

Microsoft Azure, “Azure openai service models - gpt-4 and gpt-4 turbo (o4 mini is often an internal/shorthand reference for gpt-4 omni mini if it exists, or a similar compact gpt-4 variant),” https://azure.microsoft.com/en-us/ products/ai-services/openai-service, 2024

2024
[31]

Sentence-bert: Sentence embeddings using siamese bert-networks,

N. Reimers and I. Gurevych, “Sentence-bert: Sentence embeddings using siamese bert-networks,” inProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019...

2019
[32]

Billion-scale similarity search with gpus,

J. Johnson, M. Douze, and H. Jégou, “Billion-scale similarity search with gpus,” inIEEE Transactions on Big Data, vol. 7, no. 3, 2019, pp. 535–547

2019
[33]

Robotouille: A recipe for large language model evaluation in interactive environments,

G. Wang, K. Subramanian, W. Agnew, A. Kumar, K.-H. Min, S. Yao, K. Narasimhan, J. Steinhardt, and P. Liang, “Robotouille: A recipe for large language model evaluation in interactive environments,” inProceedings of the International Conference on Learning Representations (ICLR), 2024

2024
[34]

BLEU: a method for automatic evaluation of machine translation,

K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “BLEU: a method for automatic evaluation of machine translation,” inProceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), 2002, pp. 311– 318

2002
[35]

ROUGE: A package for automatic evaluation of summaries,

C.-Y . Lin, “ROUGE: A package for automatic evaluation of summaries,” inText Summarization Branches Out: Proceedings of the ACL-04 Workshop, 2004, pp. 74–81

2004
[36]

T. M. Cover and J. A. Thomas,Elements of Information Theory, 1st ed. Wiley, 1991

1991
[37]

Modeling by shortest data description,

J. Rissanen, “Modeling by shortest data description,”Automatica, vol. 14, no. 5, pp. 465–471, 1978. 23

1978

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.

[1] [1]

Attention is all you need,

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” inAdvances in Neural Information Processing Systems 30 (NIPS 2017), 2017, pp. 5998–6008

work page 2017

[2] [2]

Language models are few-shot learners,

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-V oss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Rad- ford, I. Sutskever, and D. A...

work page 2020

[3] [3]

GPT-4 technical report,

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, R. Avila, I. Babuschkin, S. Balaji, V . Balcom, P. Baltescu, H. Bao, H. P. Barboza, S. Barta, V . Biskupic, C. McLeavey, postmodern.ai, N. Ryder, A. Lowe, K. O’Bryan, B. McGrew, J. Pachocki, and OpenAI, “GPT-4 technical report,”arXiv pre...

arXiv 2023

[4] [4]

Generative agents: Interactive simulacra of human behavior,

J. S. Park, J. C. O’Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein, “Generative agents: Interactive simulacra of human behavior,” inProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST ’23), 2023, pp. 1–22

work page 2023

[5] [5]

A survey on large language model based autonomous agents,

L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, D. Selsam, J.-F. Gu, H. Purohit, K. Tatwawadi, J. Huang, S. Wang, and Q. Sun, “A survey on large language model based autonomous agents,”arXiv preprint arXiv:2308.11432, 2023

arXiv 2023

[6] [6]

The rise and potential of large language model based agents: A survey,

Z. Xi, W. Chen, X. Wang, Y . Dou, C. Zhang, Z. Wang, Y . Wang, Y . Li, F. Jin, H. Zhao, Y . Yu, S. Sun, Y . Liu, Y . Yang, D. Xie, Y . Tian, Y . Su, C. Yan, Y . Huang, S. Huang, H. Zhao, Z. Ma, Z. Wang, P. Yu, Z. Wang, Y . Liu, H. Liu, K. Miao, W. Ma, J. Li, Z. Chen, Y . Zhao, Q. Zhang, K. Zhang, G. Shen, Z. Song, Z. Li, C. Chen, Y . Ye, Z. Li, Y . Zhang,...

arXiv 2023

[7] [7]

React: Synergizing reasoning and acting in language models,

S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y . Cao, “React: Synergizing reasoning and acting in language models,” inInternational Conference on Learning Representations (ICLR), 2023. 21

work page 2023

[8] [8]

Reflexion: Language agents with verbal reinforcement learning,

N. Shinn, F. Cassano, E. Berman, A. Gopinath, K. Narasimhan, and S. Yao, “Reflexion: Language agents with verbal reinforcement learning,”arXiv preprint arXiv:2303.11366, 2023

arXiv 2023