Pith. Sign in

RECORD

MemForm: Benchmarking Memory Formation Poisoning in LLM Agents

Cryptography and Security · Submitted 10 Oct 2026

abstract compiled · 2026-10-14 · no language-model review

The authors' main claim These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences.

how it is stated · asserted 0.67 read the record →

Comment (0) Read on arXiv ↗
Cite ▾
arXiv ID2610.14431 (version 2)
Pith IDSLZV2H6F, Pith's permanent record of this paper and its review
CitationHaowen Pan, Naixin Zhai, Pengyang Shao, Xiang Wang, Xun Yang, Yanzheng Jin, Yunshan Ma. "MemForm: Benchmarking Memory Formation Poisoning in LLM Agents." arXiv:2610.14431 (2026). https://pith.science/paper/SLZV2H6F
Claim paper

The compiled record

The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.

Open the compiled record

Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-10-14: 1 request, 8,705 input tokens.

What the abstract itself states, as probabilities: claims first 0.12 · states limitation 0.71 · human participants 0.04 · controlled comparison 0.90 · randomized assignment 0.03 · states quantitative result 0.52 · compares with prior results 0.68 · mentions code or data availability 0.99.

The abstract, sentence by sentence

arXiv listing abstract v1. Results and the main claim are underlined; .

Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. Each category pairs clean and poisoned conditions with interface-specific controls. Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. The evaluated defenses provide incomplete mitigation that varies by interface. These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. Code and data are available at https://github.com/opanhw/memform-code.

background contribution method result interpretation main claim

What the classifier reports for each sentence. The number is the probability it gave the label.
#sentencerolethe authors' own workstates the main conclusionstrength
s0 Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. background 1.00 0.06 0.04 asserted 1.00
s1 Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. gap 1.00 0.07 0.03 asserted 1.00
s2 We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. contribution 1.00 0.96 0.09 asserted 1.00
s3 We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. method 0.52 0.92 0.05 asserted 1.00
s4 Each category pairs clean and poisoned conditions with interface-specific controls. method 0.98 0.83 0.03 asserted 0.99
s5 Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. result 1.00 0.96 0.32 asserted 1.00
s6 Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. interpretation 0.66 0.88 0.54 asserted 0.95
s7 In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. result 0.90 0.87 0.15 asserted 0.75
s8 Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. result 0.98 0.94 0.05 asserted 1.00
s9 The evaluated defenses provide incomplete mitigation that varies by interface. result 0.99 0.88 0.08 asserted 1.00
s10 These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. interpretation 0.82 0.46 0.62 asserted 0.67
s11 Code and data are available at https://github.com/opanhw/memform-code. contribution 0.85 0.41 0.02 asserted 0.94

What kind of paper the classifier reports this is: dataset or benchmark 1.00 · evidence from observation or experiment 0.99.

What was examined, and what was not

sources read
  • arXiv listing abstract v1
not examined
  • full text
  • figures and tables
  • references and citing sentences
  • relations to other papers
levels run
  • P abstract
not run
  • S sections
  • T body sentences
  • C citations
  • R cross-paper relations

Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. Every number in the measurements table is the authors', checked by code. Record as JSON

The paper
Original abstract

Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. Each category pairs clean and poisoned conditions with interface-specific controls. Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. The evaluated defenses provide incomplete mitigation that varies by interface. These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. Code and data are available at https://github.com/opanhw/memform-code.

Human review

Discussion

Know something about this paper? Leave a comment, or highlight any passage above to comment on it.