Pith. sign in

REVIEW 8 cited by

A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2402.09727 v3 pith:P2UYW44N submitted 2024-02-15 cs.CL cs.AIcs.IR

classification cs.CLcs.AIcs.IR
keywords readagentlongcontextgistmemoriesmemoryagentbaselines
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Current Large Language Models (LLMs) are not only limited to some maximum context length, but also are not able to robustly consume long inputs. To address these limitations, we propose ReadAgent, an LLM agent system that increases effective context length up to 20x in our experiments. Inspired by how humans interactively read long documents, we implement ReadAgent as a simple prompting system that uses the advanced language capabilities of LLMs to (1) decide what content to store together in a memory episode, (2) compress those memory episodes into short episodic memories called gist memories, and (3) take actions to look up passages in the original text if ReadAgent needs to remind itself of relevant details to complete a task. We evaluate ReadAgent against baselines using retrieval methods, using the original long contexts, and using the gist memories. These evaluations are performed on three long-document reading comprehension tasks: QuALITY, NarrativeQA, and QMSum. ReadAgent outperforms the baselines on all three tasks while extending the effective context window by 3.5-20x.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. MemOPD: On-Policy Distillation through Memory State Alignment for Long-Horizon Agents

    cs.AI 2026-08 conditional novelty 7.0 of 10

    Reconstructing the exact model invocation state for each sampled action, instead of flattening the whole interaction, lets teacher distillation guide compact-memory agents without state mismatch.

  2. Is Progressive Disclosure All You Need for Long-Context Agents?

    cs.AI 2026-07 conditional novelty 7.0 of 10

    Progressive disclosure is redundant for a strong agent reading one book, but decisive when an agent must navigate a 20-book library; one flat routing level beats deeper hierarchies.

  3. AgentMemBench: A Systematic Benchmark for Evaluating Long-Term Memory Management Strategies in Conversational AI Agents

    cs.CL 2026-06 conditional novelty 6.0 of 10

    A benchmark comparing five memory strategies for conversational agents on three public datasets finds dense vector retrieval alone maintains long-range recall, at roughly 25 times the token cost of recency windows.

  4. AgentKVShift: Efficient KV Cache Reuse for Agentic Memory Systems

    cs.AI 2026-05 conditional novelty 6.0 of 10

    AgentKVShift corrects all reused KV cache entries in agentic memory by estimating a chunk-level residual offset from a small probe set, recovering near-fresh accuracy at 10–30% recompute ratios.

  5. StoryBench: A Dynamic Benchmark for Evaluating Long-Term Memory with Multi Turns

    cs.CL 2025-06 conditional novelty 6.0 of 10

    StoryBench introduces a branching interactive-fiction benchmark with immediate-feedback and self-recovery modes, and shows that current LLMs fail at long-term memory tasks, especially self-correction.

  6. Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools

    cs.AI 2025-02 conditional novelty 6.0 of 10

    An agentic reasoning framework that adds web search, code execution, and knowledge-graph memory to an LLM, boosting performance on expert-level benchmarks close to proprietary deep research systems.

  7. Hierarchical Memory for High-Efficiency Long-Term Reasoning in LLM Agents

    cs.CL 2025-07 conditional novelty 5.0 of 10

    H-MEM organizes LLM agent memory into a four-level semantic hierarchy with pointer-based coarse-to-fine retrieval, improving average LoCoMo QA scores over five baselines while cutting retrieval cost.

  8. A Novel Self-Evolution Framework for Large Language Models

    cs.CL 2025-07 reject novelty 4.0 of 10

    A dual-phase framework that uses a Censor satisfaction scorer to expand training data and then applies SFT plus frequency-weighted DPO, reporting benchmark gains over SFT, PO, and memory baselines.

Pith tools