Pith. sign in

REVIEW 5 cited by

Hypothetical Minds: Scaffolding Theory of Mind for Multi-Agent Tasks with Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.07086 v2 pith:QSFG7ET7 submitted 2024-07-09 cs.AI

classification cs.AI
keywords agentshypotheseshypotheticallanguagemindsmulti-agentagentbaselines
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Multi-agent reinforcement learning (MARL) methods struggle with the non-stationarity of multi-agent systems and fail to adaptively learn online when tested with novel agents. Here, we leverage large language models (LLMs) to create an autonomous agent that can handle these challenges. Our agent, Hypothetical Minds, consists of a cognitively-inspired architecture, featuring modular components for perception, memory, and hierarchical planning over two levels of abstraction. We introduce the Theory of Mind module that scaffolds the high-level planning process by generating hypotheses about other agents' strategies in natural language. It then evaluates and iteratively refines these hypotheses by reinforcing hypotheses that make correct predictions about the other agents' behavior. Hypothetical Minds significantly improves performance over previous LLM-agent and RL baselines on a range of competitive, mixed motive, and collaborative domains in the Melting Pot benchmark, including both dyadic and population-based environments. Additionally, comparisons against LLM-agent baselines and ablations reveal the importance of hypothesis evaluation and refinement for succeeding on complex scenarios.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Validating Generative Agent-Based Models of Social Norm Enforcement: From Replication to Novel Predictions

    cs.MA 2025-07 conditional novelty 6.0 of 10

    Language model agents with personality and theory-of-mind prompts reproduce human third-party punishment and gossip effects, and predict lower anonymous punishment and higher cooperation after group discussion.

  2. Understanding Human Limits in Pattern Recognition: A Computational Model of Sequential Reasoning in Rock, Paper, Scissors

    q-bio.NC 2025-07 conditional novelty 6.0 of 10

    An LLM agent reproduces human rock-paper-scissors pattern learning, and interventions suggest that hypothesis generation, not evaluation, is the main cognitive bottleneck.

  3. Modeling Open-World Cognition as On-Demand Synthesis of Probabilistic Models

    cs.CL 2025-07 conditional novelty 6.0 of 10

    A hybrid language-model and probabilistic-program architecture predicts human judgments on novel open-world reasoning vignettes better than language-model-only baselines.

  4. A Framework for Analyzing Abnormal Emergence in Service Ecosystems Through LLM-based Agent Intention Mining

    cs.AI 2025-07 reject novelty 5.0 of 10

    EAMI extracts agent intentions from LLM thought traces, clusters them by meaning, and builds temporal diagrams that trace how new intentions spread through a simulated ecosystem.

  5. Reasoning and Behavioral Equilibria in LLM-Nash Games: From Mindsets to Actions

    cs.AI 2025-07 reject novelty 4.0 of 10

    The paper proposes LLM-Nash games, an equilibrium over reasoning prompts that induce action distributions, and argues via a rock-paper-scissors example that such equilibria can differ from classical Nash outcomes.

Pith tools