REVIEW 4 cited by
Thinking Fast and Slow in Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs like GPT-3 exhibit behavior that strikingly resembles human-like intuition - and the cognitive errors that come with it. However, LLMs with higher cognitive capabilities, in particular ChatGPT and GPT-4, learned to avoid succumbing to these errors and perform in a hyperrational manner. For our experiments, we probe LLMs with the Cognitive Reflection Test (CRT) as well as semantic illusions that were originally designed to investigate intuitive decision-making in humans. Our study demonstrates that investigating LLMs with methods from psychology has the potential to reveal otherwise unknown emergent traits.
Forward citations
Cited by 4 Pith papers
-
Adversarial Testing in LLMs: Insights into Decision-Making Vulnerabilities
An adversarial-agent framework adapted from human decision-making research reveals that GPT-4, Gemini-1.5, and DeepSeek-V3 are more rigid and easily manipulated in bandit and trust-game tasks than GPT-3.5 or humans.
-
System-2 Mathematical Reasoning via Enriched Instruction Tuning
Enriched Instruction Tuning (EIT) uses GPT-4 to add planning and missing reasoning steps to human-annotated math solutions, and fine-tuning LLaMA-2 on this data yields 84.1% on GSM8K and 32.5% on MATH.
-
DSADF: Thinking Fast and Slow for Decision Making
A dual-system framework where an RL agent handles familiar subtasks and a VLM planner/executor handles unfamiliar ones improves task success and speed in Crafter and Housekeep.
-
Agentic Web: Weaving the Next Web with AI Agents
A position paper defines the Agentic Web as the next web era and proposes a three-dimensional conceptual framework for understanding and building it.
Discussion (0). Continue with ORCID to comment.