REVIEW 17 cited by
Graph of Thoughts: Solving Elaborate Problems with Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce Graph of Thoughts (GoT): a framework that advances prompting capabilities in large language models (LLMs) beyond those offered by paradigms such as Chain-of-Thought or Tree of Thoughts (ToT). The key idea and primary advantage of GoT is the ability to model the information generated by an LLM as an arbitrary graph, where units of information ("LLM thoughts") are vertices, and edges correspond to dependencies between these vertices. This approach enables combining arbitrary LLM thoughts into synergistic outcomes, distilling the essence of whole networks of thoughts, or enhancing thoughts using feedback loops. We illustrate that GoT offers advantages over state of the art on different tasks, for example increasing the quality of sorting by 62% over ToT, while simultaneously reducing costs by >31%. We ensure that GoT is extensible with new thought transformations and thus can be used to spearhead new prompting schemes. This work brings the LLM reasoning closer to human thinking or brain mechanisms such as recurrence, both of which form complex networks.
Forward citations
Cited by 17 Pith papers
-
Improving Public Service Chatbot Design and Civic Impact: Investigation of Citizens' Perceptions of a Metro City 311 Chatbot
A qualitative case study of Atlanta's 311 chatbot finds that its task-focused design creates interpretation, transparency, and social-context gaps, and suggests community-oriented features to increase civic engagement.
-
From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs
On 2,520 programming tasks, matched Qwen general and coder models reliably raise Bloom cognitive demand but fail to lower it, so execution skill does not imply educational control.
-
LLM Agents for Deliberative Collaboration: A Study on Joint Decision Making Under Partial Observability
A benchmark for LLM agents in partially observable joint decision-making reveals that deliberation challenges current models but can enable reflection and error correction.
-
DeepLook: Deeper Thinking with Lookahead
A training-free decoder that branches only at low-confidence reasoning segments and ranks continuations by average lookahead confidence reports equal or better accuracy at roughly 1/8 of a confidence-filtered baseline...
-
A Simple "Try Again" Can Elicit Multi-Turn LLM Reasoning
Multi-turn RL with only unary 'try again' feedback improves multi-turn reasoning accuracy by up to 14% while preserving single-turn performance.
-
Sample More, Reflect Less: Self-Refine and Reflexion Lose to Repeated Sampling at Equal Token Cost, from 1.5B to 7B
Self-inspection methods (Self-Refine, Reflexion, Best-of-N self-verify) lose to equal-token repeated sampling on math from 1.5B to 7B; no tested method reliably wins.
-
LLM-as-a-Verifier: A General-Purpose Verification Framework
Expecting over scoring-token logits yields continuous, scalable verification that improves agent trajectory selection and dense RL rewards across coding, robotics, and medical benchmarks.
-
Vis-CoT: A Human-in-the-Loop Framework for Interactive Visualization and Intervention in LLM Chain-of-Thought Reasoning
An interactive chain-of-thought editor with prune and graft interventions reports large accuracy gains, but without error bars, code, or a comparison to existing editing tools.
-
Integrating Quantized LLMs into Robotics Systems as Edge AI to Leverage their Natural Language Processing Capabilities
llama_ros brings quantized LLMs to ROS 2 via llama.cpp, enabling local edge-AI text generation, tokenization, and embeddings in robotics.
-
Speculative Reward Model Boosts Decision Making Ability of LLMs Cost-Effectively
A plug-and-play external reward model with speculative rejection sampling cuts tree-search cost for LLM decision-making to about 1/10 while keeping or slightly improving accuracy on math, planning, and financial reaso...
-
Pheromone-based Learning of Optimal Reasoning Paths
An ant-colony-optimization-guided tree-of-thought method with multiple fine-tuned LLM experts reports accuracy gains on GSM8K, ARC-Challenge, and MATH over CoT, ToT, and IRPO baselines.
-
Agent-Centric Projection of Prompting Techniques and Implications for Synthetic Training Data for Large Language Models
The paper defines linear and non-linear interaction contexts for LLMs and conjectures that prompting techniques and multi-agent systems are equivalent projections of the same patterns.
-
Focus Is All You Need: Adaptive Goal-aware Attention Orchestration for Multi-Agent Graph Systems
AGAO dynamically prioritizes agents in multi-agent graphs using goal, topology, and resource attention, improving coding pass rates while cutting active nodes and agent time on small pilot tasks.
-
Less is More Tokens: Efficient Math Reasoning via Difficulty-Aware Chain-of-Thought Distillation
Difficulty-aware compression of CoT traces plus SFT and DPO lets LLMs shorten reasoning on easy math problems, cutting tokens by up to 30% with mixed accuracy effects.
-
GraphTrafficGPT: Enhancing Traffic Management Through Graph-Based AI Agent Coordination
GraphTrafficGPT replaces TrafficGPT's sequential task chain with a graph-based agent scheduler, reporting 50.2% lower token use, 19.0% lower latency, and parallel multi-query handling.
-
MARBLE: A Multi-Agent Rule-Based LLM Reasoning Engine for Accident Severity Prediction
MARBLE claims near-90% accuracy for accident severity prediction by combining a machine learning model with specialized small language model agents and rule-based coordination, though the comparison to baselines is suspect.
-
Thinking About Thinking: SAGE-nano's Inverse Reasoning for Self-Aware Language Models
A 4B-parameter model is claimed to explain its own reasoning through inverse attention analysis, but the paper offers no consistent evidence or artifacts.
Discussion (0). Continue with ORCID to comment.