REVIEW 11 cited by
Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Human intelligence thrives on cognitive synergy, where collaboration among different minds yield superior outcomes compared to isolated individuals. In this work, we propose Solo Performance Prompting (SPP), which transforms a single LLM into a cognitive synergist by engaging in multi-turn self-collaboration with multiple personas. A cognitive synergist is an intelligent agent that collaboratively combines multiple minds' strengths and knowledge to enhance problem-solving in complex tasks. By dynamically identifying and simulating different personas based on task inputs, SPP unleashes the potential of cognitive synergy in LLMs. Our in-depth analysis shows that assigning multiple fine-grained personas in LLMs improves problem-solving abilities compared to using a single or fixed number of personas. We evaluate SPP on three challenging tasks: Trivia Creative Writing, Codenames Collaborative, and Logic Grid Puzzle, encompassing both knowledge-intensive and reasoning-intensive types. Unlike previous works, such as Chain-of-Thought, that solely enhance the reasoning abilities in LLMs, experimental results demonstrate that SPP effectively reduces factual hallucination, and maintains strong reasoning capabilities. Additionally, comparative experiments show that cognitive synergy only emerges in GPT-4 and does not appear in less capable models, such as GPT-3.5-turbo and Llama2-13b-chat, which draws an interesting analogy to human development. Code, data, and prompts can be found at: https://github.com/MikeWangWZHL/Solo-Performance-Prompting.git.
Forward citations
Cited by 11 Pith papers
-
ValueFlow: Measuring the Propagation of Value Perturbations in Multi-Agent LLM Systems
A perturbation-based framework measures how value opinions propagate through multi-agent LLM systems, revealing that susceptibility varies by value, model, and topology.
-
KVFlow: Efficient Prefix Caching for Accelerating LLM-Based Multi-Agent Workflows
KVFlow uses workflow-aware eviction priorities and overlapped KV prefetching to cut cache-miss latency in LLM multi-agent serving.
-
Spec2RTL-Agent: Automated Hardware Code Generation from Complex Specifications Using LLM Agent Systems
On three NIST crypto standards (AES, DSS, HMAC), Spec2RTL-Agent generates RTL via a multi-agent pipeline from pseudocode to Python to synthesizable C++, reporting 3/3 correct designs with about 4.3 human interventions...
-
MasHost Builds It All: Autonomous Multi-Agent System Directed by Reinforcement Learning
MasHost uses reinforcement learning to autonomously construct query-adaptive multi-agent graphs, and its authors report the best average accuracy across six LLM benchmarks.
-
From Virtual Agents to Robot Teams: A Multi-Robot Framework Evaluation in High-Stakes Healthcare Context
Adding a structured knowledge base raised a simulated CrewAI healthcare robot team's process score from 45.29% to 72.94%, but five failure modes, including false completion and poor recovery, persisted.
-
The Virtual Roundtable: Multi-Agent Personas Simulating the Dynamics of Human Brainstorming
Facilitated multi-agent personas can run divergent-then-convergent brainstorming; longer discussion deepens idea lineage and cross-persona absorption but does not increase idea diversity.
-
P-CoT: A Pedagogically-motivated Participatory Chain-of-Thought Prompting for Phonological Reasoning in LLMs
P-CoT prompting improves many LLM results on PhonologyBench tasks, but it does not consistently beat baselines across all models and tasks as the paper claims.
-
SciSage: A Multi-Agent Framework for High-Quality Scientific Survey Generation
SciSage, a multi-agent reflection-based framework, is reported to outperform previous LLM survey generators on coherence and citation F1, while a new benchmark, SurveyScope, enables standardized evaluation.
-
DRF: LLM-AGENT Dynamic Reputation Filtering Framework
DRF combines an LLM rating network, a reputation update rule, and a UCB-style selection strategy to filter low-quality LLM agents during multi-agent task execution, reporting improved pass@1 and lower simulated cost o...
-
LRCTI: A Large Language Model-Based Framework for Multi-Step Evidence Retrieval and Reasoning in Cyber Threat Intelligence Credibility Verification
LRCTI uses an LLM to summarize threat reports, retrieve evidence in several rounds, and judge each claim credible or incredible, reporting strong F1 gains on CTI-200 and PolitiFact.
-
Mixture of Reasonings: Teach Large Language Models to Reason with Adaptive Strategies
MoR fine-tunes Qwen2.5 on GPT-4o-selected reasoning templates, claiming up to 13.5% accuracy gains, but the reported gains are not robustly supported.
Discussion (0). Sign in to comment.