REVIEW 4 cited by
Opportunities and Risks of LLMs for Scalable Deliberation with Polis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Polis is a platform that leverages machine intelligence to scale up deliberative processes. In this paper, we explore the opportunities and risks associated with applying Large Language Models (LLMs) towards challenges with facilitating, moderating and summarizing the results of Polis engagements. In particular, we demonstrate with pilot experiments using Anthropic's Claude that LLMs can indeed augment human intelligence to help more efficiently run Polis conversations. In particular, we find that summarization capabilities enable categorically new methods with immense promise to empower the public in collective meaning-making exercises. And notably, LLM context limitations have a significant impact on insight and quality of these results. However, these opportunities come with risks. We discuss some of these risks, as well as principles and techniques for characterizing and mitigating them, and the implications for other deliberative or political systems that may employ LLMs. Finally, we conclude with several open future research directions for augmenting tools like Polis with LLMs.
Forward citations
Cited by 4 Pith papers
-
A Roadmap to Impactful Pluralistic Alignment Research
Pluralistic alignment research has produced no public evidence of adoption in deployed frontier models, so the field should focus on empirical justification, settled goals, and hill-climbable evaluations.
-
Knowledge-guided Contextual Gene Set Analysis Using Large Language Models
cGSA combines gene clustering, enrichment analysis, and LLM filtering to prioritize contextually relevant pathways, beating g:Profiler, GPT-4o, and Llama baselines by over 30% on a new manually curated benchmark.
-
Generative Social Choice: The Next Generation
The authors design a democratic process that uses approximate AI-driven queries to select a budget-limited slate of statements with provable approximate proportionality guarantees, and they test it with GPT-4o on real...
-
Of the People, By the Algorithm: How AI Transforms Democratic Representation
AI will reshape representative democracy, pushing representatives toward architect roles for automated decision frameworks and hybrid systems of digital participation.
Discussion (0). Continue with ORCID to comment.