REVIEW 2 major objections 5 minor 32 references
Generative Social Choice: The Next Generation
T0 review · 2 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read A democratic process can generate a proportional slate of opinion statements from imperfect LLM queries, and the fairness loss is exactly quantifiable and essentially unavoidable.
desk verdict Solid theory connecting query accuracy to cost-BJR, but the deployed system's accuracy parameters are never measured; the impossibility results alone justify a serious referee. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the pair of approximate query types together with the loop structure of Algorithm 1. A discriminative query $Disc(i,\alpha)$ returns $u_i(\alpha)$ with additive error $\beta$, while a generative query $Gen(S,\ell,x)$ returns a statement whose support at relaxed utility $\ell-\delta$ is at least a $\gamma$ fraction of the best statement of cost at most $\mu x$, bounding misestimation of utility, supporters, and cost. Complex-DemocraticProcess takes $C=[B]$ and $f(\ell)=[\ell,r]$, so at each utility level it queries across all costs and all higher levels, selects the generated statement with the most predicted approvers, and removes exactly its fair share of agents. The proof takes the first agent of a hypothetical violating coalition that gets removed and shows its assigned utility must contradict the violation, while the impossibility theorems construct adversarial query answers that hide every good statement from the algorithm.
What would settle it
Measure the four accuracy parameters on a deployed system: collect true utility judgments such as the Polis up-vote and down-vote pairs, and check whether GPT-4o's discriminative estimates stay within $\beta$ of true values and whether generated statements satisfy the support ratio in Equation (1) for the advertised $(\gamma,\delta,\mu)$. If violations occur on a non-negligible fraction of queries, the theorem's premise fails. On the theoretical side, running any algorithm on the $n=2B$, $B\ge 8$ instance constructed in Theorem 3.3 and achieving $(2\beta+\delta-\epsilon,1)$-costBJR would refute the impossibility claim.
Extended reading notes
Core claim
On its own terms, the paper's central result is that approximate proportionality guarantees survive approximate queries. For a budget $B$ over statement costs, a coalition $S$ deserves a statement $\alpha$ if $|S| \ge d\cdot\lceil c(\alpha)n/B\rceil$, and a slate satisfies $(b,d)$-costBJR when each agent can be matched to a statement in a balanced way so that no such coalition agrees on $\alpha$ at threshold $\theta$ while all its members are matched to statements scoring below $\theta-b$. Theorems 3.2 and 3.4 state that Complex-DemocraticProcess, which iterates over utility levels and candidate costs and removes represented agents, achieves $(2\beta+\delta,1/(\gamma\mu))$-costBJR from $\beta$-accurate discriminative and $(\gamma,\delta,\mu)$-accurate generative queries, and that no algorithm can do substantially better: the additive utility-error contribution $2\beta+\delta$ is sharp up to $\epsilon$, and the multiplicative supporter and cost error cannot be improved except for a term vanishing in the slate size. Thus, in the worst case, AI imperfection has an exact, unavoidable price in this setting.
Load-bearing premise
The guarantees hold only if the LLM's errors fit the bounded model: every utility estimate is within $\beta$, and every generated statement is within a $\gamma$ factor of the best statement at relaxed utility $\delta$ and cost factor $\mu$; if real errors exceed these bounds in even one query, the theorem's conclusion does not apply.
Editorial extensions
If this is right
- Slate creation from unstructured text can carry formal proportionality guarantees even when the LLM answers are wrong in bounded ways.
- The additive query error $\beta$ appears twice in the final fairness loss, so improving utility-prediction accuracy yields a double dividend; the multiplicative errors enter as $1/(\gamma\mu)$.
- Because the algorithm is agnostic to query implementation, any future model that satisfies the accuracy bounds inherits the same guarantee without changing the process.
- A budget on total slate length replaces the need to fix the number of statements in advance; the process splits the budget among groups proportionally.
- The impossibility results show that no alternative algorithm can remove the error cost, so the bound is a property of the information model, not of this particular algorithm.
Reading between the lines
- If real LLM errors are heavy-tailed rather than bounded by $\beta$, $\gamma$, $\delta$, and $\mu$, the theorem's guarantee does not apply; a practical calibration step would estimate these parameters on a validation set before deployment.
- Applied to participatory budgeting, the same algorithm would select projects as statements with monetary costs, provided the generative query can propose feasible new projects; the paper notes this is beyond current LLMs but is a natural next target.
- The low correlation between PROSE's discriminative query and the chain-of-thought evaluator suggests that reported utility gains depend heavily on the choice of preference model; a neutral reading is that evaluation and optimization should use different models.
- A testable extension would run the algorithm on synthetic instances with known true utilities, compare observed violations against the $(2\beta+\delta,1/(\gamma\mu))$ envelope, and check whether the gap shrinks as the slate grows.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper extends the generative social choice framework of Fish et al. by adding statement costs and a total budget to the slate-selection problem and by replacing exact queries with an approximate-query model. The authors define (b,d)-costBJR, prove that their Complex-DemocraticProcess with C=[B] and f(ℓ)=[ℓ,r] achieves (2β+δ,1/(γµ))-costBJR for β-accurate discriminative and (γ,δ,µ)-accurate generative queries, and provide impossibility results showing that this dependence is close to optimal. They validate the algorithms in a synthetic environment and introduce PROSE, a GPT-4o-based implementation, which they evaluate on drug-review and Polis datasets against four baselines. The theoretical part is self-contained, with full proofs in the appendix and code provided; the experimental part claims statistically significant improvements in mean and 25th-percentile utilities and fewer cBJR violations.
Significance. The main theoretical result is a clean, parameterized degradation theorem with matching lower bounds, and the proof structure is careful; the synthetic validation is a useful complement because it instantiates the error model directly rather than relying on an LLM. The paper also ships code and full proofs, which materially strengthens the contribution. That said, the significance for practice is currently overstated: the PROSE deployment neither verifies Eq. (1) nor instantiates the exact algorithm of Theorem 3.2, and the evaluation's 'true' utilities are another GPT-4o estimator. The theoretical contribution itself is valuable and publishable; the gap is in the bridge from theorems to the deployed system.
major comments (2)
- [§3.2, Eq. (1), App. D.3] Theorem 3.2's guarantee is conditional on the generative query being (γ,δ,µ)-accurate in the sense of Eq. (1), and on the algorithm running with C=[B] and f(ℓ)=[ℓ,r]. PROSE uses a truncated cost list (e.g., C=[80,70,...,2] for the drug instances), a different approval-level schedule that includes fractional values such as 5.5, and a minimum statement length, so it is not Complex-DemocraticProcess. Moreover, the paper never measures or bounds β,γ,δ,µ for the GPT-4o implementations; the Limitations paragraph concedes that GPT-4o 'comes without guarantees on the query answers,' but that concession is not operationalized. As a result, the framing that 'the cost of AI imperfection is exactly quantifiable' is not established for PROSE, and the abstract's promise of guarantees under approximately optimal queries is only a theorem about an idealized query model, not about the deployed system.
- [§4.2.3, App. D.4, D.5] The experimental evaluation treats the chain-of-thought GPT-4o scores as 'true, underlying utilities' and computes both user-satisfaction comparisons and cBJR violation rates against them. Since PROSE's own discriminative query is also a GPT-4o approximation of the same unknown utilities, the reported improvements could reflect a favorable interaction between two model-based estimators rather than genuine representativeness. The low Pearson correlation (0.13) reported in App. D.5 shows that the two estimators are not identical, but it does not validate the CoT scores as ground truth; the Bowling Green up/downvote check validates the queries on voting behavior, not on the statements and agents evaluated in Table 1. The paper should either obtain human judgments on the generated slates for at least a subset of agent-statement pairs, or explicitly reframe the experiments as a model-in-the-loop evaluation and soften the 'user satisfaction' conclusion.
minor comments (5)
- [Theorem 3.4] The theorem statement contains a typo: 'W it the slate returned' should read 'W is the slate returned'; the proof's footnote gives a more precise B/c version, and the main-text statement should be reconciled with that formulation.
- [Eq. (1)] When the denominator max is zero, the fraction in Eq. (1) is undefined; the paper should specify a convention for this case, since the proof of Theorem 3.4 already relies on such a convention.
- [§4.2.3] The zero-shot baselines receive an optimal maximum-weight balanced assignment while PROSE's internal mapping is used; although the authors acknowledge this asymmetry, they should also report results with PROSE's mapping recomputed by the same optimal assignment, since they state this changes utilities by around 15%.
- [App. D.3] The implementation depends on several free choices (specificity coefficient, approval-level list, cost list, minimum statement lengths, generators, and embedding choice); the claim that PROSE 'does not require dataset-specific tuning' only means the same choices were used across datasets, and the sensitivity of the results to these choices is not explored.
- [Table 1] The pairwise p-values are reported without multiple-comparison correction; with four baselines and four instances there are 16 tests, so some of the 'statistically significant' differences may not survive a correction procedure.
Circularity Check
No significant circularity: the theoretical guarantees are derived from explicit query-accuracy axioms, and the empirical evaluation uses an independent chain-of-thought scorer rather than the algorithm's own scoring function.
full rationale
The paper's derivation chain is self-contained relative to its stated model. Theorem 3.2 is a conditional statement: if discriminative queries are β-accurate and generative queries are (γ, δ, µ)-accurate as defined in Eq. (1), then Complex-DemocraticProcess provably satisfies (2β+δ, 1/(γµ))-costBJR. The proof derives this bound from the accuracy inequalities themselves, not from any quantity being fitted to the axiom or to the empirical results. The impossibility results (Theorems 3.3 and 3.4) are proved by constructing adversarial instances whose generative and discriminative queries satisfy the accuracy definitions; they do not import a uniqueness theorem or rely on the authors' prior work to rule out alternatives. The main self-citations, to Fish et al. [2024], supply the framework and the BJR notion, but the costed axiom, the approximate-query model, the algorithm, and the proofs are new contributions rather than restatements of those citations. Empirically, PROSE is not evaluated with its own discriminative query: the paper deliberately employs a separate chain-of-thought discriminative implementation and treats those CoT utilities as the ground truth for evaluation, additionally validating both implementations against real Polis up/downvote data in Appendix D.5. This addresses the main circularity risk in the experimental design. The genuine weaknesses of the paper are applicability gaps, not circularity: the accuracy parameters β, γ, δ, µ are never measured for GPT-4o, and the deployed PROSE configuration uses a reduced cost list and discrete approval levels, so Theorem 3.2's conditions are not literally satisfied by the implementation. Those are correctness or external-validity limitations, not cases where a prediction is equivalent to its input by construction.
Assumptions & free parameters
free parameters (6)
- specificity coefficient =
1
- approval levels list ℓ =
[5.5, 5, 4.5, 4, 3.5, 3, 2, 1, 0]
- cost list C (drugs) =
[80, 70, 60, 50, 40, 36, 32, 28, 24, 20, 16, 12, 10, 8, 6, 4, 2]
- cost list C (bowling green) =
[80, 60, 40, 36, 32, 28, 24, 20, 16, 12, 8, 4]
- minimum statement lengths =
10 words (drugs), 8 words (Bowling Green)
- clustering / generator choices =
four generators, two embeddings, two runs each
assumptions (4)
- domain assumption Utility functions are cardinal and map to [r], and agents' utilities for statements are additive in the statement content.
- domain assumption The universe U is closed under union of statements, so any two statements can be concatenated into a statement costing the sum of their costs and affording utility at least the sum.
- ad hoc to paper For each cost x in [B], there exists at least one statement in U with that exact cost.
- standard math The generative query returns a statement of cost at most the queried cost x in the approximate version.
invented entities (2)
-
The two-query model with (β,γ,δ,μ)-approximate queries
-
(b,d)-costBJR axiom
Cite this review
Pith. "Pith review of Generative Social Choice: The Next Generation." pith.science (2026). https://pith.science/paper/HAYUJLB6
@misc{pith2026250522939,
author = {Pith},
title = {Pith review of: Generative Social Choice: The Next Generation},
year = {2026},
howpublished = {\url{https://pith.science/paper/HAYUJLB6}},
note = {Machine review of arXiv:2505.22939}
}
read the original abstract
A key task in certain democratic processes is to produce a concise slate of statements that proportionally represents the full spectrum of user opinions. This task is similar to committee elections, but unlike traditional settings, the candidate set comprises all possible statements of varying lengths, and so it can only be accessed through specific queries. Combining social choice and large language models, prior work has approached this challenge through a framework of generative social choice. We extend the framework in two fundamental ways, providing theoretical guarantees even in the face of approximately optimal queries and a budget limit on the overall length of the slate. Using GPT-4o to implement queries, we showcase our approach on datasets related to city improvement measures and drug reviews, demonstrating its effectiveness in generating representative slates from unstructured user opinions.
Reference graph
Works this paper leans on
-
[1]
D. M. Alavi, M. W\"ahlisch, C. Irwin, and A. Konya. Using artificial intelligence for peacebuilding. Journal of Peacebuilding & Development, 17 0 (2): 0 239--243, 2022
work page 2022
-
[2]
Out of one, many: Using language models to simulate human samples
Lisa P Argyle, Ethan C Busby, Nancy Fulda, Joshua R Gubler, Christopher Rytting, and David Wingate. Out of one, many: Using language models to simulate human samples. Political Analysis, 31 0 (3): 0 337--351, 2023
2023
-
[3]
H. Aziz, M. Brill, V. Conitzer, E. Elkind, R. Freeman, and T. Walsh. Justified representation in approval-based committee voting. Social Choice and Welfare, 42 0 (2): 0 461--485, 2017 a
work page 2017
-
[4]
H. Aziz, E. Elkind, P. Faliszewski, M. Lackner, and P. Skowron. The C ondorcet principle for multiwinner elections: From shortlisting to proportionality. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI), pages 84--90, 2017 b
work page 2017
-
[5]
Participatory budgeting: Models and approaches
Haris Aziz and Nisarg Shah. Participatory budgeting: Models and approaches. Pathways Between Social Science and Computational Social Science: Theories, Methods, and Interpretations, pages 215--236, 2021
work page 2021
-
[6]
M. Bakker, M. Chadwick, H. Sheahan, M. Tessler, L. Campbell-Gillingham, J. Balaguer, N. McAleese, A. Glaese, J. Aslanides, M. Botvinick, and C. Summerfield. Fine-tuning language models to find agreement among humans with diverse preferences. In Proceedings of the 36th Annual Conference on Neural Information Processing Systems (NeurIPS), 2022
work page 2022
-
[7]
M. Brill and J. Peters. Robust and verifiable proportionality axioms for multiwinner voting. In Proceedings of the 14th ACM Conference on Economics and Computation (EC), page 301, 2023
work page 2023
- [8]
Show all 32 references
-
[9]
Bakker, Jay Baxter, and Martin Saveski
Soham De, Michiel A. Bakker, Jay Baxter, and Martin Saveski. Supernotes: Driving consensus in crowd-sourced fact-checking. In Proceedings of the ACM Web Conference 2025 ( WWW ) , pages 3751--3761, 2025
2025
-
[10]
Recursive public: Piloting connected democratic engagement with AI governance
Flynn Devine, Alex Krasodomski-Jones, Carl Miller, Shu Yang Lin, Jia-Wei Peter Cui, Bruno Marnette, and Rowan Wilkinson. Recursive public: Piloting connected democratic engagement with AI governance. Technical report, Chatham House, vTaiwan, and the AI Objectives Institute, 20...
2023
-
[11]
Self-agreement: A framework for fine-tuning language models to find agreement among diverse opinions
Shiyao Ding and Takayuki Ito. Self-agreement: A framework for fine-tuning language models to find agreement among diverse opinions. In Proceedings of the 20th Pacific Rim International Conference on Artificial Intelligence ( PRICAI ) , pages 298--309, 2023
2023
-
[12]
B. Fain, A. Goel, and K. Munagala. The core of the participatory budgeting problem. In Proceedings of the 12th Conference on Web and Internet Economics (WINE), pages 384--399, 2016
2016
-
[13]
B. Fain, K. Munagala, and N. Shah. Fair allocation of indivisible public goods. In Proceedings of the 19th ACM Conference on Economics and Computation (EC), pages 575--592, 2018
2018
-
[14]
Multiwinner voting: A new challenge for social choice theory
Piotr Faliszewski, Piotr Skowron, Arkadii Slinko, and Nimrod Talmon. Multiwinner voting: A new challenge for social choice theory. Trends in computational social choice, 74 0 (2017): 0 27--47, 2017
2017
-
[15]
Horton, and Benjamin S
Apostolos Filippas, John J. Horton, and Benjamin S. Manning. Large language models as simulated economic agents: What can we learn from homo silicus? In Proceedings of the 25th ACM Conference on Economics and Computation ( EC ) , pages 614--615, 2024
2024
-
[16]
olz, D. C. Parkes, A. D. Procaccia, G. Rusak, I. Shapira, and M. W\
S. Fish, P. G\"olz, D. C. Parkes, A. D. Procaccia, G. Rusak, I. Shapira, and M. W\"uthrich. Generative social choice. In Proceedings of the 25th ACM Conference on Economics and Computation (EC), 2024
2024
-
[17]
Flanigan, P
B. Flanigan, P. G\"olz, A. Gupta, and A. D. Procaccia. Neutralizing self-selection bias in sampling for sortition. In Proceedings of the 34th Annual Conference on Neural Information Processing Systems (NeurIPS), 2020
2020
-
[18]
Clustering by passing messages between data points
Brendan J Frey and Delbert Dueck. Clustering by passing messages between data points. Science, 315 0 (5814): 0 972--976, 2007
2007
-
[19]
Aspect-based sentiment analysis of drug reviews applying cross-domain and cross-data learning
Felix Gr \"a er, Surya Kallumadi, Hagen Malberg, and Sebastian Zaunseder. Aspect-based sentiment analysis of drug reviews applying cross-domain and cross-data learning. In Proceedings of the 2018 International Conference on Digital Health (DH), pages 121--125, 2018
2018
-
[20]
Large language models (llms) as agents for augmented democracy
Jairo F Gudi \ n o, Umberto Grandi, and C \'e sar Hidalgo. Large language models (llms) as agents for augmented democracy. Philosophical Transactions A, 382 0 (2285): 0 20240100, 2024
2024
-
[21]
Halpern, G
D. Halpern, G. Kehne, A. D. Procaccia, J. Tucker-Foltz, and Manuel W\"uthrich. Representation with incomplete votes. In Proceedings of the 37th AAAI Conference on Artificial Intelligence (AAAI), pages 5657--5664, 2023
2023
-
[22]
Kahng, M
A. Kahng, M. K. Lee, R. Noothigattu, A. D. Procaccia, and C.-A. Psomas. Statistical foundations of virtual democracy. In Proceedings of the 36th International Conference on Machine Learning (ICML), pages 3173--3182, 2019
2019
-
[23]
Democratic policy development using collective dialogues and AI
Andrew Konya, Lisa Schirch, Colin Irwin, and Aviv Ovadya. Democratic policy development using collective dialogues and AI . arXiv preprint arXiv:2311.02242, 2023
2023 arXiv
-
[24]
Multi-winner voting with approval preferences
Martin Lackner and Piotr Skowron. Multi-winner voting with approval preferences. Springer Nature, 2023
2023
-
[25]
Can AI bring deliberative democracy to the masses? Human-Centered Artificial Intelligence Seminar, Stanford University, 2022
Helene Landemore. Can AI bring deliberative democracy to the masses? Human-Centered Artificial Intelligence Seminar, Stanford University, 2022
2022
-
[26]
A. Ovadya. `Generative CI' through collective response systems. arXiv:2302.00672, 2023
2023 arXiv
-
[27]
Peters, G
D. Peters, G. Pierczynski, and P. Skowron. Proportional participatory budgeting with additive utilities. In Proceedings of the 35th Annual Conference on Neural Information Processing Systems (NeurIPS), pages 12726--12737, 2021
2021
-
[28]
Open polis data, 2023
Polis. Open polis data, 2023. URL https://github.com/compdemocracy/openData. Last accessed on 08/15/23
2023
-
[29]
The (computational) social choice take on indivisible participatory budgeting
Simon Rey and Jan Maly. The (computational) social choice take on indivisible participatory budgeting. arXiv preprint arXiv:2303.00621, 2023
2023 arXiv
-
[30]
Small, M
C. Small, M. Bjorkegren, T. Erkkil\"a, L. Shaw, and C. Megill. Polis: Scaling deliberation by mapping high dimensional opinion spaces. Revista De Pensament I An\`alisi, 26 0 (2), 2021
2021
-
[31]
C. T. Small, I. Vendrov, E. Durmus, H. Homaei, E. Barry, J. Cornebise, T. Suzman, D. Ganguli, and C. Megill. Opportunities and risks of LLMs for scalable deliberation with Polis . arXiv:2306.11932, 2023
2023 arXiv
-
[32]
AI can help humans find common ground in democratic deliberation
Michael Henry Tessler, Michiel A Bakker, Daniel Jarrett, Hannah Sheahan, Martin J Chadwick, Raphael Koster, Georgina Evans, Lucy Campbell-Gillingham, Tantum Collins, David C Parkes, et al. AI can help humans find common ground in democratic deliberation. Science, 386 0 (6719), 2024
2024
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.