REVIEW 2 major objections 5 minor 27 references
This paper proves that sharing information can raise the accuracy of a group's best single guess while lowering the group's chance of finding what it seeks, and that the loss is a failure of the action rule, not of the information.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 16:15 UTC pith:TXC6NDYI
load-bearing objection A genuinely exact benchmark for consensus-driven discovery loss; the central paradox holds, and the only real caveat is that the market result is an anonymity benchmark, not a prediction for all self-interested equilibrium play. the 2 major comments →
The Shared Discovery Paradox: How a One-Answer Rule Turns Better Information into Worse Search
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central discovery is that the value of shared information and the quality of the action protocol are separable, and that a protocol which answers an estimation problem (pick the single most likely target) can destroy the solution to an allocation problem (spread attempts over the posterior). Formally, the paper defines the Shared Discovery Paradox as any protocol with higher average action quality Q but lower union success G than a diversified protocol. In the canonical instance, Q rises from 0.20 to 0.3835 while G falls from 0.8322 to 0.3835; the same pooled posterior, assigned as an eight-action portfolio, achieves 0.8594. The paper then shows that the identity LQ - G = E[(K-1)+] quant
What carries the argument
The load-bearing object is the attainable frontier V_L(F), the posterior mass of the best L-state portfolio given information F, and the protocol-loss identity L_L(Π;F) = V_L(F) - G_L(Π), which separates information value from action-rule efficiency. Alongside it, the redundancy identity LQ(Π) - G(Π) = E[(K-1)+] links average action quality to duplicated successful actions. For the market layer, the anonymous symmetric equilibrium of the equal-split game is characterized by the water-filling rule s_b = φ^{-1}(λ/π_b) for boxes with posterior mass above λ, and welfare is G = Nλ; this is what turns the congestion game into an exact potential game and yields the price-of-anarchy bound.
Load-bearing premise
The benchmark's market claim depends on selecting the anonymous symmetric equilibrium: if searchers can coordinate through role labels, conventions, or sequencing, the equal-split game also has efficient asymmetric pure equilibria, so the 0.5991 figure is an upper bound on the cost of anonymity rather than a robust prediction about self-interested search.
What would settle it
Run the equal-split game in the canonical 16-box environment with a minimal coordination device — for instance, a public pre-play ordering of searchers or a shared deterministic tie-breaking rule that can serve as a convention — and measure discovery. If it jumps from near 0.599 toward 0.859, the price-of-anarchy bound is not the binding constraint; alternatively, in an organization that pools information into one ranking and then lets agents act freely, track the number of distinct actions and the discovery rate: the paper predicts average-quality-up/discovery-down whenever duplication rises.
If this is right
- In the canonical sixteen-box benchmark, seven coordinated actions recover the 0.8322 discovery of eight independent clue-followers; the recovery budget quantifies how much duplication costs.
- The exact mixed price of anarchy of the equal-split game is 2 - 1/N, and because the game is (1, 1-1/N)-smooth the bound extends to coarse correlated equilibria and any no-regret learning dynamics.
- A sole-rescue reward, paying only an agent who covers the target alone, makes the game an exact potential game whose potential is social discovery; with at least as many boxes as searchers, every pure Nash equilibrium is a collision-free top-N portfolio.
- Under a latent common-cue copying model, the centralized planner gain over private search is strictly increasing in copying probability c, and in the canonical environment the symmetric market overtakes decentralized report-following at c = 0.7884616565.
- In the proportional large-market limit the five-protocol ordering is exact: consensus discovery vanishes while blind, market, private, and portfolio search converge to 0.500, 0.547, 0.847, and 0.874.
Where Pith is reading between the lines
- Because the 0.5991 market value relies on the anonymous symmetric equilibrium, a cheap-talk phase, role labels, or any sequencing could push actual groups toward the efficient asymmetric equilibria; the price of anonymity, not of self-interest, is the real bound.
- The protocol-loss accounting should transfer directly to multi-agent AI systems: if agents share a pretrained model or retrieval context, adding agents can raise average prediction quality while collapsing effective channels; marginal-coverage rewards are a natural testable remedy.
- Matching an observed duplication level (e.g., expected distinct proposals) to the benchmark's exact curve could pin down a latent copying rate and thereby a recovery budget, giving an empirical calibration device without structural econometrics.
- The sparse-evidence limit suggests a sharp falsifiable prediction: consensus-style one-answer protocols are most dangerous in domains where evidence is sparse and the target's signal never separates from noise — early-stage science, venture sourcing, novel-hypothesis generation — and less harmful where evidence is abundant.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies a sixteen-box, eight-searcher discovery benchmark with a single target, a uniform prior, and conditionally independent private clues that are correct with probability p=0.20. It claims and demonstrates a 'Shared Discovery Paradox' (Definition 1): pooling the clues raises the accuracy of the best single recommendation from 0.20 to 0.3835, yet the one-answer consensus protocol that repeats that recommendation yields group discovery 0.3835, below private clue-following (0.8322), below a blind coordinated eight-box portfolio (0.50), and far below a coordinator who uses the same pooled reports but assigns one searcher to each of the eight highest-posterior boxes (0.8594). The paper formalizes this as protocol loss L_8 = V_8 - G_consensus = 0.475952, computes the exact action-budget frontier with integer recovery budget L* = 7, and derives the identity NQ - G = E[(K-1)_+]. It then replaces the planner with an equal-split game on the pooled posterior: an exact-potential game with a unique anonymous symmetric water-filling equilibrium (canonical discovery 0.5991), a worst-case mixed price of anarchy 2 - 1/N with a smoothness proof and tight example, and a sole-rescue reward that makes every pure Nash equilibrium first-best. A latent common-cue copying model (copying probability c) yields a closed-form private-discovery function, a strict monotone-planner-gain theorem (Theorem 2), and a computational crossover c* = 0.7884616565 at which the symmetric market overtakes
Significance. If the claims hold, the paper delivers a compact and fully explicit benchmark separating information value (one-action value, action-budget frontier), action allocation (protocol loss, recovery budget), decentralized incentives (water-filling equilibrium, price of anarchy), and signal dependence (channel collapse, planner-gain monotonicity). The central paradox is established by exact enumeration over count vectors and is reproduced by the public verification script; the price-of-anarchy bound is parameter-free, properly attributed to the covering-game literature, and proved by a short smoothness argument that also covers coarse correlated equilibria; Theorem 2 is an analytic monotonicity result; the proportional limit is exact. The claim-status taxonomy in Appendix E, distinguishing proved results, exact enumerations, and computational patterns, is exemplary and materially strengthens the paper. The authors also do the right thing in disclosing caveats: the market row (0.5991) is an anonymous-symmetric-equilibrium benchmark, the copying crossover is a canonical computational result, and the decentralized-team optimum is left open. The main residual risk is that Section 4's 'below
major comments (2)
- [Definition 1] Definition 1 defines the paradox as Q(Π_S) > Q(Π_P) and G(Π_S) < G(Π_P) without requiring the two protocols to have the same action budget L. Because Q is an average over L actions, an unequal-budget comparison can manufacture or destroy the paradox trivially: in the canonical environment, taking L_P = 1 gives G(Π_P) = Q(Π_P) = 0.20, so the stated inequalities fail even though the substantive finding is unchanged. The canonical application compares protocols with L = N = 8, and Section 2.2 already handles cross-budget questions through the frontier, so the fix is local: add a requirement that the protocol comparison is at a common action budget (or define the paradox for the best-L expansion of each protocol). As written, the formal definition is looser than the claim it supports.
- [Table 1 / Section 9 / Abstract] The market-layer headline — 'the equal-split game ... achieves 0.5991: strictly above consensus, but below both private search and the planner' (Abstract) — is a property of the anonymous symmetric equilibrium, not of the full equilibrium set. As the paper itself states in the Table 1 footnote and in Section 9, the equal-split game also has efficient asymmetric pure equilibria that reach the first-best portfolio whenever role labels, conventions, or sequencing are available. The 0.5991 value is therefore an anonymity benchmark — a measure of how much dispersion prices alone supply without coordination devices — rather than a robust prediction about self-interested search under every equilibrium. This does not affect the paradox or the protocol-loss diagnosis, and I agree with the authors' disclosure, but the qualifier should be surfaced in the Abstract and in the interpretive paragraphs
minor comments (5)
- [Theorem 1, Section 4.3] The proof line 'assigning one optimal box o_i to each searcher i (ignore zero-mass padding if M<N)' leaves the M<N case to the reader. Since the theorem is asserted for every posterior, please spell out the padding construction (add zero-mass states so the number of states reaches N) so that the stated claim is covered by the given argument.
- [Appendix C, Theorem 2] The sentence 'The inequality is strict for at least one k' should be made precise. The coupling shows h(k+1) ≥ h(k), with equality at k=0 because h(0)=h(1) (one copy of X0 has the same joint law as one independent clue). The strict event should be exhibited for some k ≥ 1, e.g., k = N-1, where the converted independent clue is the unique report naming the target and the common cue misses; the derivative identity then yields strict positivity on (0,1) since P(K'=N-1) > 0 for c > 0. Currently the text does not distinguish the k=0 case.
- [Appendix D, Proposition 4] The convergence step for the market equilibrium is compressed into one sentence. The finite (random) budget functions B_M(Λ) are decreasing in Λ; pointwise convergence in probability at each fixed Λ, combined with monotonicity and the strict monotonicity of the limit B, gives locally uniform convergence and justifies the root-squeeze Λ_M → Λ. A brief elaboration of this argument — and of the asserted covariance bound for E[r^{C_a} r^{C_b}] for two false boxes — would make the proof of a headline result self-contained.
- [Section 6.2] The likelihood values P(C|θ=a)=1.1427×10^{-4} and P(C|θ=b)=1.3977×10^{-4} should be identified as script-computed values, and the sentence that the Bayes-versus-count discount 'vanishes for L≥3 on the tested grid' should carry the 'computational pattern' label in the main text, as Appendix E already does.
- [Section 4.2, Proposition 6] The uniqueness claim for the anonymous symmetric equilibrium does not address the boundary tie π(1)/N = π(2). A parenthetical noting that the boundary is covered by the pure-corner case, or by taking the corresponding limit in the water-filling formula, would make the statement airtight. Also, unify the internal cross-reference style ('section D' / 'Appendix D'; 'section C' / 'Appendix C').
Circularity Check
No significant circularity: the central derivation is self-contained, and the only self-referential element is a reproducible verification repository, not a load-bearing citation loop.
full rationale
The derivation chain is self-contained. Definition 1 names a pattern; its canonical instance is established by exact enumeration (Appendix A, Eq. 28) rather than by assuming the ordering. Proposition 3 is a set-inclusion argument: the plurality winner carries at least one report, so consensus success implies at least one private clue success; the strict values 0.3835 vs 0.8322 are computed, not imposed. The market value 0.5991 solves the water-filling equations (Section 4.2, Eq. 14) from the pooled posterior; it is not fitted to the quantity it claims to explain. The 2−1/N price-of-anarchy bound is explicitly attributed to Gairing (2009) and also proved directly in Theorem 1; it is external support, not a self-citation. The sole-rescue implementation follows from the potential being covered mass (Proposition 8), and the copying results are either proved (Theorem 2) or explicitly labeled as computational patterns on a grid (Section 6.4). The only self-referential element is the author's verification repository, which is independent reproducible code and therefore counts as real evidence under the review rules. The Table 1 market row is flagged by the paper itself as an equilibrium-selection benchmark, not a claim about all Nash equilibria, so the existence of efficient asymmetric equilibria does not make the 0.5991 row a disguised fit or prediction. No step reduces a claimed output to an input by construction.
Axiom & Free-Parameter Ledger
free parameters (4)
- canonical benchmark constants M=16, N=8, p=0.20 =
M=16, N=8, p=0.20
- uniform randomization at cutoff ties =
uniform tie-breaking
- copying probability c =
c in [0,1]; crossover c*=0.788462
- proportional scaling alpha and r =
alpha=1/2, r=3.75
axioms (8)
- domain assumption Uniform prior and conditionally independent clues with P(X_i=theta|theta)=p, P(X_i=b|theta)=q for b≠theta.
- domain assumption Each searcher opens exactly one box; group succeeds if any opened box is the target.
- domain assumption Equal split of the unit prize among successful searchers.
- ad hoc to paper Anonymous symmetric equilibrium as the market selection.
- domain assumption M>=N and strictly positive posterior mass for sole-rescue implementation.
- domain assumption One latent common cue X0 with copying probability c.
- domain assumption Sparse-evidence scaling N_M/M->alpha with fixed likelihood ratio r>1.
- standard math Standard potential game and smoothness results (Rosenthal, Roughgarden).
invented entities (1)
-
Latent common cue X0
independent evidence
read the original abstract
Organizations often pool dispersed information into one ranking and then allow many agents to act on that shared view. In a discovery problem, this can improve beliefs while reducing coverage. We develop an exactly solvable benchmark with sixteen boxes, one target, eight searchers, and noisy private clues. Pooling raises the accuracy of the best single recommendation from 0.20 to 0.3835, but repeating that recommendation lowers group discovery from 0.8322 under decentralized clue-following to 0.3835. A coordinated eight-action portfolio using the same pooled reports reaches 0.8594, and seven coordinated actions recover the decentralized benchmark. The paradox is a protocol failure, not an information failure: a one-answer rule compresses a portfolio of available actions into one repeated choice. We then replace the planner with self-interested searchers who split a prize. The equal-split game is a potential game. Its anonymous symmetric equilibrium obeys a water-filling rule. In the canonical instance it achieves 0.5991: strictly above consensus, but below both private search and the planner. The exact mixed price of anarchy is 2 - 1/N. A sole-rescue reward, which pays only an agent who covers the target alone, makes every pure Nash equilibrium first-best. Finally, a latent common-cue model shows how correlated reports collapse effective discovery channels. The centralized planner gain rises strictly with copying, and in the canonical environment the symmetric market overtakes decentralized report-following at copying probability c = 0.788462. In a proportional large-market limit the five-protocol ordering survives exactly: consensus discovery vanishes while blind, market, private, and portfolio search converge to 0.500, 0.547, 0.847, and 0.874. The contribution is a compact benchmark that separates information, allocation, incentives, and dependence into exact, reusable quantities.
Figures
Reference graph
Works this paper leans on
-
[1]
Informational B raess' paradox: The effect of information on traffic congestion
Daron Acemoglu, Ali Makhdoumi, Azarakhsh Malekian, and Asuman Ozdaglar. Informational B raess' paradox: The effect of information on traffic congestion. Operations Research, 66 0 (4): 0 893--917, 2018. doi:10.1287/opre.2017.1712
arXiv 2018
-
[2]
George A. Akerlof. The market for ``lemons'': Quality uncertainty and the market mechanism. Quarterly Journal of Economics, 84 0 (3): 0 488--500, 1970. doi:10.2307/1879431
doi:10.2307/1879431 1970
-
[3]
Brian Arthur
W. Brian Arthur. Inductive reasoning and bounded rationality. American Economic Review, 84 0 (2): 0 406--411, 1994
1994
-
[4]
Abhijit V. Banerjee. A simple model of herd behavior. Quarterly Journal of Economics, 107 0 (3): 0 797--817, 1992. doi:10.2307/2118364
doi:10.2307/2118364 1992
-
[5]
A theory of fads, fashion, custom, and cultural change as informational cascades
Sushil Bikhchandani, David Hirshleifer, and Ivo Welch. A theory of fads, fashion, custom, and cultural change as informational cascades. Journal of Political Economy, 100 0 (5): 0 992--1026, 1992. doi:10.1086/261849
doi:10.1086/261849 1992
-
[6]
Equivalent comparisons of experiments
David Blackwell. Equivalent comparisons of experiments. Annals of Mathematical Statistics, 24 0 (2): 0 265--272, 1953. doi:10.1214/aoms/1177729032
arXiv 1953
-
[7]
Reducing congestion through information design
Sanmay Das, Emir Kamenica, and Renee Mirka. Reducing congestion through information design. In Proceedings of the 55th Annual Allerton Conference on Communication, Control, and Computing, pages 1279--1284, 2017. doi:10.1109/ALLERTON.2017.8262884
arXiv 2017
-
[8]
The paradox of collective certainty in science
Eamon Duede and James Evans. The paradox of collective certainty in science. arXiv:2406.05809 [physics.soc-ph], 2024
Pith/arXiv arXiv 2024
-
[9]
Covering games: Approximation through non-cooperation
Martin Gairing. Covering games: Approximation through non-cooperation. In Stefano Leonardi, editor, Internet and Network Economics: 5th International Workshop, WINE 2009, volume 5929 of Lecture Notes in Computer Science, pages 184--195. Springer, 2009. doi:10.1007/978-3-642-10841-9_18
-
[10]
Adaptive submodularity: Theory and applications in active learning and stochastic optimization
Daniel Golovin and Andreas Krause. Adaptive submodularity: Theory and applications in active learning and stochastic optimization. Journal of Artificial Intelligence Research, 42: 0 427--486, 2011. doi:10.1613/jair.3278
-
[11]
The division of cognitive labor
Philip Kitcher. The division of cognitive labor. Journal of Philosophy, 87 0 (1): 0 5--22, 1990. doi:10.2307/2026796
doi:10.2307/2026796 1990
-
[12]
Bernard O. Koopman. The theory of search. III . the optimum distribution of searching effort. Operations Research, 5 0 (5): 0 613--626, 1957. doi:10.1287/opre.5.5.613
-
[13]
Elias Koutsoupias and Christos Papadimitriou. Worst-case equilibria. In Proceedings of the 16th Annual Symposium on Theoretical Aspects of Computer Science, volume 1563 of Lecture Notes in Computer Science, pages 404--413. Springer, 1999. doi:10.1007/3-540-49116-3_38
-
[14]
Krishna K. Ladha. The condorcet jury theorem, free speech, and correlated votes. American Journal of Political Science, 36 0 (3): 0 617--634, 1992. doi:10.2307/2111584
doi:10.2307/2111584 1992
-
[15]
James G. March. Exploration and exploitation in organizational learning. Organization Science, 2 0 (1): 0 71--87, 1991. doi:10.1287/orsc.2.1.71
-
[16]
Economic Theory of Teams
Jacob Marschak and Roy Radner. Economic Theory of Teams. Yale University Press, New Haven, 1972
1972
-
[17]
Conor Mayo-Wilson, Kevin J. S. Zollman, and David Danks. The independence thesis: When individual and social epistemology diverge. Philosophy of Science, 78 0 (4): 0 653--677, 2011. doi:10.1086/661777
-
[18]
Dov Monderer and Lloyd S. Shapley. Potential games. Games and Economic Behavior, 14 0 (1): 0 124--143, 1996. doi:10.1006/game.1996.0044
arXiv 1996
-
[19]
Richard R. Nelson. Uncertainty, learning, and the economics of parallel research and development efforts. Review of Economics and Statistics, 43 0 (4): 0 351--364, 1961. doi:10.2307/1927475
-
[20]
George L. Nemhauser, Laurence A. Wolsey, and Marshall L. Fisher. An analysis of approximations for maximizing submodular set functions--- I . Mathematical Programming, 14 0 (1): 0 265--294, 1978. doi:10.1007/BF01588971
-
[21]
Robert W. Rosenthal. A class of games possessing pure-strategy N ash equilibria. International Journal of Game Theory, 2: 0 65--67, 1973. doi:10.1007/BF01737559
-
[22]
Intrinsic robustness of the price of anarchy
Tim Roughgarden. Intrinsic robustness of the price of anarchy. Journal of the ACM, 62 0 (5): 0 32:1--32:42, 2015. doi:10.1145/2806883
doi:10.1145/2806883 2015
-
[23]
Andrey Rzhetsky, Jacob G. Foster, Ian T. Foster, and James A. Evans. Choosing experiments to accelerate collective discovery. Proceedings of the National Academy of Sciences, 112 0 (47): 0 14569--14574, 2015. doi:10.1073/pnas.1509757112
- [24]
-
[25]
Pathological outcomes of observational learning
Lones Smith and Peter S rensen. Pathological outcomes of observational learning. Econometrica, 68 0 (2): 0 371--398, 2000. doi:10.1111/1468-0262.00113
arXiv 2000
-
[26]
Adrian Vetta. Nash equilibria in competitive societies, with applications to facility location, traffic routing and auctions. In Proceedings of the 43rd Annual IEEE Symposium on Foundations of Computer Science, pages 416--425. IEEE, 2002. doi:10.1109/SFCS.2002.1181966
Pith/arXiv arXiv 2002
-
[27]
Kevin J. S. Zollman. The communication structure of epistemic communities. Philosophy of Science, 74 0 (5): 0 574--587, 2007. doi:10.1086/525605
doi:10.1086/525605 2007
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.