{"id":"0c86a023-bc10-4fcf-9a87-ddea67ee0397","arxiv_id":"2611.10791","paper_version":1,"verdict":"ACCEPT","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":6,"one_line_summary":"A two-population evolutionary game shows that acceptance-oriented production and proxy evaluation can become self-reinforcing, reducing the scientific value of published work while maintaining publication success.","lead":"This paper models how AI-assisted research production and automated peer review can reinforce each other, creating a stable regime where accepted work has lower scientific value. The model identifies conditions for this self-perpetuating cycle and shows when temporary interventions can restore exploratory research.","discovery_kind":"new_method","skeptic_critique":{"model":"deepseek/deepseek-v4-flash","headline":"No significant objection identified.","rationale":"The reader's weakest_assumption identifies the linear payoff form as the most stylized element.  I agree that it is the least empirically grounded component, but the paper's robustness section directly addresses it: nonlinear workload functions (saturating, convex) preserve the bistability in the tested examples.  The central claim does not collapse if the payoff gaps are mildly nonlinear; it only requires monotonicity and threshold crossing.  The paper also notes that the exact thresholds (a_c, s_c) are derived for the linear case and do not generalize.  No additional unacknowledged assumption critically threatens the argument.  The reader's verdict (ACCEPT) is sound for a theoretical contribution that clearly states its scope and limitations.","tokens_in":32562,"tokens_out":5728,"duration_ms":57736,"concrete_test":"Replace independent acceptance probabilities with a competitive model where p_A(y,x) = p_A0(y) / (1 + d x) and p_T(y,x) = p_T0(y) / (1 + d (1-x)), with d small (e.g., 0.2).  Re-run the basin analysis from the same grid for the baseline parameters.  If (1,1) no longer attracts any interior trajectory, then the central result depends on the absence of competition among same-strategy authors; if (1,1) remains attracting, the claim gains robustness beyond the independence assumption.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper transparently sets out a two-population evolutionary game with explicit assumptions: linear payoff gaps, independent acceptance probabilities, no capacity constraints.  The central claim—that a community can settle into a privately rewarding but scientifically inferior equilibrium—follows logically from the model under the stated conditions.  The authors repeatedly acknowledge each limitation and test robustness via nonlinear workload, capacity constraints, strategy switching, and reversed feedbacks.  The linearity assumption, flagged by the reader, is the most stylized ingredient, but the robustness results show that the qualitative bistability persists under a range of departures, while the policy thresholds (a_c, s_c) are explicitly derived for the baseline only.  No unacknowledged hidden assumption or internal inconsistency undermines the theoretical demonstration.  The paper's value is as a formal mechanism, not as an empirical calibrated prediction, and it treats its scope accordingly.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek/deepseek-v4-flash","summary":"The paper develops a two-population evolutionary game model of research production and peer review under AI-assisted workflows. Authors choose between acceptance-oriented (A) and exploratory (T) research; reviewers choose between proxy (M) and careful (C) assessment. The model derives conditions under which the two populations can reinforce each other's incentive to rely on acceptance signals, producing a privately stable but scientifically inferior regime. It characterizes bistability, the analytical basin boundary, sufficient thresholds for audits and reviewer rewards, and the conditions for temporary support to produce lasting recovery. Numerical illustrations show how publication counts can mask a loss of scientific value and how relative adaptation speed affects basin sizes. Robustness tests examine nonlinear workload, capacity constraints, strategy switching, and alternative feedback signs. The paper clearly states its assumptions and repeatedly acknowledges its limitations, treating the model as a formal warning mechanism rather than an empirical prediction.","tokens_in":32916,"tokens_out":3265,"duration_ms":34881,"significance":"If the central claim holds, the paper formalizes a previously informal concern: that AI-assisted production and evaluation can co-evolve into a stable equilibrium that rewards publication success while systematically reducing the scientific value of accepted work. The model's key contributions are the explicit derivation of bistability conditions, the analytical characterization of the basin boundary via a conserved quantity, and the separation of private payoffs from an independently defined scientific-value objective. The policy thresholds for audits and reviewer rewards are simple and interpretable. While the model is stylized (linear payoff gaps, replicator dynamics, no empirical calibration), the extensive robustness checks (nonlinear workloads, capacity constraints, switching, reversed feedback) show that the core feedback mechanism is not an artifact of the linear specification. The paper thus provides a rigorous theoretical foundation for institutional reforms aimed at rewarding validated discovery and consequential checking rather than accelerating paper production and scoring alone.","major_comments":[],"minor_comments":[{"comment":"The definition of Δ^C = p^C_A - p^C_T appears without explicit note that if careful reviewers favour exploratory work, Δ^C is negative. The example later clarifies this, but a brief comment after Eq. (3) would help readers unfamiliar with the sign convention.","section":"§3.1, Eq. (3)","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The caption states that all 5,043 numerical classifications agree with the analytical boundary. It would be helpful to note explicitly that the grid excludes the absorbing edges (x=0,1 and y=0,1), otherwise the claim might be misinterpreted as agreement on the full square.","section":"§4.1, Fig. 3 caption","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The three architectural proposals are presented as plausible extensions, but the paper does not simulate or formally analyze them. A sentence at the start of §5 reiterating that these are proposals motivated by the model, not results derived from it, would strengthen the separation between analysis and speculation.","section":"§5","authors_acknowledge":null,"authors_acknowledge_p":null}],"recommendation":"accept"},"author_rebuttal":null,"desk_editor":{"model":"deepseek/deepseek-v4-flash","letter":"Here's the short version: this paper does what it sets out to do—it formalizes the concern that AI-assisted research and proxy review can become a self-reinforcing cycle that's privately rewarding but collectively damaging. The two-population evolutionary game is the right tool for the question, and the analysis is clean and honest. It is not an empirical paper, and it doesn't pretend to be. You should treat it as a careful mechanism-level model.\n\nWhat's new: the coupling of author research choice (exploratory vs. acceptance-oriented) with reviewer effort (careful vs. proxy) in a replicator dynamic, with closed-form conditions for bistability and an analytical basin boundary. The paper also introduces a separate scientific-value criterion to show how publication counts can mask value loss. The authors repeatedly state their assumptions and test many of them (nonlinear workload, capacity constraints, switching rates, reversed feedback). The derivations are correct given the assumptions, and the code and data for numerical illustrations are provided.\n\nWhere to be cautious: the core model uses linear payoff gaps, which is the most stylized part. The robustness tests help, but the linearity is still a strong form. The policy thresholds (a_c, s_c) are sufficient conditions for full convergence; the paper acknowledges that smaller interventions may still work but are not characterized. The numerical results use illustrative parameters; there is no calibration to any real venue. The temporary policy results use model time units that have no direct calendar interpretation. These are not fatal—the paper is transparent about them—but they set expectations. A reader who wants empirical predictions will be disappointed; a reader who wants a conceptual tool for thinking about intervention design will find it useful.\n\nWho this is for: anyone working on peer review reform, AI in science, or incentives in academic publishing. It would be a good fit for a journal like JASSS, Research Policy, or a top conference on game theory (EC, WINE). It is not a desk-reject candidate.\n\nMy recommendation: accept for peer review. The paper is ready for expert scrutiny. I'd assign a reviewer with a game theory background and one with science policy or evaluation expertise. The major issues are methodological (linearity, time scales) and empirical (lack of calibration). These are predictable and manageable in revision.","headline":"Clean formal model of the co-evolution of author and reviewer strategies; honest about its limits, worth engaging as a mechanism-level contribution.","tokens_in":33308,"tokens_out":1465,"duration_ms":13983},"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek/deepseek-v4-flash","headline":"A game-theory model shows how AI-assisted research and peer review can lock a community into a stable but scientifically harmful equilibrium, where publication success hides declining discovery.","keywords":["evolutionary game theory","peer review","AI research","acceptance-oriented research","exploratory research","proxy evaluation","bistability","scientific value"],"falsifier":"If, in a controlled field experiment at a major conference, increasing reviewer workload (e.g., doubling the number of papers each reviewer handles) does not increase the prevalence of superficial reviews (as measured by audit of checking depth), then the model's core feedback assumption (κ > 0) would be falsified.","tokens_in":34086,"feed_emoji":"🎯","tokens_out":1974,"duration_ms":20496,"temperature":0.7,"pith_summary":"This paper argues that authors and reviewers, each rationally pursuing private rewards, can collectively sustain practices that damage scientific discovery. The authors model this as a two-population evolutionary game: authors choose between acceptance-oriented and exploratory research, and reviewers choose between proxy and careful evaluation. When cheaper acceptance-oriented production encourages proxy review, and proxy review in turn rewards acceptance-oriented work, the feedback loop can lock the community into a stable regime that maintains publication activity but produces lower scientific value. The paper identifies conditions for this bistability, derives an analytical boundary between the two possible outcomes, and shows that temporary interventions (audits or reviewer rewards) can shift the community from the harmful regime to a beneficial one if they push it across that boundary.","feed_headline":"Why AI review cycles can lock science into a low-discovery trap","feed_subtitle":"A game-theory model shows how rational authors and reviewers can sustain practices that weaken discovery while keeping publication high.","key_machinery":"The central object is a two-population replicator dynamic system where author strategy share x evolves according to ẋ = x(1-x)(α+βy) and reviewer strategy share y evolves according to ẏ = ρ y(1-y)(γ+κx). The parameters α, β, γ, κ encode the payoff differences: α is the author's baseline incentive for acceptance-oriented work under careful review, β captures how proxy review widens that gap, γ is the reviewer's baseline incentive for proxy assessment, and κ captures how the share of acceptance-oriented authors increases the reviewer's incentive for proxy assessment. The model's key analytical result is a first integral H(x,y)=F(x)-G(y)/ρ that yields the stable manifold explicitly as G(y)-G(y*)=ρ[F(x)-F(x*)], providing a closed-form basin boundary.","core_discovery":"The paper establishes that acceptance-oriented research production and proxy evaluation can sustain each other through a positive feedback loop, creating a stable equilibrium that privately rewards participants while reducing the scientific value of accepted work. This feedback occurs even when all agents respond rationally to their own payoffs. The core result is a coordination theorem: under the conditions β>0, κ>0, α<0<α+β, and γ<0<γ+κ, the system has two locally stable corners—(0,0) where all authors pursue exploration and all reviewers use careful assessment, and (1,1) where all authors pursue acceptance-oriented work and all reviewers use proxy assessment—separated by a saddle whose stable manifold acts as a basin boundary. The scientific value at the proxy corner is lower if and only if p_M^A v_A < p_C^T v_T, meaning publication counts alone cannot signal the loss.","pith_inferences":["The model suggests a warning mechanism for conference organizers: monitoring the share of proxy reviews and acceptance-oriented submissions over time could reveal whether a conference is drifting toward the harmful regime, even if acceptance rates and reviewer satisfaction remain normal.","A practical testable extension would be to experimentally vary reviewer workload (e.g., number of assigned papers) in a conference and measure subsequent changes in review thoroughness and author strategy (e.g., shift toward more standard, less exploratory contributions).","The analysis implies that efforts to increase reviewer supply (e.g., recruiting more reviewers) could reduce the workload parameter ℓ and weaken the feedback, potentially restoring careful review without explicit rewards or audits.","The model's distinction between private payoffs and scientific value suggests that any reform that ties career rewards directly to independently validated contributions (e.g., through replication markets or prospective registration) could break the feedback loop by changing the payoff parameters α, β, γ, κ."],"forward_implications":["If the model captures actual dynamics, a research community can be trapped in a low-value equilibrium even when no individual acts maliciously; improving individual reviews or increasing production speed alone may not help.","The analytical basin boundary implies that the same institutional rules can support either a high-value or low-value outcome, depending on initial conditions and the relative speed of reviewer adaptation.","Permanent audits (assigning careful evaluation to a fraction a > a_c) or sufficient reviewer rewards (s > s_c) can destabilize the harmful equilibrium and guarantee convergence to the careful regime.","Temporary interventions can have lasting effects if they move the community across the basin boundary before withdrawal, meaning support must be sustained until a state-dependent threshold is reached rather than for a fixed time.","Scientific value must be measured independently of acceptance rewards; publication counts can remain high while the accepted work becomes less reliable or consequential."],"supporting_citations":[{"why":"Documents execution failures and incorrect numerical results in AI Scientist manuscripts, motivating the assumption that autonomous research can produce plausible but unsound work.","marker":"Beel et al. (2025)"},{"why":"Shows that fabricated papers achieve high acceptance rates from LLM reviewers, supporting the vulnerability of proxy evaluation to reward-compatible but unsound submissions.","marker":"Jiang et al. (2026)"},{"why":"Estimates that 6.5–16.9% of review text in conference corpora may be substantially LLM-modified, providing evidence that proxy evaluation is already present.","marker":"Liang et al. (2024)"},{"why":"Models how publication-based selection can propagate weaker research practices, providing the incentive-theoretic foundation for the author side of the feedback.","marker":"Smaldino & McElreath (2016)"},{"why":"Supplies the standard evolutionary-game methods (replicator dynamics, first integrals) used throughout the paper.","marker":"Hofbauer & Sigmund (1998)"},{"why":"Examines verification incentives and proxy noise in evaluation, a closely related model whose results are extended by modeling coupled adaptation of authors and reviewers.","marker":"You et al. (2026)"}],"fun_headline_variants":["Game theory reveals a stable trap that rewards publication over discovery","When rational authors and reviewers drive science into a low-value equilibrium","AI review cycles can lock science into a self-reinforcing discovery trap","Proxy assessment and acceptance-oriented research create a hidden feedback loop"],"cache_read_input_tokens":0,"weakest_assumption_plain":"The payoff gaps for authors and reviewers are assumed to be linear functions of the opposing population's strategy share (i.e., α+βy and γ+κx), which ignores nonlinear institutional effects such as competition for scarce acceptance slots, multiple-reviewer decision rules, or strategic interactions beyond imitation.","fun_headline_variants_meta":{"raw":{"variants":["Game theory reveals a stable trap that rewards publication over discovery","When rational authors and reviewers drive science into a low-value equilibrium","AI review cycles can lock science into a self-reinforcing discovery trap","Proxy assessment and acceptance-oriented research create a hidden feedback loop"]},"model":"deepseek/deepseek-v4-flash","effort":"low","cost_usd":5.8e-05,"raw_usage":{"cost":5.7826944e-05,"is_byok":false,"cost_details":{"upstream_inference_cost":5.7826944e-05,"upstream_inference_prompt_cost":3.0651264e-05,"upstream_inference_completions_cost":2.717568e-05},"total_tokens":1302,"prompt_tokens":965,"completion_tokens":337,"prompt_tokens_details":{"audio_tokens":0,"video_tokens":0,"cached_tokens":256,"cache_write_tokens":0},"completion_tokens_details":{"audio_tokens":0,"image_tokens":0,"reasoning_tokens":265}},"tokens_in":965,"tokens_out":337,"cost_source":"openrouter_usage","duration_ms":3818,"image_pages":[],"temperature":1.0,"billed_attempts":1,"reasoning_tokens":265,"transport_provider":"openrouter","cache_read_input_tokens":0,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-11-10T21:00:32.944190+00:00","model_set":{"reader":"deepseek/deepseek-v4-flash"},"pipeline_version":"pith-pipeline@v1.4.1-daily-deepseek-or-medium","input_kind":null,"input_chars":null,"input_total_chars":null,"passes_missing":null,"published_standing":null,"published_confidence":null,"objection_audit":null,"run_record":null,"basis":{"kind":"not_recorded","source":null,"chars_given":null,"chars_total":null},"receipt":null,"falsifier":"If, in a controlled field experiment at a major conference, increasing reviewer workload (e.g., doubling the number of papers each reviewer handles) does not increase the prevalence of superficial reviews (as measured by audit of checking depth), then the model's core feedback assumption (κ > 0) would be falsified.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the standard evolutionary-game methods (replicator dynamics, first integrals) used throughout the paper."}],"lane_accuracy":{"status":"not yet measured","lane":{"model":"deepseek/deepseek-v4-flash","input_kind":null},"url":"https://pith.science/accuracy"},"review_version":1}