Selection of the fittest or selection of the luckiest: the emergence of Goodhart's law in evolution
Pith reviewed 2026-05-22 23:08 UTC · model grok-4.3
The pith
In an evolutionary model, adaptation speed rises with selection pressure only up to a threshold, after which randomness dominates and slows adaptation.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The speed of adaptation increases with increasing selection pressure only up to a threshold. Beyond the threshold, any increase of the selection pressure results in more weight given to random effects rather than on genetic fitness in determining which individuals will successfully reproduce. This severely reduces the speed of adaptation and the diversity in the gene pool. The intricate response can be explained by a novel phase transition for pulled traveling waves.
What carries the argument
Pulled traveling wave dynamics that govern the long-term patterns of evolution under selection on phenotypes affected by random contingencies.
Load-bearing premise
The model assumes an idealized evolution where selection acts on phenotypes affected by random contingencies and long-term patterns follow pulled traveling wave dynamics.
What would settle it
Simulations or observations showing that adaptation speed continues to increase or does not decrease after a certain selection pressure threshold would falsify the claim.
Figures
read the original abstract
Biological evolution depends on the passing down to subsequent generations of genetic information encoding beneficial traits, and on the removal of unfit individuals by a selection mechanism. However, selection acts on phenotypes, and is affected by random contingencies. Thus, a combination of fitness and luck determines which individuals will successfully reproduce and give rise to the next generation. To understand how randomness in the selection mechanism affects the long-term patterns of evolution, we studied an idealized evolution model. We show through simulations and mathematical analysis, that the speed of adaptation increases with increasing selection pressure only up to a threshold. Beyond the threshold, any increase of the selection pressure results in more weight given to random effects rather than on genetic fitness in determining which individuals will successfully reproduce. This severely reduces the speed of adaptation and the diversity in the gene pool. Our findings may be considered as a biological instance of Goodhart's law: "When a measure becomes a target, it ceases to be a good measure". Finally, we show that this intricate response of evolution to natural selection can be mathematically explained by a novel phase transition for pulled traveling waves.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies an idealized evolutionary model in which selection acts on phenotypes subject to random contingencies. Using simulations and mathematical analysis based on pulled traveling-wave dynamics, it claims that adaptation speed increases with selection pressure only up to a threshold; beyond this point, stronger selection amplifies the relative weight of stochastic effects over genetic fitness, thereby decreasing adaptation speed and reducing genetic diversity. The non-monotonic response is presented as a biological instance of Goodhart's law and is attributed to a novel phase transition in the pulled traveling-wave regime.
Significance. If the central threshold and phase-transition claims hold, the work supplies a mechanistic, traveling-wave account of why excessively strong selection can become counterproductive, with potential implications for both theoretical evolutionary dynamics and empirical studies of selection intensity. The combination of simulation evidence with an analytic traveling-wave explanation, together with the apparent absence of free parameters in the model, constitutes a clear strength that distinguishes the contribution from purely phenomenological descriptions.
major comments (1)
- [Mathematical analysis of traveling waves] The non-monotonic speed and diversity loss are derived under the maintained assumption that the population remains in the pulled traveling-wave regime even for selection pressures above the reported threshold. The abstract states that the effect is 'mathematically explained by a novel phase transition for pulled traveling waves,' yet no explicit verification (e.g., comparison of observed wave speed against the pulled-wave formula or inspection of leading-edge dynamics) is described that confirms the wave type does not switch to pushed or become unstable once the threshold is crossed. This verification is load-bearing for the claimed mechanism.
minor comments (2)
- [Introduction] The abstract and introduction would benefit from a brief, explicit statement of the precise definition of 'selection pressure' used in the model (e.g., the functional form relating fitness to reproductive success).
- [Figure captions] Figure captions should state the number of independent simulation replicates and the precise parameter values at which the threshold is reported to occur.
Simulated Author's Rebuttal
We thank the referee for their careful reading and positive assessment of the potential significance of our work. We address the single major comment below.
read point-by-point responses
-
Referee: [Mathematical analysis of traveling waves] The non-monotonic speed and diversity loss are derived under the maintained assumption that the population remains in the pulled traveling-wave regime even for selection pressures above the reported threshold. The abstract states that the effect is 'mathematically explained by a novel phase transition for pulled traveling waves,' yet no explicit verification (e.g., comparison of observed wave speed against the pulled-wave formula or inspection of leading-edge dynamics) is described that confirms the wave type does not switch to pushed or become unstable once the threshold is crossed. This verification is load-bearing for the claimed mechanism.
Authors: We agree that explicit verification is necessary to substantiate that the reported phase transition occurs within the pulled regime. In the revised manuscript we will add a dedicated verification section (or appendix) that (i) directly compares simulated front speeds against the analytic pulled-wave speed formula across the full range of selection pressures, including values above the threshold, and (ii) examines the leading-edge density profiles to confirm consistency with pulled-front dynamics and the absence of a switch to pushed or unstable behavior. These additions will make the load-bearing assumption explicit and testable. revision: yes
Circularity Check
No circularity: derivation uses independent traveling-wave analysis and simulations without reduction to fitted inputs or self-citations.
full rationale
The paper derives the non-monotonic adaptation speed and Goodhart-like effect from an idealized model whose long-term behavior is governed by pulled traveling waves, with the threshold arising from a claimed novel phase transition. No equations or text in the provided abstract or description reduce the central prediction to a self-definitional parameter, a fitted quantity renamed as output, or a load-bearing self-citation chain. The traveling-wave regime is invoked as an external modeling assumption whose consequences are then analyzed, rather than being defined in terms of the target result. This is the common case of a self-contained mathematical argument.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Idealized evolution model in which selection acts on phenotypes affected by random contingencies
Reference graph
Works this paper leans on
-
[1]
DOI : 10.1007/s00220-010-1067-y
J. B´ erard and J.-B. Gou´ er´ e. “Brunet-Derrida Behavior of Branching-Selection Particle Systems on the Line”. In: Communications in Mathematical Physics 298.2 (2010), pp. 323–342. issn: 1432-0916. doi: 10.1007/s00220-010-1067-y. url: https://doi.org/10.1007/s00220-010- 1067-y
-
[2]
The genealogy of branching Brownian motion with absorption
J. Berestycki, N. Berestycki, and J. Schweinsberg. “The genealogy of branching Brownian motion with absorption”. English. In: Ann. Probab. 41.2 (2013), pp. 527–618. issn: 0091-1798. doi: 10.1214/11-AOP728
-
[3]
Fluctuations uncover a distinct class of traveling waves
G. Birzu, O. Hallatschek, and K. S. Korolev. “Fluctuations uncover a distinct class of traveling waves”. In: Proceedings of the National Academy of Sciences 115.16 (2018), E3645–E3654
work page 2018
-
[4]
Phenotypic heterogeneity promotes adaptive evolution
Z. B´ odi et al. “Phenotypic heterogeneity promotes adaptive evolution”. In: PLoS biology 15.5 (2017), e2000644
work page 2017
-
[5]
The evolution of variance control
M. Bruijning et al. “The evolution of variance control”. In: Trends in ecology & evolution 35.1 (2020), pp. 22–33
work page 2020
-
[6]
Effect of Microscopic Noise on Front Propagation
´E. Brunet and B. Derrida. “Effect of Microscopic Noise on Front Propagation”. In: Journal of Statistical Physics 103 (Apr. 2001), pp. 269–282. doi: 10.1023/A:1004875804376
-
[7]
Shift in the velocity of a front due to a cutoff
´E. Brunet and B. Derrida. “Shift in the velocity of a front due to a cutoff”. In: Phys. Rev. E 56 (3 1997), pp. 2597–2604. doi: 10.1103/PhysRevE.56.2597 . url: https://link.aps.org/ doi/10.1103/PhysRevE.56.2597
-
[8]
Available: https://link.aps.org/doi/10.1103/PhysRevE
´E. Brunet, B. Derrida, and D. Simon. “Universal tree structures in directed polymers and models of evolving populations”. In: Phys. Rev. E 78 (6 Dec. 2008), p. 061102. doi: 10.1103/PhysRevE. 78.061102. url: https://link.aps.org/doi/10.1103/PhysRevE.78.061102
-
[9]
Effect of selection on ancestry: an exactly soluble case and its phenomenological generalization
´E. Brunet et al. “Effect of selection on ancestry: an exactly soluble case and its phenomenological generalization”. In: Phys. Rev. E 76 (4 2007), p. 041104. doi: 10.1103/PhysRevE.76.041104 . url: https://link.aps.org/doi/10.1103/PhysRevE.76.041104
-
[10]
Noisy traveling waves: Effect of selection on genealogies
´E. Brunet et al. “Noisy traveling waves: Effect of selection on genealogies”. In: Europhys. Lett. 76.1 (2006), pp. 1–7. doi: 10.1209/epl/i2006-10224-4 . url: https://doi.org/10.1209/ epl/i2006-10224-4
-
[11]
Large deviations of a forced velocity-jump process with a Hamilton-Jacobi ap- proach
Nils Caillerie. “Large deviations of a forced velocity-jump process with a Hamilton-Jacobi ap- proach”. English. In: Ann. Inst. Fourier 71.4 (2021), pp. 1733–1755. issn: 0373-0956. doi: 10.5802/aif.3433
-
[12]
Effective population size and patterns of molecular evolution and varia- tion
Brian Charlesworth. “Effective population size and patterns of molecular evolution and varia- tion”. In: Nature Reviews Genetics 10.3 (2009), pp. 195–205
work page 2009
-
[13]
A N-branching random walk with random selection
A. Cortines and B. Mallein. “A N-branching random walk with random selection”. English. In: ALEA, Lat. Am. J. Probab. Math. Stat. 14.1 (2017), pp. 117–137. issn: 1980-0436. url: alea.impa.br/articles/v14/14-07.pdf
work page 2017
-
[14]
The genealogy of an exactly solvable Ornstein-Uhlenbeck type branching process with selection
Aser Cortines and B. Mallein. “The genealogy of an exactly solvable Ornstein-Uhlenbeck type branching process with selection”. English. In: Electron. Commun. Probab. 23 (2018). Id/No 98, p. 13. issn: 1083-589X. doi: 10.1214/18-ECP197
-
[15]
The emperor has no clothes: Limits to risk modelling
J´ on Danıelsson. “The emperor has no clothes: Limits to risk modelling”. In: Journal of Banking & Finance 26.7 (2002), pp. 1273–1296
work page 2002
-
[16]
R. Durrett. Probability models for DNA sequence evolution . Vol. 2. Springer, 2008
work page 2008
-
[17]
Fitness effects of altering gene expression noise in Saccharomyces cerevisiae
F. Duveau et al. “Fitness effects of altering gene expression noise in Saccharomyces cerevisiae”. In: Elife 7 (2018), e37272
work page 2018
-
[18]
Challenges in measuring and understanding bio- logical noise
N. Eling, M. D Morgan, and J. C. Marioni. “Challenges in measuring and understanding bio- logical noise”. In: Nature Reviews Genetics 20.9 (2019), pp. 536–548
work page 2019
-
[19]
D. S. Falconer. Introduction to quantitative genetics . Pearson Education India, 1996. 15
work page 1996
-
[20]
R. A Fisher. “XXI.—On the dominance ratio”. In: Proceedings of the royal society of Edinburgh 42 (1923), pp. 321–341
work page 1923
-
[21]
R. A. Fisher. The genetical theory of natural selection: a complete variorum edition . Oxford University Press, 1923
work page 1923
-
[22]
F. Foutel-Rodier, E. Schertzer, and J. Tourniaire. “Convergence of spatial branching processes to α-stable CSBPs: Genealogy of semi-pushed fronts”. In: arXiv preprint arXiv:2402.05096 (2024)
-
[23]
A quantitative-genetic model for selection on developmental noise
S. Gavrilets and A. Hastings. “A quantitative-genetic model for selection on developmental noise”. In: Evolution 48.5 (1994), pp. 1478–1486
work page 1994
-
[24]
C. A. E. Goodhart. “Problems of Monetary Management: The UK Experience”. In: Monetary Theory and Practice . Macmillan Education UK, 1984, pp. 91–121. isbn: 9781349172955. doi: 10.1007/978-1-349-17295-5_4 . url: http://dx.doi.org/10.1007/978-1-349-17295-5_4
-
[25]
A mathematical theory of natural and artificial selection, part V: selection and mutation
J. B. S. Haldane. “A mathematical theory of natural and artificial selection, part V: selection and mutation”. In: Mathematical Proceedings of the Cambridge Philosophical Society . Vol. 23
- [26]
-
[27]
Polymorphism due to selection of varying direction
J. B. S. Haldane and S. D. Jayakar. “Polymorphism due to selection of varying direction”. In: Journal of Genetics 58 (1963), pp. 237–242
work page 1963
-
[28]
The noisy edge of traveling waves
Oskar Hallatschek. “The noisy edge of traveling waves”. In: Proceedings of the National Academy of Sciences 108.5 (2011), pp. 1783–1787
work page 2011
-
[29]
Goodhart’s Law and Machine Learning: a Structural Perspective
C. A. Hennessy and C. A. E. Goodhart. “Goodhart’s Law and Machine Learning: a Structural Perspective”. In: International Economic Review 64.3 (Apr. 2023), pp. 1075–1086. issn: 1468-
work page 2023
-
[30]
url: http://dx.doi.org/10.1111/iere.12633
doi: 10.1111/iere.12633. url: http://dx.doi.org/10.1111/iere.12633
-
[31]
Genetic analysis of environmental variation
W. G. Hill and H. A. Mulder. “Genetic analysis of environmental variation”. In: Genetics research 92.5-6 (2010), pp. 381–395
work page 2010
-
[32]
Characterization of noise in multistable genetic circuits reveals ways to modulate heterogeneity
S. K. Hortsch and A. Kremling. “Characterization of noise in multistable genetic circuits reveals ways to modulate heterogeneity”. In: PloS one 13.3 (2018), e0194779
work page 2018
-
[33]
How selection affects phenotypic fluctuation
Y. Ito et al. “How selection affects phenotypic fluctuation”. In: Molecular Systems Biology 5.1 (2009), p. 264
work page 2009
-
[34]
J. Karwowski et al. Goodhart’s Law in Reinforcement Learning . 2023. arXiv: 2310 . 09144 [cs.LG]. url: https://arxiv.org/abs/2310.09144
-
[35]
Massively parallel interrogation of the effects of gene expression levels on fitness
L. Keren et al. “Massively parallel interrogation of the effects of gene expression levels on fitness”. In: Cell 166.5 (2016), pp. 1282–1294
work page 2016
-
[36]
Branching Brownian motion with absorption
H. Kesten. “Branching Brownian motion with absorption”. English. In: Stochastic Processes Appl. 7 (1978), pp. 9–47. issn: 0304-4149. doi: 10.1016/0304-4149(78)90035-2
-
[37]
The h-index is no longer an effective correlate of scientific reputation
V. Koltun and D. Hafner. “The h-index is no longer an effective correlate of scientific reputation”. In: PLoS One 16.6 (2021). doi: 10.1371/journal.pone.0253397
-
[38]
Quantitative genetic analysis of multivariate evolution, applied to brain: body size allometry
R.l Lande. “Quantitative genetic analysis of multivariate evolution, applied to brain: body size allometry”. In: Evolution (1979), pp. 402–416
work page 1979
-
[39]
R. C. Lewontin. “The units of selection”. In: Annual review of ecology and systematics 1.1 (1970), pp. 1–18
work page 1970
-
[40]
N-branching random walk with α-stable spine
B. Mallein. “ N-branching random walk with α-stable spine”. English. In: Theory Probab. Appl. 62.2 (2018), pp. 295–318. issn: 0040-585X. doi: 10.1137/S0040585X97T988611
-
[41]
The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models
Alexander Pan, Kush Bhatia, and Jacob Steinhardt. “The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models”. In: International Conference on Learning Repre- sentations. 2022. url: https://openreview.net/forum?id=JYtwGwIL7ye
work page 2022
-
[42]
Evolution of variation and variability under fluctuating, stabilizing, and disruptive selection
C. Pelabon et al. “Evolution of variation and variability under fluctuating, stabilizing, and disruptive selection”. In: Evolution 64.7 (2010), pp. 1912–1925. 16
work page 2010
-
[43]
Coalescents with Multiple Collisions
J. Pitman. “Coalescents with Multiple Collisions”. In: The Annals of Probability 27.4 (1999), pp. 1870–1902. issn: 00911798. url: http://www.jstor.org/stable/2652847
-
[44]
A Gaussian particle distribution for branching Brownian motion with an inhomogeneous branching rate
Matthew I. Roberts and Jason Schweinsberg. “A Gaussian particle distribution for branching Brownian motion with an inhomogeneous branching rate”. English. In: Electron. J. Probab. 26 (2021). Id/No 103, p. 76. issn: 1083-6489. doi: 10.1214/21-EJP673
-
[45]
E. Schertzer and J. Tourniaire. “Spectral analysis and k-spine decomposition of inhomoge- neous branching Brownian motions. Genealogies in fully pushed fronts”. In: arXiv preprint arXiv:2301.01697 (2023)
-
[46]
E. Schertzer and A. H. Wences. “Relative vs absolute fitness in a population genetics model. how stronger selection may promote genetic diversity”. In: arXiv preprint arXiv:2301.07762 (2023)
-
[47]
The hitch-hiking effect of a favourable gene
J. M. Smith and J. Haigh. “The hitch-hiking effect of a favourable gene”. In: Genetics Research 23.1 (1974), pp. 23–35
work page 1974
-
[48]
A branching particle system as a model of semi pushed fronts
J. Tourniaire. “A branching particle system as a model of semi pushed fronts”. In: arXiv preprint arXiv:2111.00096 (2021)
-
[49]
ToW.s experimental manipulation of stochasticity in gene expression
J. Vi˜ nuelas et al. “ToW.s experimental manipulation of stochasticity in gene expression”. In: Progress in biophysics and molecular biology 110.1 (2012), pp. 44–53. 17 Supplemental Materials for: The interplay between natural selection and evolution: a fitness wave approach Outline We present in this Supplementary material the mathematical analysis of th...
work page 2012
-
[50]
to general branching. The population model we introduced is analogue to an N-branching random walk –and more specifically to the exponential exactly solvable model introduced in [9]– when γ → 0. In this case, the population is capped to a value cN for some c < 1/2, and each individual creates ⌊1/c⌋ children independently of one another. If the selection o...
-
[51]
(describing the position of the offspring after the reproduction step), then X i Pi = P in law where P is again a shifted exponential PPP with intensity e−(y−X N eq) with a shift Xeq ≡ Xeq(xi
-
[52]
:= log N γ X i=1 exi 0 ! We emphasize that this simple but crucial observation by Brunet and Derrida [9] makes the model fully integrable. We now make use of this fact to compute the genotypic profile after one generation. 33 Reproduction profile. Let us first consider the individuals ( ri 0)∞ i=0 after reproduction. By the previous observation, log(E(#{i...
-
[53]
Let z ∈ T an individual at position u log(N) (u ∈ (−1, 0)). For the sake of simplicity, let us first assume that individuals are sampled with replacement and let pN(u) := N γ × eµu log(N) PN i=1 eµzi 0 . be the expected number of times our focal individual is selected. From (S.4.3), an easy computation shows that log(PN i=1 eµzi 0) log(N) ≈ 1 − µ. so that...
-
[54]
has limiting log-profile G. The expression of G and a direct computation yields that the speed is given by v ≈ log(χ(µ, γ) log(N) → 0 (S.4.5) so that in the semi-pulled regime, the wave is static in the natural scaling of the system (that is in log(N) units). Strong regime (γ < γ c). Define α through the relation α + (γ − 1 + µ(1 − α)) = 0 ⇐ ⇒ α = 1 − γ 1...
-
[55]
If γ < γ c(µ), ΠN k converges to the (discrete) Poisson Dirichlet coalescent with parameter (1−µ, 0). See [44] for a definition. In particular, lineages coalesce in finite time and for k = 2, and the effective population size is given by Ne ≡ E T N 2 ≈ 1 µ (S.4.7)
-
[56]
If γ > γ c(µ), then the coalescence time between two lineages go to ∞ and we need to accelerate time by χ log(N) in order to see an interesting picture emerging. After this proper time rescaling, the tree Π N k converges to the Bolthausen-Sznitman coalescent [41]. In particular, [44] proved that Ne = E T N 2 ≈ χ(µ, γ) log(N) (S.4.8) This is the ansatz use...
-
[57]
for γ < γ c(µ), then vN ≈ −(1 − γ 1 − µ) + E [log(Yµ)] log(N) + o( 1 log(N)) (S.5.1) where Yµ is a (1 − µ) positive stable random variable whose Laplace transform is given by E h e−λYµ i ) = exp(−Γ(µ)λ1−α) (S.5.2)
-
[58]
Either ≍ 1/ log(N) when γ < γ c, or log(log(χ(µ, γ)/ log(N))) when γ > γ c
For γ > γ c(µ), then vN ≈ log(χ(µ, γ) log(N)) log(N) + o( 1 log(N)) We then have two kinds of correction depending on the regime. Either ≍ 1/ log(N) when γ < γ c, or log(log(χ(µ, γ)/ log(N))) when γ > γ c. Note that both corrections explode when γ → γc(µ) which indicates that the correction o(1) correction should explode at the critical point. A different...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.