REVIEW 2 major objections 7 minor 27 references
A Better Multi-Objective GP-GOMEA -- But do we Need it?
T0 review · 2 major / 7 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read For accuracy versus expression size, single-objective GP-GOMEA with a logging archive beats its multi-objective counterpart.
desk verdict Solid empirical contribution that improves MO GP-GOMEA, but the headline SO-over-MO recommendation rests on an untested initialization assumption and the abstract overstates it. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The comparison rests on two working parts. First, the MO elitist archive: in both configurations a non-dominated archive is maintained, but in the single-objective configuration it has no influence on selection or variation, so it acts purely as a logger of the accuracy-size trade-off. Second, the proposed balanced clustering scheme BKmRR: extreme clusters are formed by taking the top $n/k$ individuals for each objective, then the remaining $k-2$ clusters are filled by round-robin assignment of the closest unassigned individual, so every cluster is equal in size and the best solutions per objective sit in dedicated single-objective clusters. The duplicate-fitness mutation step, which mutates individuals whose objective values duplicate until an active node changes, is what makes both configurations faster to explore.
What would settle it
Run the same five datasets with size-uniform initialization, so no individual at generation zero has expression size 1, and compare average hypervolume of single-objective-with-archive versus multi-objective with BKmRR; if MO then matches or exceeds SO, the SO-first conclusion is specific to this initialization and time budget.
Extended reading notes
Core claim
The central discovery is that the best-performing way to obtain a Pareto front of accuracy and expression size with Modular GP-GOMEA is to not run multi-objective optimization at all: a single-objective run that maximizes $R^2$ and merely records non-dominated solutions in an elitist archive consistently beats the genuinely multi-objective algorithm in average hypervolume on all five datasets. The reason is initialization-dependent: the half-and-half initializer already places minimal-size expressions on the front within the first generations, so the multi-objective variant's continued minimization of expression size consumes search effort without moving the front, while the single-objective run spends all its effort raising accuracy and incidentally discovers larger expressions along the way. The paper also shows that the new BKmRR clustering, which reserves equal-sized extreme clusters for each objective and fills the remaining clusters round-robin, improves multi-objective GP-GOMEA over the original clustering, and that a de-duplicated size objective can promote functional subexpression reuse on synthetic problems.
Load-bearing premise
The whole comparison depends on initialization: if the first generation already contains expressions of the smallest possible size, as happens with half-and-half initialization, then the multi-objective run wastes effort trying to shrink them further, and with a different initializer the single-objective advantage might vanish.
Editorial extensions
If this is right
- For the accuracy-versus-expression-size trade-off under a three-hour budget, a single-objective Modular GP-GOMEA with an MO logging archive is the better default, because it reaches a higher average hypervolume faster.
- The proposed BKmRR clustering improves MO Modular GP-GOMEA over the original clustering: it statistically outperforms BKRR on all five datasets.
- Mutating individuals that have duplicate per-objective fitness raises average hypervolume for both the single-objective and multi-objective variants.
- Using a de-duplicated size objective during search increases the quality of the final non-dominated front on four of five synthetic datasets designed to contain subexpression reuse.
- When the secondary objective is uncorrelated with accuracy and not already well optimized at initialization, such as the number of cosine operators, the multi-objective variant significantly beats the single-objective one.
Reading between the lines
- The paper's own account implies that the SO-first recommendation could reverse under size-uniform initialization, where the initial population consists of full, larger trees; the authors flag this possibility but do not run the experiment.
- A practical reading is that MO GP-GOMEA's value depends on whether half-and-half initialization already supplies near-optimal values of the secondary objective, so one can check that condition before choosing MO over SO.
- The de-duplicated size objective likely generalizes to other complexity measures that count repeated structure, such as operator-cost sums or node-depth measures, since it targets the same repeated-subexpression waste.
- The generation-versus-time comparison in the paper suggests that with longer budgets MO optimization may catch up; a direct extrapolation test would compare the two algorithms at, say, twenty-four hours rather than three.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. Harrison et al. study whether a multi-objective (MO) version of Modular GP-GOMEA is preferable to a single-objective (SO) version with an MO archive for symbolic regression. They introduce two clustering methods (BKRR and BKmRR), a duplicate-fitness mutation scheme, and a de-duplicated size objective intended to promote subexpression reuse. Using five real-world and five synthetic datasets, they report that SO Modular GP-GOMEA with an MO archive achieves a higher average hypervolume than the MO variants when accuracy is traded against expression size within a three-hour budget, but that MO wins when the secondary objective is uncorrelated with accuracy, such as maximizing the number of cosine operators. The authors attribute the SO dominance to half-and-half initialization already producing minimal-size individuals, and they explicitly note that alternative initialization could change the outcome.
Significance. If the results hold, the paper provides useful practical guidance: for correlated secondary objectives, a single-objective GP-GOMEA with an MO archive can be a cheaper and often better choice, while MO search is valuable when the secondary objective is not already well covered by initialization. The empirical design is a strength: multiple datasets, ten repetitions, corrected Wilcoxon tests, and a deliberately chosen counterexample objective. The proposed BKmRR clustering and duplicate-fitness mutation improve MO GP-GOMEA and are worthy contributions in their own right. The main limitation is that the central SO-over-MO recommendation is tied to one initialization scheme and is not tested under the size-uniform initialization that the authors themselves identify as a potential confound. The absence of code or data also makes the quantitative claims hard to verify independently.
major comments (2)
- [Abstract; Section 3.7; Section 4] The central claim that SO GP-GOMEA with an MO archive 'consistently' outperforms MO GP-GOMEA for the size/accuracy trade-off is load-bearing on an untested initialization premise. The paper's own Section 4 states: 'Initialising the individuals differently, e.g., uniformly in terms of size as done in [18] or [11], may potentially positively influence the performance of MO GP-GOMEA, but this requires further research.' Because half-and-half initialization already places individuals at the minimum expression size in the first generations, the comparison does not exercise MO's ability to discover the size/accuracy trade-off from a non-saturated starting distribution. The abstract and the conclusion ('SO optimization ... as a first step for most scenarios') should be qualified to the tested initialization and time budget, or an experiment with size-uniform initialization should be added.
- [Section 2.4; Section 3.1] The SO variant is described in Section 2.4 as using the MO elitist archive only for logging, with the archive not influencing the evolutionary process 'in any way.' However, Section 3.1 states that runs terminate when the MO elitist archive does not change for 100 consecutive generations. The archive therefore controls the stopping criterion and, consequently, the number of generations and the final reported hypervolume of the SO runs. This apparent contradiction should be resolved, either by clarifying that the archive affects only termination or by adjusting the description in Section 2.4.
minor comments (7)
- [Section 3.4, Table 5] The sentence 'MO GP-GOMEA is outperformed by SO GP-GOMEA in all datasets' is not supported by the numbers as presented: Table 5 reports BKmRR hypervolume 0.900 ± 0.005 on Tower, while Table 4 reports SO hypervolume 0.899 ± 0.004. Please verify the comparison and rephrase.
- [Section 3.4, Table 5 caption] The caption should state explicitly that the MO experiments in this table use a population size five times larger than the SO experiments, and how the SO population size was chosen for this comparison.
- [Algorithm 2] Lines 21 and 22 of Algorithm 2 are identical ('Identify clusters as extreme or middle clusters'); one of the two lines should be removed.
- [Section 3.5] The sentence 'Symbolic expressions in GP are often modelled as binary-unary trees' appears twice in this section; it is a duplicate from Section 2.1 and should be deleted.
- [Section 3.7] There is a typo: 'intitializes' should be 'initializes'.
- [General] No code or data repository is provided. For a claims-heavy empirical paper, making the implementation and datasets available would substantially improve reproducibility.
- [Table 12] The SO standard deviations for the cosine objective are very large (e.g., Air 0.446 ± 0.159, Concrete 0.468 ± 0.201); reporting confidence intervals or effect sizes would help readers assess the stability of the MO advantage.
Circularity Check
No significant circularity; the central SO-versus-MO comparison is empirical and self-contained.
full rationale
The paper's central claim is an empirical comparison of average hypervolume between SO Modular GP-GOMEA with a logging-only MO archive and MO Modular GP-GOMEA with proposed clustering improvements. The results are measured on five real-world datasets and five synthetic datasets with statistical testing; no prediction is derived from a fitted parameter or from the definition of the objectives. The proposed BKRR and BKmRR clustering methods are algorithmic proposals tested by experiment, not quantities inferred from the outcome they are used to explain. The Discussion's acknowledgment that different initialization (e.g., size-uniform) could change the ranking is an honest limitation of generality, not a circular step, because the paper does not define SO superiority into the setup. Self-citations to the authors' prior Modular GP-GOMEA [6] and MO GP-GOMEA [20] supply baseline algorithms and synthetic benchmark generators, but the present paper re-executes these algorithms and compares against independent datasets, so the citations are not load-bearing substitutes for evidence. No uniqueness theorem is imported, and no known result is renamed. The only mild concern is that the recommendation is contingent on half-and-half initialization, which the paper itself flags; this is a correctness or robustness risk, not circularity.
Assumptions & free parameters
free parameters (5)
- Population size =
4096
- Number of clusters k =
5
- Time budget =
3 hours
- De-duplicated size discount =
subtract all duplicate non-leaf nodes
- Operator complexity scores =
Table 13 values
assumptions (3)
- domain assumption Standard assumptions of GP-GOMEA as described in prior work [22]
- domain assumption Datasets are representative of symbolic regression tasks
- standard math Hypervolume with normalized objectives is a valid comparison metric
Cite this review
Pith. "Pith review of A Better Multi-Objective GP-GOMEA -- But do we Need it?." pith.science (2026). https://pith.science/paper/EIVXLCHP
@misc{pith2026250703777,
author = {Pith},
title = {Pith review of: A Better Multi-Objective GP-GOMEA -- But do we Need it?},
year = {2026},
howpublished = {\url{https://pith.science/paper/EIVXLCHP}},
note = {Machine review of arXiv:2507.03777}
}
read the original abstract
In Symbolic Regression (SR), achieving a proper balance between accuracy and interpretability remains a key challenge. The Genetic Programming variant of the Gene-pool Optimal Mixing Evolutionary Algorithm (GP-GOMEA) is of particular interest as it achieves state-of-the-art performance using a template that limits the size of expressions. A recently introduced expansion, modular GP-GOMEA, is capable of decomposing expressions using multiple subexpressions, further increasing chances of interpretability. However, modular GP-GOMEA may create larger expressions, increasing the need to balance size and accuracy. A multi-objective variant of GP-GOMEA exists, which can be used, for instance, to optimize for size and accuracy simultaneously, discovering their trade-off. However, even with enhancements that we propose in this paper to improve the performance of multi-objective modular GP-GOMEA, when optimizing for size and accuracy, the single-objective version in which a multi-objective archive is used only for logging, still consistently finds a better average hypervolume. We consequently analyze when a single-objective approach should be preferred. Additionally, we explore an objective that stimulates re-use in multi-objective modular GP-GOMEA.
Figures
Figures from the paper (8 more)
Reference graph
Works this paper leans on
-
[18]
Pablo Ramos Criado, D Barrios Rolanía, Daniel Manrique, and Emilio Serrano
-
[11]
Guillaume Lample and François Charton. 2019. Deep learning for symbolic mathematics. arXiv preprint arXiv:1912.01412 (2019)
arXiv 2019
-
[1]
Peter AN Bosman. 2010. The anticipated mean shift and cluster registration in mixture-based EDAs for multi-objective optimization. In Proceedings of the 12th annual conference on Genetic and evolutionary computation . 351–358
work page 2010
-
[2]
Anton Bouter, Ngoc Hoang Luong, Cees Witteveen, Tanja Alderliesten, and Peter A. N. Bosman. [n. d.]. The multi-objective real-valued gene-pool optimal mixing evolutionary algorithm. In Proceedings of the Genetic and Evolutionary Computation Conference (New York, NY, USA, 2017-07). ACM, 537–544. https: //doi.org/10.1145/3071178.3071274
arXiv 2017
-
[3]
Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE transactions on evolutionary computation 6, 2 (2002), 182–197. A Better Multi-Objective GP-GOMEA - But do we Need it? GECCO ’25 Companion, July 14–18, 2025, Malaga, Spain
work page 2002
-
[4]
Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of inter- pretable machine learning. arXiv preprint arXiv:1702.08608 (2017)
arXiv 2017
-
[5]
Ilan Gronau and Shlomo Moran. 2007. Optimal implementations of UPGMA and other common clustering algorithms. Information processing letters 104, 6 (2007), 205–210
work page 2007
-
[6]
Bosman, and Tanja Alderliesten
Joe Harrison, Peter A.N. Bosman, and Tanja Alderliesten. 2025. Thinking Outside the Template with Modular GP-GOMEA. arXiv preprint arXiv2505.01262 (2025)
arXiv 2025
Show all 27 references
-
[7]
Maarten Keijzer. 2003. Improving symbolic regression with interval arithmetic and linear scaling. In European Conference on Genetic Programming . Springer, 70–82
2003
-
[8]
Michael Kommenda, Andreas Beham, Michael Affenzeller, and Gabriel Kron- berger. 2015. Complexity measures for multi-objective symbolic regression. In Computer Aided Systems Theory–EUROCAST 2015: 15th International Conference, Las Palmas de Gran Canaria, Spain, February 8-13, 2...
2015
-
[9]
Michael Kommenda, Bogdan Burlacu, Gabriel Kronberger, and Michael Affen- zeller. 2020. Parameter identification for symbolic regression using nonlinear least squares. Genetic Programming and Evolvable Machines 21, 3 (2020), 471–501
2020
-
[10]
John R Koza. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection . Vol. 1. MIT press Cambridge, MA, USA
1992
-
[12]
Zachary C Lipton. 2018. The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue 16, 3 (2018), 31–57
2018
-
[13]
Dazhuang Liu, Marco Virgolin, Tanja Alderliesten, and Peter AN Bosman. 2022. Evolvability degeneration in multi-objective genetic programming for symbolic regression. In Proceedings of the Genetic and Evolutionary Computation Conference. 973–981
2022
-
[14]
Hoang N Luong and Peter AN Bosman. 2012. Elitist archiving for multi-objective evolutionary algorithms: To adapt or not to adapt. In Parallel Problem Solving from Nature-PPSN XII: 12th International Conference, Taormina, Italy, September 1-5, 2012, Proceedings, Part II 12 . Sp...
2012
-
[15]
Ngoc Hoang Luong, Han La Poutré, and Peter AN Bosman. 2014. Multi-objective gene-pool optimal mixing evolutionary algorithms. In Proceedings of the 2014 Annual Conference on Genetic and Evolutionary Computation . 357–364
2014
-
[16]
Julian F Miller and Stephen L Smith. 2006. Redundancy and computational efficiency in cartesian genetic programming. IEEE Transactions on evolutionary computation 10, 2 (2006), 167–174
2006
-
[17]
Michael O’Neill. 2009. Riccardo Poli, William B. Langdon, Nicholas F. McPhee: A Field Guide to Genetic Programming: Lulu. com, 2008, 250 pp, ISBN 978-1-4092- 0073-4
2009
-
[19]
Thalea Schlender, Mafalda Malafaia, Tanja Alderliesten, and Peter Bosman. 2024. Improving the efficiency of GP-GOMEA for higher-arity operators. InProceedings of the Genetic and Evolutionary Computation Conference . 971–979
2024
-
[20]
EMC Sijben, Tanja Alderliesten, and Peter AN Bosman. 2022. Multi-modal multi- objective model-based genetic programming to find multiple diverse high-quality models. In Proceedings of the Genetic and Evolutionary Computation Conference . 440–448
2022
-
[21]
Bas HM Van der Velden, Hugo J Kuijf, Kenneth GA Gilhuijs, and Max A Viergever
-
[22]
Marco Virgolin, Tanja Alderliesten, Cees Witteveen, and Peter AN Bosman. 2021. Improving model-based genetic programming for symbolic regression of small expressions. Evolutionary computation 29, 2 (2021), 211–237
2021
-
[23]
Marco Virgolin and Peter AN Bosman. 2022. Coefficient mutation in the gene-pool optimal mixing evolutionary algorithm for symbolic regression. In Proceedings of the Genetic and Evolutionary Computation Conference Companion . 2289–2297
2022
-
[24]
Marco Virgolin, Andrea De Lorenzo, Eric Medvet, and Francesca Randone. 2020. Learning a formula of interpretability to learn interpretable formulas. In Parallel Problem Solving from Nature–PPSN XVI: 16th International Conference, PPSN 2020, Leiden, The Netherlands, September 5...
2020
-
[25]
Eckart Zitzler and Lothar Thiele. 1999. Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach. IEEE transactions on Evolutionary Computation 3, 4 (1999), 257–271. GECCO ’25 Companion, July 14–18, 2025, Malaga, Spain Harrison et al. A...
1999
-
[2020]
Soft Computing 24, 15 (2020), 11265–11282
Grammatically uniform population initialization for grammar-guided genetic programming. Soft Computing 24, 15 (2020), 11265–11282
2020
-
[2022]
Medical Image Analysis 79 (2022), 102470
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Medical Image Analysis 79 (2022), 102470
2022
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.