REVIEW 3 major objections 4 minor 1 cited by
The paper introduces partial parameter sharing for symbolic regression with multiple categorical variables, claiming that a middle level of sharing — parameters that vary with one category but not another — achieves comparable fit quality w
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-03 12:06 UTC pith:FLQUI5WW
load-bearing objection A clean, useful extension of symbolic regression to multiple categorical variables, but the paper overclaims generalization from in-sample fits. the 3 major comments →
Symbolic Regression for Shared Expressions: Introducing Partial Parameter Sharing
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that intermediate levels of parameter sharing, where a parameter is tied to one categorical variable but held constant across another, give symbolic regression the flexibility to fit multi-category data with fewer individual parameters than either full sharing or full non-sharing. On a synthetic two-category problem, the paper shows that the scheme can re-identify perturbed ground-truth parameters from very few data points per combination, as long as there is enough global data to pin down shared parameters. On a supernova light-curve dataset with two categorical variables (three datasets, two photometric bands), the 'novel' variant, which uses all three sharing levels,
What carries the argument
The key object is the three-level parameter-sharing hierarchy: fully-shared parameters (one value across all category-value combinations), partially-shared parameters (one value per level of one categorical variable, constant across the other), and non-shared parameters (a distinct value for each category-value combination). This decomposition lets a single expression separate additive effects of each category from their interactions. The scheme is embedded in a multi-objective genetic-programming symbolic regression loop, where the count of individual parameters is a third objective alongside fit and complexity, and the nested least-squares fitting exploits the Jacobian's sparsity pattern t
Load-bearing premise
The load-bearing premise is that matching in-sample fit while using fewer parameters automatically guarantees better out-of-sample and zero-shot generalization, a premise the paper adopts without a held-out category-combination test.
What would settle it
Hold out all data for one category-value combination (for instance, one supernova dataset seen through one photometric band), train the predictive variant on the remaining five combinations, and check whether its predicted flux curve for the held-out combination is accurate; if it is not, the claimed zero-shot generalization fails.
If this is right
- For scientific datasets with several categorical variables, researchers can now search for one shared functional form that distinguishes universal behavior from category-specific trends and interactions.
- Data requirements per category combination can fall dramatically; in the synthetic example, some combinations need only a single data point once shared parameters are well constrained by the rest of the data.
- The Pareto-frontier results suggest that parameter count, not just expression size, should be tracked as a primary complexity objective in symbolic regression.
- The predictive variant offers a route to zero-shot prediction for unseen category combinations, which the paper motivates but does not empirically verify.
Where Pith is reading between the lines
- A natural next experiment is to hold out an entire category-value combination (e.g., one supernova dataset in one photometric band) and measure whether the predictive variant's fit degrades gracefully; the paper's zero-shot claim stands or falls on this test.
- The same partial-sharing principle could be applied to other structured multi-task regression settings, such as group-contribution models in chemical engineering, where parameters like group-specific contributions are already a form of categorical sharing.
- Because the real-data comparison uses a fixed preprocessing from the prior study, an independent train/test split would clarify whether the reported R² values reflect in-sample fits; ideally the Pareto analysis would be repeated on held-out data.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper extends symbolic regression with categorical variables by introducing partially shared parameters that are shared across one categorical variable but depend on another, alongside fully shared and non-shared parameters. After defining the sharing taxonomy and describing its implementation in the TiSR framework, the paper reports a synthetic parameter-recovery/data-reduction experiment (Section 3, Eq. 3.1) and a five-variant comparison on a supernovae dataset previously used in [24]. The central claim is that the proposed variants achieve comparable fit quality with significantly fewer parameters while revealing category structure. The conclusion further asserts superior Pareto trade-offs, transfer learning, and zero-shot generalization to unseen category combinations.
Significance. If the claims are validated, the proposed partial-sharing taxonomy is a useful extension of single-category symbolic regression, particularly for separating category-agnostic, category-specific, and interaction effects. The synthetic identifiability experiment is internally consistent, and the comparison of all five variants inside the same algorithmic framework is a strength that controls for implementation confounds. However, the most distinctive claims — out-of-sample trade-off superiority, transfer learning, and zero-shot generalization — are not supported by the experiments as reported. The central derivation is sound, but the evidence is incomplete for the paper's strongest conclusions.
major comments (3)
- [Section 3, Figure 3.1 and Tables 3.2–3.3] No train/test split is described for the supernovae experiment; all reported R² values are therefore in-sample fits. Since the search simultaneously optimizes R² and parameter count, the Pareto comparison shows only that the proposed variants can fit the training data with fewer parameters. It does not establish 'superior trade-offs between fit quality and parameter count' as a predictive statement. Please add a hold-out or cross-validated evaluation, or explicitly revise the claim to 'in-sample fit quality'.
- [Section 4 (Conclusion)] The conclusion claims that 'the proposed approach facilitates zero-shot generalization to unseen category combinations,' but no experiment holds out a category combination. The predictive variant is described as designed for this purpose by omitting non-shared parameters, but design intent is not evidence. Either report an experiment that evaluates held-out category combinations, or remove/qualify the zero-shot generalization claim.
- [Section 3, Eq. (3.1) and Table 3.1] The synthetic 'transfer learning' test only re-fits perturbed ground-truth parameters of a known expression under data subsampling. This tests parameter recovery and data requirements, not the transfer of discovered expressions to new category values or new physical settings. The abstract's reference to testing 'transfer learning' therefore overstates what is measured. Please clarify that this is an identifiability/data-requirement experiment and temper the transfer-learning language accordingly.
minor comments (4)
- [Section 3, text before conclusion] Typo and grammar: 'An additional benefitofthe proposedapproachisthatmore informationiscan be extracted' should be corrected. Also, 'which act like 48 parameters' is unclear; the intended meaning seems to be that 20 individual parameters replace 48 fully non-shared parameters, but the phrasing should be made explicit.
- [Section 3, Figure 3.1] The niching process and horizontal jitter are described, but it is unclear how many unique solutions remain per variant and whether the plotted points are the result of a single best run or aggregated across the five runs. Please clarify the aggregation and consider showing run-level variation or confidence information.
- [Section 3, synthetic experiment] The 100 processions are described but no random seed or variance summary is given for the perturbation scale in Eq. (3.1). Reporting the seed would improve reproducibility.
- [References] In the introduction, 'Virgolin, Pissis [29]' lacks a year; please add it. Also check the reference list for consistent formatting of arXiv identifiers.
Circularity Check
No circularity: the proposed method is a constrained fitting/search procedure evaluated against an external benchmark, and the synthetic test is explicitly fitting-only.
full rationale
The derivation chain is self-contained. The method section defines a least-squares objective (Eq. 2.2) over explicit shared, partially-shared, and non-shared parameters, and the GP search is a standard optimization procedure. The synthetic experiment uses a known ground-truth equation (Eq. 2.3) and measures parameter re-identification under data subsampling and perturbation (Eq. 3.1); the paper itself labels this “synthetic, fitting-only,” so it is not a disguised prediction of new symbolic structure. The real-data comparison adopts the external benchmark and preprocessing of [24], re-implements all variants inside the same TiSR framework, and reports fitted R² and parameter counts; no parameter or expression from [24] is used as an input to derive the proposed variants' results. The self-citation to TiSR [16, 18] is a citation to open-source code used as the implementation base, and the other self-citations (e.g., [17]) are contextual examples, not load-bearing assumptions. Some stronger claims in the conclusion—zero-shot generalization to unseen category combinations and out-of-sample superiority—are asserted without a corresponding holdout experiment, but that is a validation gap, not circularity. No equation is defined in terms of the quantity it is claimed to predict, and no fitted parameter is renamed as a prediction.
Axiom & Free-Parameter Ledger
free parameters (5)
- Maximum expression complexity =
12
- Run duration per variant =
15 minutes
- Probability of introducing partially/non-shared parameters in new expressions =
0
- Perturbation scale in synthetic transfer experiment =
0.1
- Number of runs and random seeds =
5 runs, seeds not reported
axioms (6)
- domain assumption The search heuristics (NSGA-II/GP) can find expressions close to the true Pareto frontier within 15-minute runs.
- ad hoc to paper Fitted least-squares parameters and R² on the benchmark dataset are meaningful evidence of model quality without a reported hold-out split.
- ad hoc to paper For nonlinear expressions, satisfying the stated per-parameter data-count conditions guarantees recoverability and minimum data requirements.
- domain assumption Perturbing ground-truth parameters and re-identifying them measures transfer learning.
- domain assumption The supernovae dataset preprocessing from [24] is appropriate and was not selectively altered for the five variants.
- standard math The nonlinear least-squares parameter identification (Sec. 2.2) converges to a good minimum for the expressions examined.
invented entities (1)
-
Partially-shared parameters (ppartial,U, ppartial,L / C category)
no independent evidence
read the original abstract
Symbolic regression aims to find symbolic expressions that describe datasets. Due to its inherent interpretability, symbolic regression (SR) is a powerful paradigm for scientific discovery. Recent advances have expanded SR to describe related phenomena using a single expression with varying sets of parameters, thereby introducing a single categorical variable. To illustrate, this enables the search for a single expression describing temperaturedependent viscosity across multiple fluids, while simultaneously identifying a distinct set of fluid-specific parameters. We expand upon prior efforts by considering multiple categorical variables and introducing intermediate levels of parameter sharing. Rather than parameters being either entirely universal or entirely unique, some parameters can also be shared across specific categories while remaining distinct for others. This allows for separating universal effects (shared parameters), category-specific trends (partially-shared parameters), and category interactions (non-shared parameters). We test the limits of this setup in terms of reducing data requirements and transfer learning using a synthetic, fitting-only example. Furthermore, we apply the method to an astrophysics dataset also used in a previous single-category study. In comparison, we achieve similar fit quality with significantly fewer parameters while extracting additional information about the problem.
Figures
Forward citations
Cited by 1 Pith paper
-
Learning the Universe: The Structure of Dust Attenuation Curves in Galaxy Simulations
Four parameters suffice to describe dust attenuation curve diversity in TNG simulations, yielding a new symbolic-regression model that recovers curves and fluxes better than existing parameterizations while linking pa...
Reference graph
Works this paper leans on
-
[1]
Bartlett, D. J.; Desmond, H.; Ferreira, P. G. Exhaustive symbolic regression. IEEE Transactions on Evolutionary Computation28,950–964. doi:10.1109/ tevc.2023.3280250(2024)
arXiv 2023
-
[2]
arXiv:2106.06427.https://proceedings.mlr.press/v139/biggio21a
Biggio, L.; Bendinelli, T.; Neitz, A.; Lucchi, A.; Parascandolo, G.Neural sym- bolic regression that scales Proceedings of the 38th International Conference on Machine Learning(eds Meila, M.; Zhang, T.)139(PMLR, 2021), 936–945. arXiv:2106.06427.https://proceedings.mlr.press/v139/biggio21a. html
Pith/arXiv arXiv 2021
-
[3]
M.; Affenzeller, M.Genetic Programming Theory and Practice XIX1–30 (Springer Nature Singapore, 2023)
Burlacu, B.; Kommenda, M.; Kronberger, G.; Winkler, S. M.; Affenzeller, M.Genetic Programming Theory and Practice XIX1–30 (Springer Nature Singapore, 2023). doi:10.1007/978-981-19-8460-01
-
[4]
Cranmer, M.PySR: Fast & parallelized symbolic regression in Python/Julia
-
[5]
Cranmer,M.;Sanchez-Gonzalez,A.;Battaglia,P.;Xu,R.;Cranmer,K.;Spergel, D.; Ho, S.Discovering symbolic models from deep learning with inductive bi- asesarXiv:2006.11287
Pith/arXiv arXiv 2006
-
[6]
Frotscher, O.; Martinek, V.; Fingerhut, R.; Yang, X.; Vrabec, J.; Herzog, R.; Richter, M. Proof of concept for fast equation of state development using an integrated experimental-computational approach.International Journal of Thermophysics44.doi:10.1007/s10765-023-03197-z(2023). 14
-
[7]
S.; Zhang, H.; Bomarito, G.; Cranmer, M.; Fonseca, A.; Burlacu, B.; La Cava, W
Imai Aldeia, G. S.; Zhang, H.; Bomarito, G.; Cranmer, M.; Fonseca, A.; Burlacu, B.; La Cava, W. G.; Olivetti de França, F.Call for action: towards the next generation of symbolic regression benchmark Proceedings of the Ge- netic and Evolutionary Computation Conference Companion(ACM, 2025), 2529–2538. doi:10.1145/3712255.3734309. arXiv:2505.03977
arXiv 2025
-
[8]
Kammerer, L.; Kronberger, G.; Burlacu, B.; Winkler, S. M.; Kommenda, M.; Affenzeller, M.Genetic Programming Theory and Practice XVII79–99 (Springer International Publishing, 2020). doi:10.1007/978-3-030-39958- 0 5
-
[9]
Kommenda, M.; Kronberger, G.; Winkler, S.; Affenzeller, M.; Wagner, S.Ef- fects of constant optimization by nonlinear least squares minimization in sym- bolic regression Proceedings of the 15th Annual Conference Companion on Ge- netic and Evolutionary Computation(ACM, 2013), 1121–1128. doi:10.1145/ 2464576.2482691
arXiv 2013
-
[10]
R.Genetic Programming
Koza, J. R.Genetic Programming. On the Programming of Computers by Means of Natural Selection(The MIT Press, 1992)
1992
-
[11]
Kronberger, G.; Kommenda, M.; Promberger, A.; Nickel, F.Predicting friction system performance with symbolic regression and genetic programming with factor variables Proceedings of the Genetic and Evolutionary Computation Conference(ACM, 2018). doi:10.1145/3205455.3205522
arXiv 2018
-
[12]
LaCava,W.;Orzechowski,P.;Burlacu,B.;OlivettideFranca,F.;Virgolin,M.; Jin, Y.; Kommenda, M.; Moore, J.Contemporary symbolic regression methods and their relative performance Proceedings of the Neural Information Process- ing Systems Track on Datasets and Benchmarks(eds Vanschoren, J.; Yeung, S.)1(2021).https://datasets-benchmarks-proceedings.neurips.cc/ pa...
2021
-
[13]
S.; Yang, J.; Glatt, R.; Santiago, C
Landajuela, M.; Lee, C. S.; Yang, J.; Glatt, R.; Santiago, C. P.; Aravena, I.; Mundhenk, T.; Mulcahy, G.; Petersen, B. K.A unified framework for deep symbolic regression Advances in Neural Information Processing Systems(eds Koyejo, S.; Mohamed, S.; Agarwal, A.; Belgrave, D.; Cho, K.; Oh, A.)35(Cur- ran Associates, Inc., 2022), 33985–33998.https://proceedi...
2022
-
[14]
Lemos, P.; Jeffrey, N.; Cranmer, M.; Ho, S.; Battaglia, P. Rediscovering orbital mechanics with machine learning.Machine Learning: Science and Technology 4,045002. doi:10.1088/2632-2153/acfa63(2023)
-
[15]
Loh, C.; Schneegass, D.; Tian, P.A search for the underlying equation gov- erning similar systemsarXiv:1908.10673
Pith/arXiv arXiv 1908
-
[16]
A tool for the thermodynamic equation of state development2023
Martinek, V.Thermodynamics-informed symbolic regression (TiSR). A tool for the thermodynamic equation of state development2023. doi:10.5281/ zenodo.8317546.https://github.com/scoop-group/TiSR/
-
[17]
Martinek, V.; Bell, I.; Herzog, R.; Richter, M.; Yang, X. Entropy scaling of vis- cosity IV—application to 124 industrially important fluids.Journal of Chemi- cal & Engineering Data70,727–742. doi:10.1021/acs.jced.4c00451(2025)
-
[18]
Martinek,V.;Frotscher,O.;Richter,M.;Herzog,R.Introducing thermodynamics- informed symbolic regression – a tool for thermodynamic equations of state developmentarXiv:2309.02805. 15
-
[19]
Matchev, K. T.; Matcheva, K.; Roman, A. Analytical modeling of exoplanet transit spectroscopy with dimensional analysis and symbolic regression.The Astrophysical Journal930,33. doi:10.3847/1538-4357/ac610c(2022)
-
[20]
Michishita, Y. Alpha Zero for physics: application of symbolic regression with Alpha Zero to find analytical methods in physics.Journal of the Physical So- ciety of Japan93.doi:10.7566/jpsj.93.074005. arXiv:2311.12713(2024)
Pith/arXiv arXiv 2024
-
[21]
Muzny, C. D.; Huber, M. L.; Kazakov, A. F. Correlation for the viscosity of normal hydrogen obtained from symbolic regression.Journal of Chemical & Engineering Data58,969–979. doi:10.1021/je301273j(2013)
-
[22]
Olivetti de França, F.; Kronberger, G.Improving genetic programming for symbolic regression with equality graphs Proceedings of the Genetic and Evolu- tionary Computation Conference(ACM,2025),989–998.doi:10.1145/3712256. 3726383. arXiv:2501.17848
Pith/arXiv arXiv 2025
-
[23]
K.; Landajuela Larma, M.; Mundhenk, T
Petersen, B. K.; Landajuela Larma, M.; Mundhenk, T. N.; Prata Santiago, C.; Kim, S. K.; Kim, J. T.Deep symbolic regression: recovering mathematical expressions from data via risk-seeking policy gradients International Confer- ence on Learning Representations, ICLR 2021(2021). arXiv:1912.04871. https://openreview.net/forum?id=m5Qsh0kBQG
Pith/arXiv arXiv 2021
-
[24]
Russeil,E.;OlivettideFrança,F.;Malanchev,K.;Burlacu,B.;Ishida,E.E.O.; Leroux, M.; Michelin, C.; Moinard, G.; Gangler, E.Multi-view symbolic regres- sionarXiv:2402.04298
-
[25]
Exploring multi-view symbolic regression methods in physical sciencesarXiv: 2509.10500
Russeil, E.; Olivetti de França, F.; Malanchev, K.; Moinard, G.; Cherrey, M. Exploring multi-view symbolic regression methods in physical sciencesarXiv: 2509.10500
-
[26]
Sotiriadou, S. G.; Antoniadis, K. D.; Assael, M. J.; Martinek, V.; Huber, M. L. Correlation for the viscosity of methane (CH4) from the triple point to 625 K and pressures to 1000 MPa.International Journal of Thermophysics 47.doi:10.1007/s10765-025-03690-7(2025)
-
[27]
Tenachi, W.; Ibata, R.; François, T. L.; Diakogiannis, F. I. Class symbolic regression: gotta fit ’em all.The Astrophysical Journal Letters969,L26. doi:10.3847/2041-8213/ad5970. arXiv:2312.01816(2024)
Pith/arXiv arXiv 2041
-
[28]
Valipour, M.; You, B.; Panju, M.; Ghodsi, A.SymbolicGPT: a generative transformer model for symbolic regressionarXiv:2106.14131
-
[29]
P.Symbolic regression is NP-hardarXiv:2207.01018
Virgolin, M.; Pissis, S. P.Symbolic regression is NP-hardarXiv:2207.01018
-
[30]
Wang, G.; Wang, E.; Li, Z.; Zhou, J.; Sun, Z. Exploring the mathematic equa- tionsbehindthematerialssciencedatausinginterpretablesymbolicregression. Interdisciplinary Materials3,637–657. doi:10.1002/idm2.12180(2024)
-
[31]
Wang, Y.; Wagner, N.; Rondinelli, J. M. Symbolic regression in materials science.MRS Communications9,793–805. doi:10.1557/mrc.2019.85(2019)
-
[32]
Weiss, K.; Khoshgoftaar, T. M.; Wang, D. A survey of transfer learning.Jour- nal of Big Data3.doi:10.1186/s40537-016-0043-6(2016)
-
[33]
Yang, X.; Frotscher, O.; Richter, M. Symbolic-regression aided development of a new cubic equation of state for improved liquid phase density calculation at pressures up to 100 MPa.International Journal of Thermophysics46.doi:10. 1007/s10765-024-03490-5(2025). 16
2025
-
[34]
Effective thermophysical constants of thousands of flu- ids
Yang, X.; Richter, M. Effective thermophysical constants of thousands of flu- ids. I: critical temperature, critical pressure, critical density, and acentric fac- tor.Journal of Chemical & Engineering Data70,2911–2946. doi:10.1021/ acs.jced.5c00110(2025). (V. Martinek)Interdisciplinary Center for Scientific Computing, Heidelberg Uni- versity, 69120 Heidel...
2025
-
[2020]
doi:10.5281/zenodo.4041459
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.