Pith. sign in

REVIEW 5 major objections 4 minor 23 references

Material synthesis through simulations guided by machine learning: a position paper

T0 review · 5 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read A tuned gradient-boosting model predicts concrete porosity with a mean squared error of 0.1077, suggesting machine-learning-guided simulations could replace costly trial-and-error mix design for stone-cutting sludge reuse.

desk verdict The paper's real content is a small, reproducible regression benchmark on concrete porosity with Bayesian tuning; the 'simulation' and sludge-reuse promise are unsupported, so it reads as an overclaimed position paper. read the letter →

arxiv 2411.13953 v2 pith:LEFK3T6I submitted 2024-11-21 cs.LG

classification cs.LG
keywords marblesludgerecyclingmixdesignmachinelearningBayesianoptimizationgradientboostingporositypredictionsimulation-guidedmaterialspositionpaper
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This position paper argues that machine learning, combined with Bayesian-optimization-based hyperparameter tuning (which the authors call meta-learning), can predict material properties accurately enough to guide the mix design of concrete made with stone-cutting sludge. To support this claim in the absence of sludge-specific data, the authors train several regression models on a public concrete dataset and show that gradient boosting achieves a test mean squared error of 0.1077 for porosity prediction. They propose this as a proof-of-concept that simulations can generate large datasets and identify optimal sludge mix designs, reducing the need for lengthy and costly physical experiments. The paper's contribution is thus a proposal backed by a preliminary demonstration, not a validated industrial workflow.

What carries the argument

The central mechanism is the machine-learning-based 'simulator': a regression model (gradient boosting, after tuning) that takes material characteristics — water-to-binder ratio, binder content, fly ash, slag, superplasticizer, aggregate ratio, curing days, and strength — as inputs and outputs a predicted porosity. Hyperparameter tuning is carried out by Bayesian optimization, which the paper describes as a meta-learning approach: it builds a Gaussian-process surrogate of the objective function and selects promising hyperparameter combinations, balancing exploration and exploitation. This tuning step is what lifts gradient boosting from the worst-performing model (test R² 0.2820) to the best (test R² 0.8887), and it is the load-bearing procedure for the paper's claim that ML can be made trustworthy for mix-design guidance.

What would settle it

Collect a dataset of marble-sludge concrete mixes with measured porosity (or any target property), train the same gradient-boosting model with Bayesian optimization on it, and evaluate on a held-out test set; if the test MSE is substantially worse than the 0.1077 achieved on concrete, or no better than predicting the mean, the transfer claim collapses. A simpler check: compare the model's predicted optimal sludge mix against a randomly chosen mix in a physical experiment; if the model-guided mix does not reliably outperform the baseline, the practical value is unproven.

Watch

Extended reading notes

Core claim

The paper's central claim is that machine-learning-guided simulation can replace much of the empirical trial-and-error in material mix design, specifically for reusing marble sludge. On the concrete dataset, the authors apply five regression models (linear regression, support vector regression, random forest, gradient boosting, and XGBoost) and then tune them with Bayesian optimization. After tuning, gradient boosting performs best, reaching a test MSE of 0.1077, a test R² of 0.8887, and a test MAPE of 0.6933. The authors conclude that this level of accuracy 'unlocks the possibility of trusting the simulation' and performing only a restricted number of real experiments. They propose extending the same approach to stone-cutting sludge mix design once relevant data become available, arguing that the concrete task is a similar proxy.

Load-bearing premise

The load-bearing premise is that concrete porosity prediction is a valid proxy for marble-sludge mix design, so a model trained on concrete data will transfer to sludge-based mixtures with different chemistry and variability — but no sludge-specific data or transfer experiment is provided.

Editorial extensions

If this is right

  • If the approach transfers, stone producers could screen candidate sludge mix designs computationally before running any physical tests, cutting both cost and waste.
  • The same tuned-regression pipeline could be applied to other material properties — not just porosity — such as compressive strength or durability, whenever a relevant dataset exists.
  • Simulation-driven mix design could be adapted to different regional building regulations by retraining on local data, reducing the need for redundant experiments in each jurisdiction.
  • The demonstrated performance jump from Bayesian optimization suggests that many existing ML applications in materials may be underperforming simply due to poor hyperparameter choices.
  • A reliable porosity simulator would let researchers explore a far wider mix-design space than laboratory budgets allow, potentially discovering better-performing recipes than current heuristics.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper's use of the term 'meta-learning' is nonstandard: Bayesian optimization for hyperparameter tuning is not learning from multiple related tasks in the usual meta-learning sense, so readers should interpret the claim accordingly.
  • The strongest test of the proposal would be to run the identical pipeline on an actual marble-sludge mix-design dataset; until that is done, the concrete result remains a proxy demonstration, and the transfer is an assumption rather than an established finding.
  • If sludge-specific data are too scarce for training, the paper's own logic suggests a more direct route: collect a modest set of sludge mixes, tune the model with Bayesian optimization, and check whether the predicted optimal mix outperforms a random or heuristic baseline in physical testing.
  • The approach could be extended to active learning, where the simulator suggests which experiments to run next, using the model's uncertainty to minimize the number of physical tests needed.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 4 minor

Summary. This position paper proposes using machine learning, with hyperparameter optimization via 'meta-learning' (identified as Bayesian optimization), to guide material mix design for marble sludge reuse. The authors train several regression models (SVM, LR, RF, GB, XGB) on a public dataset of 240 concrete records and report that after Bayesian optimization, gradient boosting predicts porosity with a test MSE of 0.1077 and R² of 0.8887, claiming this unlocks simulation-driven mix design and that the approach can be transferred to stone-cutting sludge. The paper presents the concrete experiment as a proxy because no sludge-specific dataset is available.

Significance. If fully supported, the paper would offer a low-cost, data-efficient path for estimating concrete porosity and a plausible first step toward ML-guided mix design for recycled stone sludge. The manuscript has clear strengths: it uses a public dataset, reports standard metrics (MSE, R², MAPE) with a held-out test set, compares five models, and documents the practical motivation for stone-cutting sludge reuse in detail. However, the central contribution is not delivered: the 'simulator' is a supervised regressor and cannot generate the promised large dataset, no sludge-specific data or transfer experiment is provided, and the 'meta-learning' claim is a mislabeling of Bayesian hyperparameter optimization. The paper therefore does not substantiate its headline claims.

major comments (5)
  1. [Section 3.4] The 'simulator' is not a simulator and cannot generate large datasets as the Abstract promises. The text claims that the model 'enabl[es] the estimation of porosity without relying on historical data and using only current material inputs,' but the model's parameters are learned entirely from 240 historical concrete records. A supervised regressor can only interpolate predictions for new feature combinations; it cannot generate new ground-truth data points. No generative model, physical forward model, or sampling procedure is described. Consequently, the Abstract's statement that 'through simulations, a large dataset can be generated' is unsupported, and the title's promise of 'material synthesis through simulations' is not met.
  2. [Section 4] The transfer to stone-cutting sludge is untested and rests on an unverified analogy. Section 4 justifies the concrete dataset by stating 'Concrete quality estimation is a very similar task to the one we aim to solve,' but no sludge-specific features (e.g., CaCO3 content, particle-size distribution, sludge-to-binder ratio) are used, and no transfer experiment is performed. The conclusion that ML 'can estimate the correct quantity of stone-cutting sludge to be used in aggregates' (Abstract) is therefore a speculation about transfer across materials with different chemistry, variability, and processing, not a demonstrated result.
  3. [Table 1] The feature set includes Strength as an input to predict porosity. In a mix-design workflow, strength is a target property that would not be known before the mix is produced; using it as an input makes the model an inverse or diagnostic predictor, not a forward design simulator. The paper does not explain how a user of the proposed simulator would supply 'Strength' before making and testing the concrete, which undermines the claimed applicability of the simulator for discovering optimal mix designs.
  4. [Section 3.2] The identification of Bayesian hyperparameter optimization as 'meta-learning' is a terminology error with consequences for the paper's central claim. Meta-learning refers to learning across tasks (e.g., few-shot learning, learning-to-learn); Bayesian optimization is a standard hyperparameter-search technique applied to a single dataset. No multi-task or few-shot experiments are reported, so the paper's advertised advantage of using meta-learning in data-constrained settings is not demonstrated.
  5. [Section 3.3 and Figure 2] The evaluation protocol is underspecified regarding the test set. The paper does not state whether Bayesian optimization used the same test partition for feedback (Figure 2 shows 'evaluation feedback' but not its source); if the test set was used to select hyperparameters, the reported test MSE of 0.1077 would be optimistically biased. Moreover, the random 80/20 split on 240 records from only 74 unique mixture designs may place the same design in both training and testing, inflating performance. A grouped split by mixture design should be reported as a check.
minor comments (4)
  1. [Section 3.1] The term 'Z-Normalization' is nonstandard; use 'z-score normalization' or 'standardization'.
  2. [Sections 3.2 and 3.3] The headings 'T raining' and 'T esting' contain spurious spaces that should be removed.
  3. [Section 4.1] The figure references appear inconsistent: the text says 'Figure 4 displays the performance ... before any hyper-parameter optimization,' but Figure 3 is captioned 'without meta-learning' and Figure 4 'with meta-learning.' Please correct the numbering or the verbal description.
  4. [Section 4.1] The discussion of GB states 'GB performs the worst among the models, with an (R2 = 0.4738)' without specifying whether this is the training or test value; from Table 2 the value appears to be the test R², but the sentence should state this explicitly.

Circularity Check

1 steps flagged · score 4.0 of 10

Empirical porosity benchmark is independent, but the paper's 'simulation generates a large dataset' advantage restates the fitted regressor as a generative simulator, a renaming that reduces by construction to the training data.

  1. renaming known result [Section 3.4 'Simulator'; cf. Abstract advantage (i)]
    "Unlike a traditional predictor, which forecasts outcomes based solely on historical data, our simulator offers more comprehensive capabilities. It models and simulates the complex relationships between various material parameters, enabling the estimation of porosity without relying on historical data and using only current material inputs."

    Section 3.2 trains this simulator on the 240-record historical concrete dataset, so its porosity output is by construction a function of those historical labels. Thus the Abstract's claimed advantage that 'through simulations, a large dataset can be generated' reduces to evaluating the fitted regressor on new feature vectors; such a generated dataset contains no new ground truth and is a re-encoding of the training data plus interpolation. The claim 'without relying on historical data' is contradicted by the training stage. The reported held-out MSE remains an independent benchmark; the circularity is in the simulation-generation framing.

full rationale

The only quantified result — GB with Bayesian optimization reaching a test MSE of 0.1077 on the public concrete dataset — is an ordinary supervised regression evaluated on a held-out split, so it is not circular: the model's output is not defined in terms of the test labels. The circularity concern is confined to the framing. Section 3.4 calls the trained model a 'simulator' and claims it estimates porosity 'without relying on historical data,' although Section 3.2 trained it on exactly those historical data; the Abstract's claimed advantage (i), that 'through simulations, a large dataset can be generated,' is therefore equivalent by construction to evaluating the fitted regressor, and such a generated dataset adds no new ground-truth information. The paper itself honestly concedes that sludge-specific transfer is untested ('we propose that this strategy could be effectively applied to achieve improved results with smaller datasets of this type'), which is a non-circular external-validity gap. The Table 1 statement that 'features were chosen based on their Pearson correlation with porosity' and the inclusion of Strength as an input are potential leakage/correlation caveats for the reported MSE, but they are not formal derivation-equivalence issues. No self-citation chain is used; the external dataset [7] is genuine independent evidence. On balance, the empirical benchmark is self-contained, while the paper's central simulation-generation promise is partially circular by renaming a fitted predictor as a generative simulator.

Assumptions & free parameters 4 free parameters · 5 assumptions · 1 invented entities

The central claim rests on three unpaid assumptions: that concrete porosity data represents sludge-based mixes, that a trained regressor can act as a generative simulator, and that hyperparameter tuning on a single dataset qualifies as transferable meta-learning. The concrete regression itself is benchmarked on a held-out split, which keeps circularity low for that narrow claim, but the broader sludge claim has no empirical grounding. Free parameters include model hyperparameters, the 80/20 split, the target-correlated feature set, and unspecified Bayesian optimization settings.

free parameters (4)
  • Model hyperparameters (GB, XGB, RF, SVM) = Not reported in paper
    Bayesian optimization selected hyperparameters per model (Table 3 search spaces), and final test metrics depend on these choices, but the chosen values are not listed.
  • 80/20 random train-test split = Not reported (no seed)
    All reported MSE, R2, and MAPE values come from one random split of 240 records; no repeated splits or confidence intervals are given.
  • Feature set selected by Pearson correlation with porosity = Eight features listed in Table 1
    Features were chosen based on correlation with the target, and include Strength, a material outcome, making the feature set partially dependent on the target.
  • Bayesian optimization settings = Not reported
    Number of iterations, acquisition function, and initial points are unspecified, so the optimized results in Table 4 are not fully reproducible from the text.
assumptions (5)
  • domain assumption Concrete porosity data is a good proxy for stone-cutting sludge mix design.
    Invoked in Section 4 to justify experiments on concrete instead of sludge; no transfer evidence is given.
  • domain assumption A trained supervised regressor functions as a simulator that can generate a large dataset of material properties.
    Section 3.4 defines the simulator as the best-performing regressor and claims it can estimate porosity without physical tests; this conflates interpolation with generative simulation.
  • ad hoc to paper Bayesian optimization of hyperparameters constitutes meta-learning.
    The paper labels standard BO hyperparameter tuning as meta-learning (Sections 1 and 3.2) but does not train across tasks or cite meta-learning methods.
  • ad hoc to paper Strength can be used as an input feature to predict porosity in a design workflow.
    Table 1 includes 'Strength' among predictors; for mix design, strength is an output that would not be known before the mix is made, so this is a questionable modeling choice for the stated use case.
  • standard math Standard regression and train/test split assumptions.
    The metrics in Table 4 assume i.i.d. samples from the same concrete dataset and an independent held-out split.
invented entities (1)
  • ML-guided simulator
    purpose: Claimed to simulate porosity and generate large datasets of mix designs without physical experiments (Section 3.4).
    The paper presents a trained supervised regressor as a simulator; there is no physical model, no generated dataset, and no validation against new sludge measurements.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Material synthesis through simulations guided by machine learning: a position paper." pith.science (2026). https://pith.science/paper/LEFK3T6I

@misc{pith2026241113953,
  author       = {Pith},
  title        = {Pith review of: Material synthesis through simulations guided by machine learning: a position paper},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LEFK3T6I}},
  note         = {Machine review of arXiv:2411.13953}
}
read the original abstract

In this position paper, we propose an approach for sustainable data collection in the field of optimal mix design for marble sludge reuse. Marble sludge, a calcium-rich residual from stone-cutting processes, can be repurposed by mixing it with various ingredients. However, determining the optimal mix design is challenging due to the variability in sludge composition and the costly, time-consuming nature of experimental data collection. Also, we investigate the possibility of using machine learning models using meta-learning as an optimization tool to estimate the correct quantity of stone-cutting sludge to be used in aggregates to obtain a mix design with specific mechanical properties that can be used successfully in the building industry. Our approach offers two key advantages: (i) through simulations, a large dataset can be generated, saving time and money during the data collection phase, and (ii) Utilizing machine learning models, with performance enhancement through hyper-parameter optimization via meta-learning, to estimate optimal mix designs reducing the need for extensive manual experimentation, lowering costs, minimizing environmental impact, and accelerating the processing of quarry sludge. Our idea promises to streamline the marble sludge reuse process by leveraging collective data and advanced machine learning, promoting sustainability and efficiency in the stonecutting sector.

Figures

Figures reproduced from arXiv: 2411.13953 by the authors.

Figure 1
Figure 1. The stone-cutting sludge problem overview. The stone-cutting processes of marble and similar materials produce some byproducts, such as stone-cutting sludge. These byproducts come with a high cost for the environment and industries. They can be disposed of as waste, leading only to a cost for the industry, or be re-used to create mix-designs. Traditionally, the reuse is subject to trial & error approaches, involving… view at source ↗
Figure 2
Figure 2. The end-to-end workflow of a simulator based on the machine learning model development and deployment process. It is divided into four main phases: Preprocess￾ing, Training, Testing, and Simulation, with the ultimate goal of producing simulations based on material characteristics. The circle represents the data, while the rectangle represents the process. To address these challenges, we employ a specific meta-learni… view at source ↗
Figure 3
Figure 3. The plot shows the performance of different models on training and testing sets, respectively. The x-axis represents the true values, while the y-axis represents the predictions made by the model without meta-learning. The blue points are individual data points, and the red dashed line represents the ideal line where the predictions perfectly match the true values. accuracy. Meanwhile, the RF model maintained strong… view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: The plot displays the best model’s performance, with meta-learning through Bayesian Optimization. These results demonstrate that applying meta-learning through Bayesian op￾timization can effectively tune models for predicting porosity with high accuracy in this scenari…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

23 extracted references · 20 canonical work pages

  1. [1]

    Qubahan Academic Journal1(2), 81–90 (2021)

    Abdullah, D.M., Abdulazeez, A.M.: Machine learning applications based on svm classification a review. Qubahan Academic Journal1(2), 81–90 (2021)

  2. [2]

    The Journal of Solid Waste Technology and Management47(1), 56–60 (2021)

    Al-Zboon, K., Masoud, T.: Recycling of stone cutting waste in the construction sector: A review. The Journal of Solid Waste Technology and Management47(1), 56–60 (2021)

  3. [3]

    International Journal of Environmental Science and Engineering1(4), 167–172 (2009)

    Alzboon, K.K., Mahasneh, K.N.: Effect of using stone cutting waste on the com- pression strength and slump characteristics of concrete. International Journal of Environmental Science and Engineering1(4), 167–172 (2009)

  4. [4]

    Procedia Engineering 00 (2013) 000–000 (2013)

    Bahoria, B., Parbat, D., Nagarnaik, P., Waghe, U.: Effect of replacement of natural sand by quarry dust and waste plastic on compressive & split tensile strength of m20 concrete. Procedia Engineering 00 (2013) 000–000 (2013)

  5. [5]

    In: In- ternational Congress on Engineering and Sustainability in the XXI Century

    Branco, F.G., Ortega, J.M., Marques, L., Pereira, L.: Partial replacement of port- land cement by stone cutting sludge in mortars–hygrometric performance. In: In- ternational Congress on Engineering and Sustainability in the XXI Century. pp. 289–299. Springer (2023)

  6. [6]

    Applied Ocean Research 104, 102339 (2020) Material synthesis through ML-guided simulations 15

    Callens, A., Morichon, D., Abadie, S., Delpey, M., Liquet, B.: Using random forest and gradient boosting trees to improve wave forecast at a specific location. Applied Ocean Research 104, 102339 (2020) Material synthesis through ML-guided simulations 15

  7. [7]

    Results in Engineering 17, 100794 (2023)

    Cao, C.: Prediction of concrete porosity using machine learning. Results in Engineering 17, 100794 (2023). https://doi.org/https://doi.org/10.1016/j. rineng.2022.100794, https://www.sciencedirect.com/science/article/pii/ S2590123022004649

  8. [8]

    Information Sciences 591, 155–175 (2022)

    Du, L., Gao, R., Suganthan, P.N., Wang, D.Z.: Bayesian optimization based dy- namic ensemble for time series forecasting. Information Sciences 591, 155–175 (2022)

Show all 23 references
  1. [9]

    Ginga, C., Ongpeng, J.: materials circular economy on construction and demolition waste:Aliteraturereviewonmaterialrecoveryandproduction.Materials 13(2020)

  2. [10]

    Indian Geotechnical Journal50 (2020)

    Jain, A., Jha, A., , S.: Improvement in subgrade soils with marble dust for highway construction: A comparative study. Indian Geotechnical Journal50 (2020)

  3. [11]

    Construction and Building Materials325, 126607 (2022)

    Liu, J., Liu, F., Zheng, C., Zhou, D., Wang, L.: Optimizing asphalt mix design through predicting effective asphalt content and absorbed asphalt content using machine learning. Construction and Building Materials325, 126607 (2022)

  4. [12]

    Journal of environmental management90(1), 466–470 (2009)

    Nasserdine, K., Mimi, Z., Bevan, B., Elian, B.: Environmental management of the stone cutting industry. Journal of environmental management90(1), 466–470 (2009)

  5. [13]

    Minerals13 (2023)

    Segui, P., Safhi, A., Amrani, M., Benzaazoua, M.: Mining wastes as road construc- tion material: A review. Minerals13 (2023)

  6. [14]

    Proceedings of the IEEE 104(1), 148–175 (2015)

    Shahriari, B., Swersky, K., Wang, Z., Adams, R.P., De Freitas, N.: Taking the human out of the loop: A review of bayesian optimization. Proceedings of the IEEE 104(1), 148–175 (2015)

  7. [15]

    Buildings13(7), 1856 (2023)

    Silva, L.S., Amario, M., Stolz, C.M., Figueiredo, K.V., Haddad, A.N.: A com- prehensive review of stone dust in concrete: Mechanical behavior, durability, and environmental performance. Buildings13(7), 1856 (2023)

  8. [16]

    Environmental Earth Sciences67 (2011)

    Song, Y.S., Kim, M.I., Woo, K.s.: Stability of embankments constructed from soil mixed with stone dust in quarry reclamation. Environmental Earth Sciences67 (2011)

  9. [17]

    Journal of environmental management231, 86–97 (2019)

    Tunc, E.T.: Recycling of marble waste: A review based on strength of concrete containing marble waste. Journal of environmental management231, 86–97 (2019)

  10. [18]

    MATEC Web of Conferences331, 1–7 (2020)

    Turuallo, G., Mallisa, H., Rupang, N.: Sustainable development: Using stone dust to replace a part of sand in concrete mixture. MATEC Web of Conferences331, 1–7 (2020)

  11. [19]

    Open Geosciences 12, 1247–1262 (2020)

    Ural, N., Yakşe, G.: Utilization of marble piece wastes as base materials. Open Geosciences 12, 1247–1262 (2020)

  12. [20]

    Neurocomputing415, 295–316 (2020)

    Yang, L., Shami, A.: On hyperparameter optimization of machine learning algo- rithms: Theory and practice. Neurocomputing415, 295–316 (2020)

  13. [21]

    arXiv preprint arXiv:2003.05689 (2020)

    Yu, T., Zhu, H.: Hyper-parameter optimization: A review of algorithms and appli- cations. arXiv preprint arXiv:2003.05689 (2020)

  14. [22]

    Materials Proceedings 5(1), 57 (2021)

    Zichella, L., Bellopede, R., Marini, P.: Ornamental stone cutting processing and sludge production evaluation with the goal of ending waste. Materials Proceedings 5(1), 57 (2021)

  15. [23]

    Journal of cleaner production 178, 866–876 (2018)

    Zichella, L., Bellopede, R., Spriano, S., Marini, P.: Preliminary investigations on stone cutting sludge processing for a future recovery. Journal of cleaner production 178, 866–876 (2018)

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.