REVIEW 4 major objections 4 minor 32 references
Multimodal deep learning framework to predict strain localization of Mg/LPSO two-phase alloys
T0 review · 4 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read A multimodal deep learning model that combines phase volume fractions, persistence diagrams, and two-point spatial correlations predicts local compressive strain in as-cast Mg/LPSO alloys more accurately than any single descriptor, and…
desk verdict Useful data-rich application with a load-bearing evaluation flaw: the RVE overlap and test-set-based model selection make the reported accuracy gains unverifiable. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the multimodal deep learning architecture that combines a fully connected branch for the four numerical volume fractions with two convolutional branches for image-type descriptors: one for the persistence diagrams of the α-Mg and LPSO phases and one for the zx- and yz-plane two-point spatial correlations. The image features are concatenated into a single vector and passed through fully connected layers to regress the equivalent strain. The paper also introduces a fine-tuning step in which the feature-extraction layers are initialized from models trained on each descriptor individually, which it reports is needed to prevent the network from ignoring some input modalities. What this machinery does is to let the model jointly use connectivity (persistence), orientation (spatial correlation), and composition (volume fraction) information, and the authors argue this integration is what produces the higher accuracy.
What would settle it
Retrain the same model with a spatial split that assigns entire contiguous regions of the sample to training or test sets, so overlapping RVEs never straddle the split, and compare the multimodal model's test accuracy against each single-descriptor model; if the multimodal advantage shrinks to within the noise of the single-descriptor models, the reported superiority is an artifact of data leakage. A second check is to apply the trained model to a separately imaged and compressed specimen of the same alloy and see whether the accuracy and the 45-degree LPSO feature-importance pattern reproduce.
Extended reading notes
Core claim
The central claim is that fusing the three descriptor types — numerical volume fractions, persistence diagrams (topological summaries of phase connectivity), and two-point spatial correlations (directional statistics of phase arrangement) — in a single neural network yields a materially better prediction of local equivalent strain than any one descriptor alone. The paper further claims that both correlation analysis and occlusion sensitivity analysis converge on the same physical picture: strain localization in as-cast Mg/LPSO alloys occurs preferentially where the LPSO phase exhibits a large elongated morphology oriented roughly 45 degrees to the compression axis, a geometry that maximizes the Schmid factor for basal slip. The authors interpret this as consistent with prior surface-based observations and use it to argue that the method captures mechanistically meaningful microstructure–deformation relationships, not just statistical correlations.
Load-bearing premise
The evaluation assumes that every strain measurement point contributes independent information, so an 8:2 random split into training and test sets measures true generalization; in reality the 101-voxel cubes centered at points spaced 20 voxels apart overlap heavily, so neighboring training and test samples share nearly identical microstructures.
Editorial extensions
If this is right
- If the claim holds, local strain hotspots in Mg/LPSO alloys can be predicted from a single 3D microstructure image without running deformation simulations.
- The multimodal fusion scheme provides a template for combining numerical and image-type microstructural descriptors in other two-phase and multiphase materials.
- The identified 45-degree elongated LPSO morphology becomes a quantifiable microstructure metric that alloy designers can target to suppress strain localization.
- Feature-importance maps from occlusion sensitivity can complement or replace linear persistence-diagram regression methods for complex tasks.
- The method suggests that DVC-measured strain fields can serve as training labels for microstructure–mechanics links at the mesoscale.
Reading between the lines
- The paper's 8:2 random split likely overstates the method's generalization because overlapping RVEs share microstructure information; a spatially separated split is a direct, low-cost test of whether the multimodal advantage survives.
- The 45-degree orientation rule, if mechanistically confirmed, implies that the same descriptor pipeline could detect incipient kink-band or shear-band formation before visible damage, making it a candidate in-situ monitoring tool.
- The architecture is descriptor-agnostic: replacing persistence diagrams with, for example, 3D crystallographic orientation data from EBSD could extend the same fusion logic to textured materials.
- A quantitative claim implicit in the paper is that strain localization is predictable from a 101-voxel neighborhood; whether even smaller or larger neighborhoods change the accuracy is an open testable question.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a multimodal deep learning framework that predicts the three-dimensional local equivalent strain distribution in as-cast Mg/LPSO two-phase alloys from X-ray CT-based microstructure information. Around each DVC strain measurement point, a 101-voxel cubic RVE is extracted, and three microstructure descriptors are computed: phase volume fractions (numerical), zero-order persistence diagrams for the α-Mg and LPSO phases (image-like), and two-point spatial correlations in the zx and yz planes (image-like). A multimodal network combining FCNNs and CNNs is trained to regress local strain, and its accuracy is compared against single-descriptor baselines. Feature importance is assessed via correlation analysis and occlusion sensitivity analysis, leading to the conclusion that high strain is associated with large elongated LPSO regions oriented near 45° to the loading direction. The paper reports that the multimodal model achieves significantly higher accuracy than any single descriptor and that the feature-importance findings are consistent with prior experimental studies.
Significance. If the quantitative claims were secure, the paper would provide a useful methodological contribution: a reusable pipeline linking 3D microstructure descriptors to measured local strain fields, with a physically plausible and externally consistent interpretation of the 45°-oriented LPSO phase as a strain-localization driver. The availability of the X-ray CT images, segmentation results, DVC results, and Python code (data availability statement) is a notable strength that enables verification and reuse. However, the central quantitative claim — that the multimodal model predicts local strain with significantly higher accuracy than single descriptors — is currently not credible because of the evaluation protocol. The qualitative feature-importance findings are less affected by the split issue, since they are descriptive over the full dataset and corroborated by prior literature. For these reasons, the paper's significance rests on whether the evaluation can be redone properly; the underlying data and code make such a reanalysis feasible.
major comments (4)
- [§2.3 and §2.4] The evaluation protocol suffers from spatial data leakage. Section 2.3 states that each RVE is a 101-voxel cube centered at measurement points spaced 20 voxels apart; adjacent RVEs therefore overlap by 81 voxels in each dimension and share roughly half their volume. The random 8:2 split described in Section 2.4 (2074 training / 518 test points) places heavily overlapping, near-duplicate RVEs in both sets. Under these conditions, the model can effectively interpolate local strain from overlapping neighborhoods rather than generalize to unseen microstructures, and all reported accuracy metrics in Fig. 6 are optimistically biased. I request a spatially separated split, for example contiguous-block cross-validation or a split by macroscopic specimen region, with the results re-reported for Fig. 6 and the associated RMSE, MAE, and R² values.
- [§2.4] Test-set-based model selection is a procedural error. The sentence 'The network parameters that minimized the loss on the test set were used for subsequent analyses' means the test set was used as a validation set during parameter selection, so the reported test accuracy is not an unbiased estimate of generalization. The authors should partition the data into training, validation, and test sets; select hyperparameters and stopping criteria on the validation set; and evaluate the final model on the test set exactly once. This is essential regardless of the spatial split issue.
- [§3.2, Fig. 6] Because of the two issues above, the claim that the multimodal model achieves 'significantly higher accuracy' than the best single-descriptor model is not supported. The word 'significantly' is not accompanied by any statistical test, and the ranking of descriptors could change under a proper, spatially separated split. I request a statistically sound comparison — for example, confidence intervals from repeated cross-validation with spatial block splits, or at least a paired test on non-overlapping test regions — and a statement of the effect size and its uncertainty.
- [§3.3.1, Fig. 9] The RVE-size dependence analysis in Fig. 9 also uses RVEs centered at the same 20-voxel-spaced grid, so the overlapping-RVE autocorrelation is present there as well. The plateau of the correlation coefficient at an RVE side length of 101 voxels may partly reflect spatial smoothing of the underlying strain field rather than a true microstructural scale. While this does not affect the qualitative conclusion, the interpretation of Fig. 9 should be softened or the analysis should be repeated for non-overlapping RVEs.
minor comments (4)
- [§2.4 and §2.5] The manuscript states in §2.4 that there are 518 test data points but in §2.5 says the occlusion sensitivity analysis was performed on each of the 512 test data. Please reconcile this inconsistency.
- [Abstract and §1] The phrase 'two types of descriptors' is confusing because the paper uses three descriptor families (volume fractions, persistence diagrams, two-point spatial correlations) in two data formats (numerical and image). Please revise to 'three microstructure descriptors in two data formats' or similar.
- [§2.4] The statement that training was conducted over 100 epochs 'ensuring convergence' appears to conflict with the later sentence about selecting the parameters that minimize loss on the test set. Please clarify whether early stopping was used and, if so, on which data split the stopping criterion was evaluated.
- [§3.2] In Fig. 6, the accuracy indices (RMSE, MAE, R²) are reported without error bars or uncertainties. If a proper cross-validation is performed, please include the variability across folds.
Circularity Check
No circularity: supervised regression predicts strain from independently measured descriptors; reported accuracy issues are statistical leakage, not derivation-by-construction.
full rationale
The paper's derivation chain is an empirical supervised-learning pipeline: volume fractions, persistence diagrams, and two-point correlations are extracted from X-ray CT images, and a deep network is trained to regress DVC equivalent strain. No descriptor is defined in terms of the strain target, and no strain value is fed back to define a descriptor or a fitted constant; hence no prediction is equivalent to an input by construction. The claimed multimodal superiority is a measured comparison on test data, and the 45-degree LPSO finding is supported by the paper's own correlation/occlusion analyses plus external Schmid-factor arguments (Ref. [2]) and prior HR-DIC (Ref. [3]); the latter is a same-group citation but is used only as corroboration, not as the load-bearing premise. The manuscript's use of the test set for model selection and the overlap of adjacent RVEs are real threats to the validity of the reported accuracy numbers, but these are data-leakage/statistical-independence flaws, not structural circularity: even if the evaluation is biased, the model output is not defined as a function of the target. No circular step is exhibited, so the circularity score is 0.
Assumptions & free parameters
free parameters (4)
- RVE side length =
101 voxels (about 68.7 micrometers)
- DVC subset size and step size =
80 voxels subset, 20 voxels step
- Persistence diagram lifetime threshold =
lifetime >= 2
- Fine-tuning initialization weights =
Pretrained single-descriptor model weights
assumptions (4)
- domain assumption The DVC-measured equivalent strain at each point is an accurate representation of the true local deformation.
- domain assumption The 101-voxel RVE contains sufficient microstructure information to determine the local strain at its center.
- domain assumption The single compression test on one as-cast specimen is representative of the alloy class.
- domain assumption Segmentation by Trainable Weka Segmentation correctly classifies the phases.
Cite this review
Pith. "Pith review of Multimodal deep learning framework to predict strain localization of Mg/LPSO two-phase alloys." pith.science (2026). https://pith.science/paper/4EUXOAYZ
@misc{pith2026260808071,
author = {Pith},
title = {Pith review of: Multimodal deep learning framework to predict strain localization of Mg/LPSO two-phase alloys},
year = {2026},
howpublished = {\url{https://pith.science/paper/4EUXOAYZ}},
note = {Machine review of arXiv:2608.08071}
}
read the original abstract
This study proposes a method for predicting three-dimensional (3D) local strain distribution under compressive deformation of as-cast Mg/LPSO two-phase alloys from 3D microstructure images. The 3D local strain distribution was obtained by applying the digital volume correlation method to X-ray CT images before and after compression tests. Three microstructure descriptors were extracted from the 3D microstructure images around each strain measurement point: volume fractions of the phases, persistent diagrams that can express the connectivity of the phases, and two-phase spatial correlation that can express the spatial distribution of the phases. A deep learning model was then constructed to predict local strain from the three microstructure descriptors. Since two types of descriptors were used in this study, numerical data and image data, multimodal deep learning was employed to make predictions. Thus, the use of multiple microstructure descriptors enabled predictions to be made with higher accuracy than when predictions were made from a single descriptor. Feature importance of the descriptors was assessed through correlation analysis and occlusion sensitivity analysis. The results revealed that high strain tended to occur in the region where the hard phase, LPSO phase, had a large elongated phase oriented at a 45{\deg} direction to the loading direction. This result is consistent with other previous studies and indicates that the proposed method is effective in elucidating the relationship between the microstructure and the deformation behavior of the material.
Reference graph
Works this paper leans on
-
[1]
Y. Kawamura, K. Hayashi, A. Inoue, T. Masumoto, Rapidly solidified powder metallurgy Mg97Zn1Y2Alloys with excellent tensile yield strength above 600 MPa, Mater. Trans. 42 (2001) 1172 – 1176, https://doi.org/10.2320/matertrans.42.1172
-
[2]
K. Hagihara, N. Yokotani, Y. Umakoshi, Plastic deformation behavior of Mg12YZn with 18R long-period stacking ordered structure, Intermetallics. (Barking) 18 (2010) 267 – 276, https://doi.org/10.1016/j.intermet.2009.07.014
-
[3]
F. Briffod, Y. Shen, H. Hu, W. Yin, T. Shiraiwa, M. Enoki, Effect of microstructure on the deformation of as-cast α -Mg/LPSO two-phase alloys: An integrated SEM-DIC and crystal plasticity study, Materialia (Oxf) 33 (2024) 102015, https://doi.org/ 10.1016/j.mtla.2024.102015
- [4]
-
[5]
H. Toda, A. Takijiri, M. Azuma, S. Yabu, K. Hayashi, D. Seo, M. Kobayashi, K. Hirayama, A. Takeuchi, K. Uesugi, Damage micromechanisms in dual-phase steel investigated with combined phase- and absorption-contrast tomography, Acta Mater. 126 (2017) 401 – 412, https://doi.org/10.1016/j.actamat.2017.01.010
-
[6]
N. Dahdah, N. Limodin, A. El Bartali, J.F. Witz, R. Seghir, E. Charkaluk, J. Y. Buffiere, Damage investigation in A319 aluminium alloy by x-ray tomography and digital volume correlation during in situ high-temperature fatigue tests, Strain. 52 (4) (2016) 324 – 335, https://doi.org/10.1111/str.12193
-
[7]
Z. Li, N. Limodin, A. Tandjaoui, P. Quaegebeur, J.-F. Witz, D. Balloy, In-situ 3D characterization of tensile damage mechanisms in A319 aluminium alloy using X- ray tomography and digital volume correlation, Mater. Sci. Eng., A 794 (2020) 139920, https://doi.org/10.1016/j.msea.2020.139920
- [8]
Show all 32 references
-
[9]
Y. Gu, C.D. Stiles, J.A. El-Awady, A statistical perspective for predicting the strength of metals: revisiting the hall – Petch relationship using machine learning, Acta Mater. 266 (2024) 119631, https://doi.org/10.1016/j.actamat.2023.119631
2024
-
[10]
H.K. Park, Y. Kim, J. Jung, H.H. Lee, J.M. Park, K. Ameyama, H.S. Kim, Efficient design of harmonic structure using an integrated hetero-deformation induced hardening model and machine learning algorithm, Acta Mater. 244 (2023) 118583, https://doi.org/10.1016/j.actamat.2022.118583
2023
-
[11]
Kimura, I
M. Kimura, I. Obayashi, Y. Takeichi, R. Murao, Y. Hiraoka, Non-empirical identification of trigger sites in heterogeneous processes using persistent homology, Sci. Rep. 8 (1) (2018) 3553, https://doi.org/10.1038/s41598-018- 21867-z
2018 doi
-
[12]
Z.-L. Wang, T. Ogawa, Y. Adachi, Property predictions for dual-phase steels using persistent homology and machine learning, Adv. Theory. Simul. 3 (3) (2020) 1900227, https://doi.org/10.1002/adts.201900227
2020 doi
-
[13]
L. Song, D. Wang, X. Liu, A. Yin, Z. Long, Prediction of mechanical properties of composite materials using multimodal fusion learning, Sens. Actuat. A Phys. 358 (2023) 114433, https://doi.org/10.1016/j.sna.2023.114433
2023
-
[14]
Song, B.A
G.W. Song, B.A. Tama, J. Park, J.Y. Hwang, J. Bang, S.J. Park, S. Lee, Temperature control optimization in a steel-making continuous casting process using a multimodal deep learning approach, Steel. Res. Int. 90 (12) (2019) 1900321, https://doi.org/10.1002/srin.201900321
2019 doi
-
[15]
J. Yang, L. Hazlett, A.K. Landauer, C. Franck, Augmented Lagrangian Digital Volume Correlation (ALDVC), Exp. Mech. 60 (9) (2020) 1205 – 1223, https://doi. org/10.1007/s11340-020-00607-3
2020 doi
-
[16]
Arganda-Carreras, V
I. Arganda-Carreras, V. Kaynig, C. Rueden, K.W. Eliceiri, J. Schindelin, A. Cardona, H.Sebastian Seung, Trainable Weka Segmentation: a machine learning tool for microscopy pixel classification, Bioinformatics. 33 (15) (2017) 2424 – 2426, https://doi.org/10.1093/bioinformatics/btx180
2017 doi
-
[17]
Schindelin, I
J. Schindelin, I. Arganda-Carreras, E. Frise, V. Kaynig, M. Longair, T. Pietzsch, S. Preibisch, C. Rueden, S. Saalfeld, B. Schmid, J.-Y. Tinevez, D.J. White, V. Hartenstein, K. Eliceiri, P. Tomancak, A. Cardona, Fiji: an open-source platform for biological-image analysis, Nat....
2012 doi
-
[18]
Obayashi, T
I. Obayashi, T. Nakamura, Y. Hiraoka, Persistent Homology Analysis for Materials Research and Persistent Homology Software: HomCloud, J. Phys. Soc. Jpn. 91 (9) (2022) 091013, https://doi.org/10.7566/JPSJ.91.091013
2022 doi
-
[19]
Kalidindi, S.R
S.R. Kalidindi, S.R. Niezgoda, A.A. Salem, Microstructure informatics using higher- order statistics and efficient data-mining protocols, JOM 63 (4) (2011) 34 – 41, https://doi.org/10.1007/s11837-011-0057-7 . D. Kuriki et al. Acta Materialia 281 (2024) 120398 10
2011 doi
-
[20]
Cecen, S
A. Cecen, S. Kalidindi, MATLAB Spatial Correlation Toolbox: Release 3.1, Integr. Mater. Manuf. Innov. 5 (1) (2015) 1 – 15, https://doi.org/10.5281/zenodo.31329
2015 doi
-
[21]
Kokhlikyan, V
N. Kokhlikyan, V. Miglani, M. Martin, E. Wang, B. Alsallakh, J. Reynolds, A. Melnikov, N. Kliushkina, C. Araya, S. Yan, O. Reblitz-Richardson, Captum: A unified and generic model interpretability library for PyTorch, 2020, p. arXiv: 2009.07896
2020 arXiv
-
[22]
Shiraishi, T
K. Shiraishi, T. Mayama, M. Yamasaki, Y. Kawamura, Strain-hardening behavior and microstructure development in polycrystalline as-cast Mg-Zn-Y alloys with LPSO phase subjected to cyclic loading, Mater. Sci. Eng., A 672 (2016) 49 – 58, https://doi.org/10.1016/j.msea.2016.06.069
2016 doi
-
[23]
Nicholson, V
K.S. Nicholson, V. Skripnyuk, C. Xu, X. Gao, E. Rabkin, P.D. Hodgson, R. Lapovok, Tailoring LPSO phases in Mg – Y – Zn alloys to govern hydrogenation kinetics, J. Mater. Sci. 58 (20) (2023) 8572 – 8596, https://doi.org/10.1007/s10853-023- 08537-w
2023 doi
-
[24]
L. Wang, N. Limodin, A. El Bartali, J.-F. Witz, R. Seghir, J.-Y. Buffiere, E. Charkaluk, Influence of pores on crack initiation in monotonic tensile and cyclic loadings in lost foam casting A319 alloy by using 3D in-situ analysis, Mater. Sci. Eng., A 673 (2016) 362 – 372, http...
2016 doi
-
[25]
Obayashi, Y
I. Obayashi, Y. Hiraoka, M. Kimura, Persistence diagrams with linear machine learning models, J. Appl. Comput. Topol. 1 (3) (2018) 421 – 449, https://doi.org/ 10.1007/s41468-018-0013-5
2018 doi
-
[26]
J. Li, L. Jin, F. Wang, S. Dong, J. Dong, Effect of phase morphology on microscopic deformation behavior of Mg – Li – Gd dual-phase alloys, Mater. Sci. Eng., A 809 (2021) 140871, https://doi.org/10.1016/j.msea.2021.140871
2021
-
[27]
Zubair, S
M. Zubair, S. Sandl ¨obes-Haut, M.A. Wollenweber, K. Bugelnig, C.F. Kusche, G. Requena, S. Korte-Kerzel, Strain heterogeneity and micro-damage nucleation under tensile stresses in an Mg – 5Al – 3Ca alloy with an intermetallic skeleton, Mater. Sci. Eng., A 767 (2019) 138414, ht...
2019
-
[28]
Shibata, I
A. Shibata, I. Gutierrez-Urrutia, A. Nakamura, G. Miyamoto, Y. Madi, J. Besson, T. Hara, K. Tsuzaki, Multi-scale three-dimensional analysis on local arrestability of intergranular crack in high-strength martensitic steel, Acta Mater. 234 (2022) 118053, https://doi.org/10.1016/...
2022
-
[29]
X. Zeng, C. Liu, C. Zhao, J. Dong, F. Roters, D. Guan, Three-dimensional study of grain scale tensile twinning activity in magnesium: A combination of microstructure characterization and mechanical modeling, Acta Mater. 255 (2023) 119043, https://doi.org/10.1016/j.actamat.2023.119043
2023
-
[30]
L. Li, L. Shen, G. Proust, C.K.S. Moy, G. Ranzi, Three-dimensional crystal plasticity finite element simulation of nanoindentation on aluminium alloy 2024, Mater. Sci. Eng., A 579 (2013) 41 – 49, https://doi.org/10.1016/j.msea.2013.05.009
2013 doi
-
[31]
Zhang, L.-W
C. Zhang, L.-W. Zhang, W.-F. Shen, Y.-N. Xia, Y.-T. Yan, 3D Crystal Plasticity Finite Element Modeling of the Tensile Deformation of Polycrystalline Ferritic Stainless Steel, Acta Metallurgica Sinica (English Letters) 30 (1) (2017) 79 – 88, https://doi. org/10.1007/s40195-016-0488-9
2017 doi
-
[32]
Shiraiwa, F
T. Shiraiwa, F. Briffod, M. Enoki, K. Yamazaki, Inverse analysis of the relationship between three-dimensional microstructures and tensile properties of dual-phase steels, Mater. Today Commun. 33 (2022), https://doi.org/10.1016/j. mtcomm.2022.104958 . D. Kuriki et al. Acta Mat...
2022
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.