{"id":"e81fcf00-ff0a-4d40-95fd-33b1d2b65545","arxiv_id":"2512.05568","paper_version":3,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"A 6,750-site screening with three universal machine-learning potentials maps C/N/O/H interstitial energetics in Ti-23Nb-0.7Ta-2Zr, finding Ti stabilizes and Nb destabilizes interstitials, with SevenNet-0 failing on H site preference.","lead":"Researchers used three general-purpose machine-learning interatomic potentials to map where carbon, nitrogen, oxygen, and hydrogen sit in a titanium-niobium gum metal alloy, screening 6,750 sites quickly. The results show titanium-rich neighborhoods attract interstitials while niobium repels them, and one of the three potentials gets hydrogen's preferred site wrong.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Missing DFT validation for H (and C/N) undermines the central claim of uMLIP transferability; abstract asserts H DFT confirmation absent from main text.","rationale":"The reader's weakest assumption correctly identifies the lack of DFT validation for C, N, and H. My stress-test focuses on the more specific and severe inconsistency: the abstract explicitly claims DFT confirmation of H's tetrahedral preference, yet this data is absent from the main text and supplementary. This is a direct mismatch that affects the paper's credibility and the central conclusion about SevenNet-0. The O-only benchmark is a positive step but insufficient to support the generalized fidelity claim across all four interstitial species. The concern is addressable by adding the missing H DFT benchmark (and ideally C/N), so the appropriate verdict remains CONDITIONAL, matching the reader's assessment. No change to the verdict is needed; the concern reinforces it.","tokens_in":10463,"tokens_out":5422,"duration_ms":53807,"concrete_test":"Perform six fully DFT-relaxed H interstitial calculations (VASP, same settings as §2.2) for configurations spanning the uMLIP energy range—including both tetrahedral and octahedral starting sites—and compare the relative energies and relaxed geometries against MACE-MATPES-PBE-0, Orb-v3, and SevenNet-0. If the DFT results confirm the H tetrahedral preference and the uMLIP ordering, the abstract's claim and the SevenNet-0 limitation are substantiated; if not, the paper's central generalization is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central claim is that three uMLIPs can reliably map interstitial energetics for C, N, O, and H in Ti-23Nb-0.7Ta-2Zr without system-specific training (§4.3). The only direct DFT benchmark, however, is six O configurations (§3.3). No DFT checks for C or N appear in the main text or supplementary, and the H DFT validation asserted in the abstract ('DFT validation confirms that tetrahedral configurations are energetically more favorable than octahedral sites for H interstitials') is never presented. The H site preference is central to the paper's conclusion that SevenNet-0 is a limited model (§3.1, §4.1), and the 'reasonably well' fidelity stated in §4.3 is generalized to all four elements. If the uMLIPs systematically mis-rank C/N/H sites, the chemical trends (Ti stabilization, Nb destabilization) and the SevenNet-0 critique would not be supported by the data shown. The abstract's H DFT claim either needs to be in the paper or removed.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper applies three universal machine-learning interatomic potentials (MACE-MATPES-PBE-0, Orb-v3, SevenNet-0) to relax and score 6,750 octahedral and tetrahedral interstitial configurations (C, N, O, H) in three 250-atom SQS representations of the Ti-23Nb-0.7Ta-2Zr gum-metal base alloy. It reports broad energy distributions, site-preference differences between models (C/N/O in octahedral sites; H in tetrahedral sites for MACE and Orb, but octahedral for SevenNet-0), and Pearson correlations showing Ti-rich coordination is stabilizing while close Nb is destabilizing, with negligible Zr/Ta influence. A DFT benchmark of six O configurations is used to support the claim that the uMLIPs capture the energetic ordering without system-specific training. The paper also introduces an open-source GUI, uMLIP-Interactive, for running uMLIP calculations.","tokens_in":10678,"tokens_out":6070,"duration_ms":65990,"significance":"If the uMLIP energies are faithful proxies for DFT across the four interstitial species, the study would provide a statistically broad and computationally efficient map of interstitial energetics in a relevant gum-metal alloy, with potential guidance for alloy design. The paper's strengths include systematic sampling of thousands of configurations, use of three independent universal potentials, public release of scripts and the GUI, and an explicit (though narrow) DFT benchmark. However, the empirical support is considerably narrower than the central claim: the only direct DFT validation covers six O configurations, no DFT checks for C, N, or H appear, and the abstract's assertion that DFT confirms H's tetrahedral preference is not present in the main text. The 'statistically significant' language for the Zr/Ta null result is also unsupported by significance testing. These gaps are load-bearing because the paper's main conclusion is uMLIP transferability across chemically distinct interstitial environments.","major_comments":[{"comment":"The abstract claims that 'DFT validation confirms that tetrahedral configurations are energetically more favorable than octahedral sites for H interstitials,' but no H DFT calculation is reported in the main text or supplementary information. The only DFT validation in §3.3 is for six O configurations. Since the H site preference is central to the paper's assessment of SevenNet-0 (§3.1, §4.1), this claim must be substantiated with DFT data or removed/qualified. As written, the abstract overstates the evidence.","section":"Abstract; §3.3; §4.1"},{"comment":"The conclusion that 'uMLIPs can capture the energetic hierarchy of interstitials in the Ti-23Nb-0.7Ta-2Zr alloy reasonably well' is generalized to C, N, O, and H, but the only direct DFT benchmark is six O configurations. No DFT validation for C, N, or H is presented. Because transferability across interstitial species is precisely the load-bearing claim, the authors should either add DFT benchmarks for at least H (and ideally C and N) or restrict the fidelity conclusion to O, presenting the other elements' trends as model predictions requiring further validation.","section":"§4.3; §3.3"},{"comment":"The statement that Zr and Ta show 'no statistically significant influence' is not supported by any significance test. The manuscript uses a heuristic threshold |r| ≤ 0.1 for 'negligible' correlations and does not report p-values or confidence intervals. With n = 6750, even very small correlations can be statistically significant. Please report significance measures or rephrase the claim to describe effect magnitude rather than statistical significance.","section":"§3.2"},{"comment":"The Pearson correlation analysis is performed on 'total energies' of interstitial configurations. If these are raw total energies from different SQS supercells, each of the three SQSs contributes a different defect-free reference energy, and correlations pooled across SQSs would mix host-lattice energies with interstitial formation energies. The manuscript does not state whether per-SQS reference energies were subtracted. Please clarify and, if needed, recompute the correlations using formation energies referenced to the defect-free SQS.","section":"§3.1–§3.2"}],"minor_comments":[{"comment":"The definition of 'nearest-neighbor (NN) count of each host element (within 0.1 Å distance tolerance)' is ambiguous. Please specify whether the neighbor shell is defined relative to the minimum distance per configuration and justify the 0.1 Å tolerance.","section":"§2.1/§3.2"},{"comment":"The six O configurations are described as 'randomly selected' but also as 'spanning the full energetic range predicted by Orb-v3.' A random draw would not generally span a range; please describe the actual selection protocol.","section":"§3.3"},{"comment":"Typo: 'user-friedly' should be 'user-friendly'.","section":"§1"},{"comment":"The phrase 'more than a factor of over 1400' is redundant. Use '>1400×' or 'more than a factor of 1400'.","section":"§4.3"},{"comment":"The DFT benchmark uses the PBE functional, which is the same functional underlying MACE-MATPES-PBE-0. The agreement for O is therefore partly a consistency check; this should be acknowledged when describing the validation as independent.","section":"§3.3/§4.3"},{"comment":"The manuscript describes the statistics as 'converged,' but no convergence analysis with respect to the number of SQSs or configurations is provided. A subset analysis would strengthen this claim.","section":"§4.3"}],"recommendation":"major_revision","confidential_remarks":"The decisive issue is the mismatch between the abstract's claim of DFT-validated H site preference and the absence of any H DFT calculation in the manuscript. The existing DFT benchmark covers only O. This is fixable—either by adding the H (and ideally C/N) DFT benchmarks or by strictly limiting the fidelity claims to O and framing the other trends as uMLIP predictions. The GUI contribution, while useful, is somewhat tangential to the scientific core and might be better presented as a software note or separated from the alloys study. If the authors can address the validation gap and the statistical overreach, the manuscript could be suitable for publication."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Worth a look if you care about uMLIP benchmarking or interstitial screening in complex alloys. The paper does something genuinely useful: 6,750 interstitial configurations in three 250-atom SQSs, evaluated with three uMLIPs for C, N, O, and H. The consistent octahedral/tetrahedral site preferences for MACE and Orb, and the SevenNet-0 H anomaly, are cleanly demonstrated. The Ti-stabilization/Nb-destabilization trends are chemically plausible and line up with earlier M/HEA work, which gives me some confidence they are not just artifacts.\n\nWhat the paper does well: full workflow is reproducible — scripts and the uMLIP-Interactive GUI are on GitHub. The DFT check on six O configurations, despite small inversions in the higher-energy range, does support the energetic ordering for O. The speed comparison (under a minute on a 4090 vs. up to 24 h for DFT) is credible and important for accessibility.\n\nThe soft spots are real but addressable. The abstract claims \"DFT validation confirms that tetrahedral configurations are energetically more favorable than octahedral sites for H interstitials,\" but no H DFT calculation appears in the main text or supplementary. That matters because the SevenNet-0 critique rests on the H site preference. Either show the calculation or remove the claim. Likewise, there are no DFT checks for C or N, so generalizing \"uMLIPs capture the energetic hierarchy\" to all four elements is under-supported. The six O benchmark is useful, but since MACE-MATPES-PBE-0 and the DFT both use PBE, it is partly a consistency check rather than a fully independent test. The Pearson correlation thresholds are arbitrary, the coefficients lack uncertainty bounds, and \"statistically converged\" is asserted without a convergence analysis of SQS/site sampling.\n\nNone of these are fatal. The central argument holds for O, and the cross-model agreement on chemical trends is encouraging. But the paper’s own general conclusion goes beyond the evidence shown. I’d send this to peer review, not desk reject it, and ask for the missing H DFT data, raw energies, and some uncertainty or convergence analysis. That is a major revision, not a rejection.\n\nFor a reading group, it is a decent example of how to do uMLIP screening carefully — and how not to overclaim in the abstract. I would probably cite it if I were working on interstitial uMLIP evaluations, mostly for the dataset and the model comparison.","headline":"Useful large-scale uMLIP comparison for interstitial energetics in a gum metal alloy, but the missing H DFT validation weakens the central transferability claim.","tokens_in":11218,"tokens_out":1757,"would_cite":true,"duration_ms":21878,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Universal machine-learning potentials, used without retraining, can map the energy of carbon, nitrogen, oxygen, and hydrogen at thousands of interstitial sites in a titanium-niobium gum-metal alloy, revealing that titanium-rich surroundings","keywords":["universal machine-learning interatomic potentials","interstitial energetics","gum metal alloy","Ti-Nb-Ta-Zr","special quasirandom structures","hydrogen site preference","defect chemistry","DFT validation"],"falsifier":"Take the same three 250-atom SQS supercells and relax a stratified sample of C, N, and H interstitial configurations spanning the energy range each uMLIP predicts (about ten per element), using DFT with the paper's settings; compare the DFT energetic ordering and final site (octahedral vs tetrahedral) to the uMLIP results. If DFT reverses the relative energies of multiple configurations, or puts H in tetrahedral sites for SevenNet-0's octahedral minima, the paper's transferability thesis and its hydrogen-specific limitation claim would not survive.","tokens_in":10340,"feed_emoji":"⚛️","tokens_out":8203,"duration_ms":81053,"temperature":0.7,"pith_summary":"The paper sets out to show that three off-the-shelf, universally pretrained machine-learning interatomic potentials can stand in for DFT when mapping the energetics of light interstitial atoms (C, N, O, H) in a disordered Ti-23Nb-0.7Ta-2Zr gum-metal alloy. Using those potentials to relax and score 6,750 interstitial configurations in three 250-atom special quasirandom structures, it identifies two dominant chemical rules: the more titanium neighbors an interstitial has, the lower its energy, and the closer niobium sits, the higher its energy; tantalum and zirconium show no statistically significant effect. It also finds that the body-centered cubic lattice's geometric preferences survive chemical disorder—C, N, and O settle into octahedral sites while H prefers tetrahedral sites—for two of the three potentials, with the third (SevenNet-0) placing H in octahedral coordination, which the authors treat as a model limitation. If these findings hold, defect-energetics surveys that were previously too expensive for first-principles methods become routine, giving alloy designers a practical screening rule for interstitial behavior. The direct DFT check reported in the main text is limited to six oxygen configurations; broader claims about C, N, and H rest on the transferability of the universal potentials.","feed_headline":"6,750 alloy sites: Ti attracts interstitials, Nb repels them","feed_subtitle":"Pretrained atomic potentials reproduce C, N, O, and H energy rankings in a titanium-niobium alloy thousands of times faster than DFT.","key_machinery":"The central objects are three universal machine-learning interatomic potentials (uMLIPs): pretrained neural-network models that output energies and forces for arbitrary atomic configurations without being fitted to this alloy. They replace DFT in the workflow, relaxing every candidate interstitial site and assigning it an energy. The statistical engine is a two-descriptor correlation analysis—each interstitial is characterized by the nearest-neighbor count of each host element and the minimum distance to each species—and Pearson correlation coefficients translate those descriptors into the paper's chemical-trend claims. A small DFT benchmark on six oxygen configurations serves as the calibra","core_discovery":"On its own terms, the discovery is that a suite of universal machine-learning potentials—MACE-MATPES-PBE-0, Orb-v3, and SevenNet-0—can, without system-specific training, reproduce the energetic hierarchy among interstitial configurations in a chemically disordered bcc alloy. Across 6,750 relaxed configurations, every potential predicts a wide energy spread of roughly 1–3 eV that tracks local chemistry: increasing Ti nearest-neighbor count lowers energy, decreasing Nb–interstitial distance raises it, and Zr and Ta are statistically invisible. Two of the potentials (MACE and Orb-v3) preserve the known bcc site preferences, relaxing C, N, and O into octahedral positions and H into tetrahedral p","pith_inferences":["The paper only benchmarks DFT against O configurations; a natural next calculation is a DFT set of C, N, and H configurations spanning each model's full energy range, which would put the universal-transferability claim on much firmer ground.","The Ti-attracts / Nb-repels rule, if confirmed by broader DFT, suggests an alloy-design lever: local composition fluctuations or phase separation into Ti-rich and Nb-rich regions should redistribute interstitials spatially, potentially controlling oxygen strengthening or hydrogen embrittlement in gum-metal components.","The SevenNet-0 hydrogen discrepancy points toward an element-specific blind-spot pattern in universal potentials: a cheap pre-screening check would be to compare a foundation model's predicted site preference against known bcc crystal chemistry, which would have caught the H error without any DFT.","The statistical protocol itself—three independent SQS cells, 2,250 interstitial sites per element per potential—could serve as a reusable benchmark for evaluating future universal potentials, exposing both energy distributions and site-preference errors more sharply than single-configuration tests."],"forward_implications":["Interstitial design in gum-metal-type alloys can be guided by local chemistry: enriching the matrix in Ti should lower the energy of dissolved C, N, O, and H, while Nb-rich regions should repel them.","The persistence of bcc site preferences across chemical disorder means C, N, and O can be assumed to sit in octahedral sites and H in tetrahedral sites in this alloy class, simplifying thermodynamic and diffusion models.","uMLIP-relaxed geometries are good starting structures for DFT, reducing subsequent quantum-mechanical relaxation times from many hours to routine runs, making validation of large configurational sets affordable.","The same workflow is directly portable to other multicomponent alloys and other point defects, making thousand-configuration statistical surveys of defect energetics feasible without HPC access.","Cross-model agreement can serve as a built-in quality filter: when two independently trained universal potentials agree on a trend, confidence is higher; when they disagree (as with SevenNet-0 and H), targeted DFT validation is indicated."],"fun_headline_variants":["Universal ML potentials decode interstitial chemistry in gum metal alloy","Ti stabilizes, Nb destabilizes: ML maps interstitial energetics","Pretrained potentials match DFT on 6,750 interstitial sites in TiNb alloy","ML speeds up interstitial energy mapping in Ti alloy by orders","One ML model misses H site preference in Ti-Nb-Ta-Zr alloy"],"cache_read_input_tokens":2304,"weakest_assumption_plain":"The load-bearing premise is that the three pretrained universal potentials, never trained on this alloy or its interstitial solutes, produce a faithful energy ranking for C, N, O, and H in this disordered alloy; the only direct first-principles check in the main text covers six oxygen configurations, so if any potential mis-ranks C, N, or H sites—or if the unreported H-DFT result contradicts the abstract—the chemical trends and the SevenNet-0 limitation claim would be unsuppo","fun_headline_variants_meta":{"raw":{"variants":["Universal ML potentials decode interstitial chemistry in gum metal alloy","Ti stabilizes, Nb destabilizes: ML maps interstitial energetics","Pretrained potentials match DFT on 6,750 interstitial sites in TiNb alloy","ML speeds up interstitial energy mapping in Ti alloy by orders","One ML model misses H site preference in Ti-Nb-Ta-Zr alloy"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000907,"raw_usage":{"total_tokens":3821,"prompt_tokens":915,"completion_tokens":2906,"prompt_tokens_details":{"cached_tokens":256},"prompt_cache_hit_tokens":256,"prompt_cache_miss_tokens":659,"completion_tokens_details":{"reasoning_tokens":2814}},"tokens_in":659,"tokens_out":2906,"duration_ms":20467,"temperature":1.0,"reasoning_tokens":2814,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-03T18:19:58.209955+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Take the same three 250-atom SQS supercells and relax a stratified sample of C, N, and H interstitial configurations spanning the energy range each uMLIP predicts (about ten per element), using DFT with the paper's settings; compare the DFT energetic ordering and final site (octahedral vs tetrahedral) to the uMLIP results. If DFT reverses the relative energies of multiple configurations, or puts H in tetrahedral sites for SevenNet-0's octahedral minima, the paper's transferability thesis and its hydrogen-specific limitation claim would not survive.","supporting_citations":[],"review_version":1}