Trans-dimensional Hamiltonian model selection and parameter estimation from sparse, noisy data
Pith reviewed 2026-05-19 07:55 UTC · model grok-4.3
The pith
Hybridized MCMC recovers nuclear spin parameters and model dimension from an order of magnitude less data than existing methods.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By hybridizing MCMC sampling for mixed continuous-discrete spaces, reversible-jump MCMC to select model dimension, and parallel tempering to accelerate mixing, the framework recovers informative posterior distributions over physical parameters and model dimension even when data are sparse and noisy, as demonstrated on experimental coherence measurements of nuclear spins surrounding a semiconductor spin defect.
What carries the argument
The hybridized MCMC sampler that uses reversible-jump proposals to move between models of different dimensions while employing parallel tempering to improve exploration of the joint posterior over parameters and model index.
If this is right
- Model dimension and continuous parameters can be inferred jointly rather than by fixing the number of spins in advance.
- Posterior distributions remain informative with roughly ten times fewer measurements than required by existing approaches.
- The same sampler structure applies directly to other nonlinear inverse problems that mix continuous and discrete unknowns under realistic noise.
- Experimental validation confirms that recovered posteriors are consistent with independent measurements on actual quantum devices.
Where Pith is reading between the lines
- High-throughput quantum sensing experiments could characterize many more defects per unit time by reducing the number of coherence measurements needed per device.
- The framework may extend naturally to other data-limited domains such as single-molecule spectroscopy or sparse astrophysical signals where model order is uncertain.
- If the assumed noise model deviates substantially from experiment, the recovered posteriors will broaden or shift even when the true Hamiltonian lies inside the model family.
Load-bearing premise
The true underlying Hamiltonian belongs to the discrete family of models the reversible-jump sampler is allowed to visit, and the noise statistics are known well enough that model mismatch does not dominate the posterior.
What would settle it
Synthetic data generated from a spin configuration outside the allowed model family in which the sampler nevertheless reports high posterior probability on an incorrect model dimension and parameters would show the method fails to produce reliable results.
Figures
read the original abstract
High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and model dimensions are consistent with available data. This ill-posed regime may render traditional machine learning and deterministic methods unreliable or intractable, particularly in high-dimensional, nonlinear, and mixed continuous and discrete parameter spaces. To address these challenges, we present a Bayesian framework that hybridizes several Markov chain Monte Carlo (MCMC) sampling techniques to estimate both parameters and model dimension from sparse, noisy data. By integrating sampling for mixed continuous and discrete parameter spaces, reversible-jump MCMC to estimate model dimension, and parallel tempering to accelerate exploration of complex posteriors, our approach enables principled parameter estimation and model selection in data-limited regimes. We apply our framework to a specific ill-posed problem in quantum information science: recovering the locations and hyperfine couplings of nuclear spins surrounding a spin-defect in a semiconductor from sparse, noisy coherence data. We show that a hybridized MCMC method can recover meaningful posterior distributions over physical parameters using an order of magnitude less data than existing approaches, and we validate our results on experimental measurements. More generally, our work provides a flexible, extensible strategy for solving a broad class of ill-posed inverse problems under realistic experimental constraints.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces a Bayesian framework that hybridizes MCMC sampling techniques—including methods for mixed continuous-discrete spaces, reversible-jump MCMC for trans-dimensional model selection, and parallel tempering—to estimate both physical parameters and model dimension from sparse, noisy data. The method is applied to recovering nuclear-spin locations and hyperfine couplings around a spin defect in a semiconductor from coherence measurements, with the central claim that meaningful posteriors can be recovered using an order of magnitude less data than existing approaches and that results are validated on experimental measurements.
Significance. If the central claims hold, the work provides a general strategy for principled inference in ill-posed inverse problems common to quantum sensing and characterization, where data acquisition is resource-intensive. The hybridization of sampling methods directly targets challenges in high-dimensional, nonlinear spaces with discrete model choices.
major comments (1)
- [Abstract] Abstract: The claim that the hybridized MCMC recovers accurate posteriors with ~10× fewer coherence measurements rests on the unverified assumption that the true nuclear-spin Hamiltonian lies exactly within the discrete family of models over which the reversible-jump sampler can move. No controlled synthetic-data test is described in which the ground-truth Hamiltonian is generated outside this family (or an ablation removing the reversible-jump component), leaving open the possibility that reported performance gains are dominated by model mismatch rather than by the data.
minor comments (1)
- The abstract would benefit from a single sentence clarifying the specific hybridization (e.g., how reversible-jump proposals are combined with parallel tempering) to aid readers unfamiliar with the subfield.
Simulated Author's Rebuttal
We thank the referee for their careful reading of the manuscript and for identifying this important point about the scope of our validation experiments. We address the comment in detail below and are prepared to revise the manuscript accordingly.
read point-by-point responses
-
Referee: [Abstract] Abstract: The claim that the hybridized MCMC recovers accurate posteriors with ~10× fewer coherence measurements rests on the unverified assumption that the true nuclear-spin Hamiltonian lies exactly within the discrete family of models over which the reversible-jump sampler can move. No controlled synthetic-data test is described in which the ground-truth Hamiltonian is generated outside this family (or an ablation removing the reversible-jump component), leaving open the possibility that reported performance gains are dominated by model mismatch rather than by the data.
Authors: We agree that the synthetic-data experiments generate ground-truth Hamiltonians from within the discrete family explored by the reversible-jump sampler. This choice is deliberate: the method is intended for settings in which the true physical model belongs to the considered family (as is the case for the nuclear-spin Hamiltonian around a spin defect), and the trans-dimensional sampler is used to infer the unknown dimension within that family. Existing approaches to which we compare also operate under comparable model assumptions, so the reported reduction in required data is measured under consistent conditions. We acknowledge, however, that an explicit out-of-family mismatch test and an ablation isolating the reversible-jump component would strengthen the claims. We will add a dedicated paragraph in the revised manuscript (likely in Section 4 or a new subsection of the methods) that (i) states the modeling assumption explicitly, (ii) discusses the implications for performance claims, and (iii) presents a limited ablation removing the reversible-jump moves to quantify their contribution. We will also revise the abstract to avoid any implication that the method has been validated under arbitrary model misspecification. revision: yes
Circularity Check
No significant circularity; MCMC framework derives posteriors directly from data without self-referential reduction
full rationale
The paper introduces a hybridized MCMC sampler combining reversible-jump, parallel tempering, and mixed continuous-discrete sampling to compute posteriors over Hamiltonian parameters and model dimension. The reported performance (order-of-magnitude data efficiency) is presented as an empirical outcome of applying this sampler to coherence measurements, with validation on experimental data. No quoted derivation step equates a claimed prediction or first-principles result to a fitted input or self-citation by construction. The method conditions outputs on observed data under stated assumptions about the model family and noise; these assumptions are external to the sampling procedure itself and do not create a closed loop where the result is forced by redefinition or renaming of inputs. The framework remains self-contained against external benchmarks.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Foundation/ArithmeticFromLogic.leanLogicNat recovery and initial Peano algebra unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
hybridizes several Markov chain Monte Carlo (MCMC) sampling techniques... reversible-jump MCMC to estimate model dimension, and parallel tempering
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel (J-cost uniqueness) unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
recovering the locations and hyperfine couplings of nuclear spins... from sparse, noisy coherence data
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Silicon carbide color centers for quantum applications
Stefania Castelletto and Alberto Boretti. Silicon carbide color centers for quantum applications. Journal of Physics: Photonics, 2(2):022001, 2020
work page 2020
-
[2]
Lila VH Rodgers, Lillian B Hughes, Mouzhe Xie, Peter C Maurer, Shimon Kolkowitz, Ania C Bleszynski Jayich, and Nathalie P de Leon. Materials challenges for quantum technologies based on color centers in diamond.MRS Bulletin, 46(7):623–633, 2021
work page 2021
-
[3]
Five-second coherence of a single spin with single-shot readout in silicon carbide
Christopher P Anderson, Elena O Glen, Cyrus Zeledon, Alexandre Bourassa, Yu Jin, Yizhi Zhu, Christian Vorwerk, Alexander L Crook, Hiroshi Abe, Jawad Ul-Hassan, et al. Five-second coherence of a single spin with single-shot readout in silicon carbide. Science advances, 8(5):eabm5912, 2022
work page 2022
-
[4]
Generalized scaling of spin qubit coherence in over 12,000 host materials
Shun Kanai, F Joseph Heremans, Hosung Seo, Gary Wolfowicz, Christopher P Ander- son, Sean E Sullivan, Mykyta Onizhuk, Giulia Galli, David D Awschalom, and Hideo Ohno. Generalized scaling of spin qubit coherence in over 12,000 host materials. Proceedings of the National Academy of Sciences, 119(15):e2121808119, 2022
work page 2022
-
[5]
Alexandre Bourassa, Christopher P Anderson, Kevin C Miao, Mykyta Onizhuk, He Ma, Alexander L Crook, Hiroshi Abe, Jawad Ul-Hassan, Takeshi Ohshima, Nguyen T Son, et al. Entanglement and control of single nuclear spins in isotopi- cally engineered silicon carbide.Nature Materials, 19(12):1319–1325, 2020
work page 2020
-
[6]
CE Bradley, SW de Bone, PFW Möller, S Baier, MJ Degen, SJH Loenen, HP Bartling, M Markham, DJ Twitchen, R Hanson, et al. Robust quantum-network memory based on spin qubits in isotopically engineered diamond.npj Quantum Information, 8(1): 122, 2022
work page 2022
-
[7]
AM Waeber, G Gillard, G Ragunathan, M Hopkinson, P Spencer, DA Ritchie, MS Skolnick, and EA Chekhovich. Pulse control protocols for preserving coherence in dipolar-coupled nuclear spin baths.Nature Communications, 10(1):3157, 2019. 21
work page 2019
-
[8]
Wenzheng Dong, FA Calderon-Vargas, and Sophia E Economou. Precise high-fidelity electron–nuclear spin entangling gates in nv centers via hybrid dynamical decoupling sequences. New Journal of Physics, 22(7):073059, 2020
work page 2020
-
[9]
Julia Cramer, Norbert Kalb, M Adriaan Rol, Bas Hensen, Machiel S Blok, Matthew Markham, Daniel J Twitchen, Ronald Hanson, and Tim H Taminiau. Repeated quan- tum error correction on a continuously encoded qubit by real-time feedback.Nature communications, 7(1):11526, 2016
work page 2016
-
[10]
TH Taminiau, JJT Wagenaar, T Van der Sar, Fedor Jelezko, Viatcheslav V Dobrovit- ski, and R Hanson. Detection and control of individual nuclear spins using a weakly coupled electron spin.Physical review letters, 109(13):137602, 2012
work page 2012
-
[11]
Universal control and error correction in multi-qubit spin registers in diamond
TimHugoTaminiau, JuliaCramer, ToenovanderSar, ViatcheslavVDobrovitski, and Ronald Hanson. Universal control and error correction in multi-qubit spin registers in diamond. Nature nanotechnology, 9(3):171–176, 2014
work page 2014
-
[12]
Jonathan C Marcks, Mykyta Onizhuk, Nazar Delegan, Yu-Xin Wang, Masaya Fukami, Maya Watts, Aashish A Clerk, F Joseph Heremans, Giulia Galli, and David D Awschalom. Guiding diamond spin qubit growth with computational methods.Phys- ical Review Materials, 8(2):026204, 2024
work page 2024
-
[13]
Connor P Horn, Christina Wicker, Antoni Wellisz, Cyrus Zeledon, Pavani Vamsi Kr- ishna Nittala, F Joseph Heremans, David D Awschalom, and Supratik Guha. Con- trolled spalling of 4h silicon carbide with investigated spin coherence for quantum engineering integration.ACS nano, 18(45):31381–31389, 2024
work page 2024
-
[14]
Roadmap on nanoscale magnetic resonance imaging.Nanotechnology, 35(41): 412001, 2024
Raffi Budakian, Amit Finkler, Alexander Eichler, Martino Poggio, Christian L Degen, Sahand Tabatabaei, Inhee Lee, P Chris Hammel, S Polzik Eugene, Tim H Taminiau, et al. Roadmap on nanoscale magnetic resonance imaging.Nanotechnology, 35(41): 412001, 2024
work page 2024
-
[15]
Abdelghani Laraoui, Florian Dolde, Christian Burk, Friedemann Reinhard, Jörg Wrachtrup, and Carlos A Meriles. High-resolution correlation spectroscopy of 13c spins near a nitrogen-vacancy centre in diamond.Nature communications, 4(1):1651, 2013
work page 2013
-
[16]
MH Abobeih, J Randall, CE Bradley, HP Bartling, MA Bakker, MJ Degen, M Markham, DJ Twitchen, and TH Taminiau. Atomic-scale imaging of a 27-nuclear- spin cluster using a quantum sensor.Nature, 576(7787):411–415, 2019
work page 2019
-
[17]
Deep learning enhanced individual nuclear- spin detection
Kyunghoon Jung, MH Abobeih, Jiwon Yun, Gyeonghun Kim, Hyunseok Oh, Ang Henry, TH Taminiau, and Dohun Kim. Deep learning enhanced individual nuclear- spin detection. npj Quantum Information, 7(1):41, 2021
work page 2021
-
[18]
B Varona-Uriarte, C Munuera-Javaloy, E Terradillos, Y Ban, A Alvarez-Gila, E Gar- rote, and J Casanova. Automatic detection of nuclear spins at arbitrary magnetic fields via signal-to-image ai model.Physical Review Letters, 132(15):150801, 2024
work page 2024
-
[19]
Finite-error metrological bounds on multiparameter hamiltonian estimation
Naoto Kura and Masahito Ueda. Finite-error metrological bounds on multiparameter hamiltonian estimation. Physical Review A, 97(1):012101, 2018
work page 2018
-
[20]
Robustandefficienthamiltonian learning
WenjunYu, JinzhaoSun, ZeyaoHan, andXiaoYuan. Robustandefficienthamiltonian learning. Quantum, 7:1045, 2023
work page 2023
-
[21]
Hsin-YuanHuang, YuTong, DiFang, andYuanSu. Learningmany-bodyhamiltonians with heisenberg-limited scaling.Physical Review Letters, 130(20):200403, 2023
work page 2023
-
[22]
Sample-efficient learning of interacting quantum systems.Nature Physics, 17(8): 931–935, 2021
Anurag Anshu, Srinivasan Arunachalam, Tomotaka Kuwahara, and Mehdi Soleiman- ifar. Sample-efficient learning of interacting quantum systems.Nature Physics, 17(8): 931–935, 2021
work page 2021
-
[23]
Reversible jump markov chain monte carlo computation and bayesian model determination
Peter J Green. Reversible jump markov chain monte carlo computation and bayesian model determination. Biometrika, 82(4):711–732, 1995. 22
work page 1995
-
[24]
WD Vousden, Will M Farr, and Ilya Mandel. Dynamic temperature selection for parallel tempering in markov chain monte carlo simulations.Monthly Notices of the Royal Astronomical Society, 455(2):1919–1937, 2016
work page 1919
-
[25]
Bayesian methods for nonlinear classification and regression, volume 386
David GT Denison, Christopher C Holmes, Bani K Mallick, and Adrian FM Smith. Bayesian methods for nonlinear classification and regression, volume 386. John Wiley & Sons, 2002
work page 2002
-
[26]
A first course in monte carlo methods
Daniel Sanz-Alonso and Omar Al-Ghattas. A first course in monte carlo methods. arXiv preprint arXiv:2405.16359, 2024
-
[27]
PeterJGreenandDavidIHastie. Reversiblejumpmcmc. Genetics, 155(3):1391–1403, 2009
work page 2009
-
[28]
Alexandre Toubiana, Michael L Katz, and Jonathan R Gair. Is there an excess of black holes around 20 m? optimizing the complexity of population models with the use of reversible jump mcmc.Monthly Notices of the Royal Astronomical Society, 524 (4):5844–5853, 2023
work page 2023
-
[29]
Michael Zevin, Chris Pankow, Carl L Rodriguez, Laura Sampson, Eve Chase, Vassiliki Kalogera, and Frederic A Rasio. Constraining formation models of binary black holes with gravitational-wave observations.The Astrophysical Journal, 846(1):82, 2017
work page 2017
-
[30]
Dehan Zhu and Richard Gibson. Seismic inversion and uncertainty quantification using transdimensional markov chain monte carlo method.Geophysics, 83(4):R321– R334, 2018
work page 2018
-
[31]
Yongchae Cho, Richard L Gibson Jr, and Dehan Zhu. Quasi 3d transdimensional markov-chain monte carlo for seismic impedance inversion and uncertainty analysis. Interpretation, 6(3):T613–T624, 2018
work page 2018
-
[32]
Jamie R Oaks, Perry L Wood Jr, Cameron D Siler, and Rafe M Brown. Generalizing bayesian phylogenetics to infer shared evolutionary events.Proceedings of the National Academy of Sciences, 119(29):e2121036119, 2022
work page 2022
-
[33]
Mark Pagel and Andrew Meade. Modelling heterotachy in phylogenetic inference by reversible-jump markov chain monte carlo.Philosophical Transactions of the Royal Society B: Biological Sciences, 363(1512):3955–3964, 2008
work page 2008
-
[34]
István Takács and Viktor Ivády. Accurate hyperfine tensors for solid state quantum applications: case of the nv center in diamond.Communications Physics, 7(1):178, 2024
work page 2024
-
[35]
Mapping a 50-spin-qubit network through correlated sensing
GL Van de Stolpe, DP Kwiatkowski, CE Bradley, J Randall, MH Abobeih, SA Bre- itweiser, LC Bassett, M Markham, DJ Twitchen, and TH Taminiau. Mapping a 50-spin-qubit network through correlated sensing. Nature Communications, 15(1): 2006, 2024
work page 2006
-
[36]
Optimal Transport for Seismic Full Waveform Inversion
Bjorn Engquist, Brittany D Froese, and Yunan Yang. Optimal transport for seismic full waveform inversion.arXiv preprint arXiv:1602.01540, 2016
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[37]
Hyunseok Oh, Jiwon Yun, MH Abobeih, Kyung-Hoon Jung, Kiho Kim, TH Taminiau, and Dohun Kim. Algorithmic decomposition for efficient multiple nuclear spin detec- tion in diamond.Scientific Reports, 10(1):14884, 2020
work page 2020
-
[38]
David M Walker, F Javier Pérez-Barbería, and Glenn Marion. Stochastic modelling of ecological processes using hybrid gibbs samplers.ecological modelling, 198(1-2):40–52, 2006
work page 2006
-
[39]
Bayesian adaptive markov chain monte carlo estimation of genetic parameters
Boby Mathew, AM Bauer, Petri Koistinen, TC Reetz, Jens Léon, and MJ3464018 Sil- lanpää. Bayesian adaptive markov chain monte carlo estimation of genetic parameters. Heredity, 109(4):235–245, 2012
work page 2012
-
[40]
Jian Zhang, Jingye Li, Xiaohong Chen, and Yuanqiang Li. Geological structure-guided 23 hybrid mcmc and bayesian linearized inversion methodology.Journal of Petroleum Science and Engineering, 199:108296, 2021
work page 2021
-
[41]
Sebastian Reuschen, Fabian Jobst, and Wolfgang Nowak. Efficient discretization- independent bayesian inversion of high-dimensional multi-gaussian priors using a hy- brid mcmc. Water Resources Research, 57(8):e2021WR030051, 2021
work page 2021
-
[42]
Binh Duong Nguyen, Pavlo Potapenko, Aytekin Demirci, Kishan Govind, Sébastien Bompas, and Stefan Sandfeld. Efficient surrogate models for materials science sim- ulations: Machine learning-based prediction of microstructure properties. Machine learning with applications, 16:100544, 2024
work page 2024
-
[43]
Agrim Babbar, Sriram Ragunathan, Debirupa Mitra, Arnab Dutta, and Tarak K Patra. Explainability and extrapolation of machine learning models for predicting the glass transition temperature of polymers. Journal of Polymer Science, 62(6): 1175–1186, 2024
work page 2024
-
[44]
Chandramouli Nyshadham, Matthias Rupp, Brayden Bekker, Alexander V Shapeev, Tim Mueller, Conrad W Rosenbrock, Gábor Csányi, David W Wingate, and Gus LW Hart. Machine-learned multi-system surrogate models for materials prediction.npj Computational Materials, 5(1):51, 2019
work page 2019
-
[45]
Marc Verriere, Nicolas Schunck, Irene Kim, Petar Marević, Kevin Quinlan, Michelle N Ngo, David Regnier, and Raphael David Lasseri. Building surrogate models of nuclear density functional theory with gaussian processes and autoencoders. Frontiers in Physics, 10:1028370, 2022
work page 2022
-
[46]
Machine-learning-accelerated dft conformal sampling of catalytic pro- cesses
ThantipRoongcharoen, GiorgioConter, LucaSementa, GiacomoMelani, andAlessan- dro Fortunelli. Machine-learning-accelerated dft conformal sampling of catalytic pro- cesses. Journal of Chemical Theory and Computation, 20(21):9580–9591, 2024
work page 2024
-
[47]
Solving the electronic structure problem with machine learning
Anand Chandrasekaran, Deepak Kamal, Rohit Batra, Chiho Kim, Lihua Chen, and Rampi Ramprasad. Solving the electronic structure problem with machine learning. npj Computational Materials, 5(1):22, 2019
work page 2019
-
[48]
Merlise A Clyde, Joyee Ghosh, and Michael L Littman. Bayesian adaptive sampling for variable selection and model averaging.Journal of Computational and Graphical Statistics, 20(1):80–101, 2011
work page 2011
-
[49]
Morgan & Claypool Publishers, 2010
Giovanni Seni and John Elder.Ensemble methods in data mining: improving accuracy through combining predictions. Morgan & Claypool Publishers, 2010
work page 2010
-
[50]
Bagging, boosting and ensemble methods
Peter Bühlmann. Bagging, boosting and ensemble methods. InHandbook of compu- tational statistics: Concepts and methods, pages 985–1022. Springer, 2011
work page 2011
-
[51]
Stabilizing black-box model selection with the inflated argmax.arXiv preprint arXiv:2410.18268, 2024
Melissa Adrian, Jake A Soloff, and Rebecca Willett. Stabilizing black-box model selection with the inflated argmax.arXiv preprint arXiv:2410.18268, 2024
-
[52]
A Dréau, J-R Maze, M Lesik, J-F Roch, and V Jacques. High-resolution spectroscopy of single nv defects coupled with nearby 13 c nuclear spins in diamond. Physical Review B—Condensed Matter and Materials Physics, 85(13):134107, 2012. 24 A Hyperparameter dependence Figure 6: Error trajectories of 5 ensembles as a function of walker steps for varyingσ2. The ...
work page 2012
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.