REVIEW 2 major objections 5 minor 36 references
Mixing nanodot sizes stabilizes thermally driven magnetic reservoirs so they keep working across everyday temperature swings.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-15 02:56 UTC pith:6KCZCJT5
load-bearing objection Clean simulation fix for temperature drift in the authors' own superparamagnetic reservoir; useful engineering result, still model-only. the 2 major comments →
Reproducible Reservoir Computing with Thermally Driven Superparamagnets: Controlling Temperature Sensitivity
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Optimised geometric heterogeneity—i.e., a controlled mixture of nanodot diameters—renders strain-driven superparamagnetic reservoirs far more temperature-stable than uniform arrays, keeping NARMA-10 NRMSE low across 5–35 °C with only modest degradation of the best-case error obtained at the training temperature.
What carries the argument
Weighted-average magnetisation of independent ensembles (Eq. 5) whose individual Néel–Arrhenius rates differ because the energy barriers scale with nanodot volume; multi-objective Bayesian optimisation then selects both the size distribution and the reservoir hyperparameters that jointly minimise peak NRMSE and average NRMSE over the temperature window.
Load-bearing premise
The model treats every nanodot as completely independent and assigns it fixed material parameters taken from the literature; any real dipolar coupling, fabrication scatter, or temperature dependence of anisotropy would change the predicted stability.
What would settle it
Fabricate the optimised multi-diameter CoFeB/PMN-PT arrays, train them on NARMA-10 at 20 °C, then measure NRMSE while the chip is held at 5 °C and 35 °C; if the measured temperature-induced error rise substantially exceeds the simulated curves, the claim fails.
If this is right
- Heterogeneous superparamagnetic reservoirs become practical candidates for edge devices that must operate without temperature control.
- Feedback strength can be used post-fabrication as a single knob to re-balance peak accuracy against thermal robustness for different deployment environments.
- The same multi-timescale design principle may be transferable to other thermally activated physical reservoirs.
- Task-independent reservoir metrics (memory capacity, kernel rank) should next be mapped across temperature to confirm that the stabilisation is not NARMA-specific.
Where Pith is reading between the lines
- Once fabrication variance is measured, a second optimisation pass that includes that variance as a constraint could further harden the design against real process spread.
- The same volume-spread idea could be applied to other magnetoelectric or spin-orbit-torque reservoirs whose dynamics sit near thermal activation.
- If the weighted-average approximation holds experimentally, it supplies a rapid surrogate model that lets designers explore far larger size distributions without full micromagnetic simulation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript studies temperature sensitivity of a previously proposed physical reservoir based on strain-driven superparamagnetic CoFeB nanodot ensembles. Using a Stoner–Wohlfarth energy landscape (Eq. 1) and Néel–Arrhenius switching rates (Eq. 2), the authors show that a uniform ensemble trained at 20 °C suffers large NRMSE degradation on NARMA-10 when inference temperature varies over 5–35 °C. They then introduce geometric heterogeneity (multiple diameters and number fractions) and construct the ensemble magnetisation as a weighted sum of independent uniform ensembles (Eqs. 5–6). Multi-objective Bayesian optimisation yields a Pareto front trading minimum NRMSE against average NRMSE across the temperature window; optimised heterogeneous designs keep both metrics near 0.55–0.72 while the best uniform design reaches average NRMSE ~70. Feedback strength γ is identified as the dominant hyperparameter for tuning the trade-off. All results are numerical.
Significance. If the modelling assumptions hold, the work supplies a concrete, optimisable design rule (size heterogeneity plus γ tuning) that converts an intrinsically temperature-fragile thermal reservoir into one that remains usable over a realistic ambient range. That is a necessary step toward practical deployment of the ultra-low-power magnetoelectric platform introduced in the authors’ 2021 APL paper. The Pareto-front analysis and hyperparameter importance ranking are cleanly executed and give device designers an actionable knob. The principal limitation is that the entire claim rests on an idealised non-interacting ensemble model that has not been experimentally validated; the quantitative stability numbers are therefore still conditional.
major comments (2)
- The central stability claim rests on the weighted-average construction m_hetero = ∑ w_k m_k (Eqs. 5–6) of independent, non-interacting ensembles. The manuscript states that dots are spaced “>2 imes diameter to minimize dipolar coupling” and treats each size class as an isolated Stoner–Wohlfarth particle whose only temperature dependence is the Néel–Arrhenius rate with fixed literature Ms, K and f0. No sensitivity analysis is provided for residual dipolar fields, lithographic size/shape variance, or weak temperature dependence of anisotropy. Because these effects would distort the multi-timescale averaging that produces the flat NRMSE curves in Fig. 4(b,c), the quantitative Pareto-front numbers (min NRMSE 0.55–0.63, avg 0.72–1.26) remain conditional on an idealisation that is never stress-tested inside the paper. A short numerical check (e.g., adding a mean-field dipolar term or drawing d
- All evidence is simulation-only. The abstract and conclusion present the heterogeneous designs as “a key step in making these novel devices suitable for real-world deployment,” yet no experimental magnetisation traces, fabricated heterogeneous arrays, or even a comparison against measured temperature-dependent switching rates of CoFeB nanodots are shown. While pure simulation studies are acceptable for a design paper, the language should be tempered to make clear that the reported temperature stability is a prediction of the model rather than a demonstrated device property.
minor comments (5)
- Abstract and main text inconsistently use “NMRSE” and “NRMSE”; the latter is the conventional acronym and should be used throughout.
- Eq. (2) writes the attempt frequency as f0^{ij} = 10^{-9} s; the conventional value is 10^9 s^{-1}. The sign of the exponent is inverted (also appears in the caption of Fig. 2).
- Fig. 3(a) reports NRMSE = 550 at 5 °C; the axis scale and units should be double-checked, and a note added that such extreme values simply indicate total loss of predictive power.
- Table I lists “Diameter ratio (d2/d1)” while Table II shows multi-element vectors; a brief clarification of how the multi-species diameters are parameterised would help the reader.
- The conclusion correctly flags the need for task-independent metrics (memory capacity, kernel rank). Adding even a single such metric for the Pareto-front designs would make the temperature-stability claim less task-specific.
Circularity Check
No significant circularity; temperature-stability results are numerical outcomes of an independent physical model plus out-of-sample evaluation, not tautologies of fitted inputs or self-citation chains.
full rationale
The derivation chain is: Stoner–Wohlfarth energy (Eq. 1) + Néel–Arrhenius rates (Eq. 2) yield single-ensemble magnetisation dynamics (Eqs. 3–4); heterogeneous ensembles are then defined by the explicit weighted-average construction m_hetero = ∑ w_k m_k (Eqs. 5–6); time-multiplexed reservoir states are formed, a linear readout is trained by ridge regression solely at 20 °C, and NRMSE is evaluated at other temperatures; multi-objective Bayesian optimisation simply searches the resulting min-NRMSE / avg-NRMSE surface. None of these steps reduces a claimed prediction to its own defining inputs. The 2021 self-citation supplies the original reservoir concept and literature material parameters but is not load-bearing for the new temperature-robustness claim, which is generated by fresh simulation under the stated model. Hyper-parameter search on NARMA-10 is ordinary optimisation practice, not circularity. The paper is therefore self-contained against its own simulation benchmarks.
Axiom & Free-Parameter Ledger
free parameters (5)
- nanodot diameters and number fractions (Pareto set)
- feedback strength γ
- virtual-node number Nv, input scaling Δv, applied field h, input rate θ/T0
- attempt frequency f0 = 10^9 s^-1
- Ms = 7.2e5 A m^-1, K = 1.2e3 J m^-3, λs = 60 ppm, E = 216 GPa
axioms (4)
- domain assumption Magnetisation dynamics of each nanodot obey the Stoner–Wohlfarth energy (Eq. 1) and Néel–Arrhenius switching rates (Eq. 2) with temperature-independent material parameters.
- domain assumption Dipolar interactions are negligible when dots are spaced >2× diameter, so the heterogeneous magnetisation is simply the weighted sum of independent uniform ensembles (Eqs. 5–6).
- ad hoc to paper Ridge-regression readout trained at a single temperature remains the correct linear map when the reservoir is later operated at other temperatures.
- ad hoc to paper NARMA-10 NRMSE is a sufficient proxy for the computational utility of the reservoir under temperature variation.
read the original abstract
Unconventional computing systems must demonstrate robust performance under real-world environmental conditions to enable practical deployments. We have recently proposed superparamagnetic nanodot ensembles driven by strain-induced magnetoelectric coupling as exciting candidates for use as ultra-low energy consumption reservoir computing substrates. However, because their dynamics are governed by thermal activation effects, these systems are intrinsically sensitive to ambient temperature fluctuations, leading to degraded task performance when operated outside the temperature range used during training. In this paper we simulate how temperature variations affect the magnetization dynamics of such superparamagnetic ensembles, and quantify how this affects task performance. We then show how heterogeneous nanodot patterns that incorporate different sizes of nanodots with different characteristic timescales for thermal activation mitigate this problem. Benchmark results on the NARMA-10 task show that introducing optimized heterogeneity stabilizes performance of the reservoirs across a wide range of ambient temperatures (5-35{\deg}C), with little loss of ultimate performance. We also characterize the trade-off between performance and temperature stability and show that it can be tuned via reservoir hyperparameters. Our study demonstrates a key step in making these novel devices suitable for real-world deployment.
Figures
Reference graph
Works this paper leans on
-
[1]
Reservoir Computing: Theory, Physical Implementations, and Applications. (Springer, Singapore, 2021). doi:10.1007/978-981-13-1687-6
-
[2]
& Markram, H
Maass, W., Natschläger, T. & Markram, H. A Model for Real-Time Computation in Generic Neural Microcircuits. in Advances in Neural Information Processing Systems vol. 15 (MIT Press, 2002)
2002
-
[3]
Jalalvand, A., Van Wallendael, G. & Van De Walle, R. Real-Time Reservoir Computing Network-Based Systems for Detection Tasks on Visual Contents. in 2015 7th International Conference on Computational Intelligence, Communication Systems and Networks 146–151 (2015). doi:10.1109/CICSyN.2015.35
-
[4]
& Lai, Y.-C
Kong, L.-W., Weng, Y., Glaz, B., Haile, M. & Lai, Y.-C. Reservoir computing as digital twins for nonlinear dynamical systems. Chaos 33, 033111 (2023)
2023
-
[5]
Salehinejad, H., Sankar, S., Barfett, J., Colak, E. & Valaee, S. Recent Advances in Recurrent Neural Networks. Preprint at https://doi.org/10.48550/arXiv.1801.01078 (2018)
-
[6]
Allwood, D. A. et al. A perspective on physical reservoir computing with nanomagnetic devices. Applied Physics Letters 122, 040501 (2023)
2023
-
[7]
Tanaka, G. et al. Recent advances in physical reservoir computing: A review. Neural Networks 115, 100–123 (2019)
2019
-
[8]
& Bienstman, P
Vandoorne, K., Dambre, J., Verstraeten, D., Schrauwen, B. & Bienstman, P. Parallel Reservoir Computing Using Optical Amplifiers. IEEE Transactions on Neural Networks 22, 1469–1481 (2011)
2011
-
[9]
Sande, G. V. der, Brunner, D. & Soriano, M. C. Advances in photonic reservoir computing. Nanophotonics 6, 561–576 (2017)
2017
-
[10]
Vandoorne, K. et al. Toward optical signal processing using Photonic Reservoir Computing. Opt. Express, OE 16, 11182–11192 (2008)
2008
-
[11]
Hafizovic, S. et al. A CMOS-based microelectrode array for interaction with neuronal cultures. Journal of Neuroscience Methods 164, 93–106 (2007)
2007
-
[12]
& Hirose, A
Nakane, R., Tanaka, G. & Hirose, A. Reservoir Computing With Spin Waves Excited in a Garnet Film. IEEE Access 6, 4462–4469 (2018)
2018
-
[13]
Grollier, J. et al. Neuromorphic spintronics. Nat Electron 3, 360–370 (2020)
2020
-
[15]
(吴涛) et al
Wu, T. (吴涛) et al. Domain engineered switchable strain states in ferroelectric (011) [Pb(Mg1/3Nb2/3)O3](1−x)-[PbTiO3]x (PMN-PT, x≈0.32) single crystals. Journal of Applied Physics 109, 124101 (2011)
2011
-
[16]
(吴涛) et al
Wu, T. (吴涛) et al. Electrical control of reversible and permanent magnetization reorientation for magnetoelectric memory devices. Applied Physics Letters 98, 262504 (2011)
2011
-
[17]
Théorie du traînage magnétique des ferromagnétiques en grains fins avec application aux terres cuites
Néel, L. Théorie du traînage magnétique des ferromagnétiques en grains fins avec application aux terres cuites. Annales de géophysique 5, 99–136 (1949)
1949
-
[18]
Raanaei, H. et al. Imprinting layer specific magnetic anisotropies in amorphous multilayers. J. Appl. Phys. 106, 023918 (2009)
2009
-
[19]
T., Rushforth, A
Hindmarch, A. T., Rushforth, A. W., Campion, R. P., Marrows, C. H. & Gallagher, B. L. Origin of in-plane uniaxial magnetic anisotropy in CoFeB amorphous ferromagnetic thin films. Phys. Rev. B 83, 212404 (2011)
2011
-
[20]
Borders, W. A. et al. Integer factorization using stochastic magnetic tunnel junctions. Nature 573, 390–393 (2019)
2019
-
[22]
& Jaeger, H
Lukoševičius, M. & Jaeger, H. Reservoir computing approaches to recurrent neural network training. Computer Science Review 3, 127–149 (2009)
2009
-
[23]
Atiya, A. F. & Parlos, A. G. New results on recurrent network training: unifying the algorithms and accelerating convergence. IEEE Transactions on Neural Networks 11, 697– 709 (2000)
2000
-
[24]
Manneschi, L. et al. Exploiting Multiple Timescales in Hierarchical Echo State Networks. Front. Appl. Math. Stat. 6, (2021)
2021
-
[25]
Wang, J. et al. Giant non-volatile magnetoelectric effects via growth anisotropy in Co40Fe40B20 films on PMN-PT substrates. Appl. Phys. Lett. 114, 092401 (2019)
2019
-
[26]
& Chang, C
Chen, Y.-T. & Chang, C. C. Effect of grain size on magnetic and nanomechanical properties of Co60Fe20B20 thin films. Journal of Alloys and Compounds 498, 113–117 (2010)
2010
-
[27]
& Hakanen, J
Deb, K., Sindhya, K. & Hakanen, J. Multi-Objective Optimization. in Decision Sciences (CRC Press, 2016)
2016
-
[28]
Konak, A., Coit, D. W. & Smith, A. E. Multi-objective optimization using genetic algorithms: A tutorial. Reliability Engineering & System Safety 91, 992–1007 (2006)
2006
-
[29]
Mathern, A. et al. Multi-objective constrained Bayesian optimization for structural design. Struct Multidisc Optim 63, 689–701 (2021)
2021
-
[30]
Deb, K. & Gupta, H. Searching for Robust Pareto-Optimal Solutions in Multi-objective Optimization. in Evolutionary Multi-Criterion Optimization 150–164 (Springer, Berlin, Heidelberg, 2005). doi:10.1007/978-3-540-31880-4_11
-
[32]
Wringe, C., Trefzer, M. & Stepney, S. Reservoir Computing Benchmarks: a tutorial review and critique. International Journal of Parallel, Emergent and Distributed Systems 1– 39 (2025) doi:10.1080/17445760.2025.2472211
-
[33]
Echo state property and memory capacity of artificial spin ice
Taniguchi, T. Echo state property and memory capacity of artificial spin ice. Sci Rep 15, 9073 (2025)
2025
-
[34]
Venkat, G. et al. Exploring physical and digital architectures in magnetic nanoring array reservoir computers. Neuromorph. Comput. Eng. 4, 024018 (2024). Supplementary material: Reproducible reservoir computing with thermally driven superparamagnets: controlling temperature sensitivity Z. Chen1, A. Welbourne1, M. O. A. Ellis2, D.A. Allwood1, E. Vasilaki2,...
2024
-
[35]
Akiba, T., Sano, S., Yanase, T., Ohta, T. & Koyama, M. Optuna: A Next-generation Hyperparameter Optimization Framework. in Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining 2623–2631 (Association for Computing Machinery, New York, NY, USA, 2019). doi:10.1145/3292500.3330701
-
[36]
Welbourne, A. et al. Voltage-controlled superparamagnetic ensembles for low-power reservoir computing. Applied Physics Letters 118, 202402 (2021)
2021
-
[37]
Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428–431 (2017)
2017
-
[38]
Appeltant, L. et al. Information processing using a single dynamical node as complex system. Nat Commun 2, 468 (2011)
2011
-
[39]
Abreu Araujo, F. et al. Role of non-linear data processing on speech recognition task in the framework of reservoir computing. Sci Rep 10, 328 (2020)
2020
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.