REVIEW 4 major objections 4 minor 51 references
Learning neural representations for X-ray ptychography reconstruction with unknown probes
T0 review · 4 major / 4 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read PtyINR claims that X-ray ptychography can jointly recover both the sample and the unknown illuminating probe from raw diffraction patterns by parameterizing each as a continuous neural field, and that this beats established solvers especial
desk verdict PtyINR: a credible blind probe+object INR for ptychography, but the 'consistent SOTA' claim needs repeated-seed stats and hyperparameter values. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the pair of implicit neural representations: a SIREN (sine-activated MLP) for the object and a multi-resolution hash-encoding network (Instant-NGP style) for the probe. The asymmetry matters because the probe contributes to every diffraction pattern, so its representation must train stably, while the object contributes only locally and needs expressive high-frequency modeling. The other key piece is the hybrid loss: a SmoothL1 interpolation between l1 and l2 in intensity space, plus a probe mean-amplitude regularization applied only in early training and a normalization constraint. Together these carry the blind joint recovery; the paper's ablations attribute the s
What would settle it
Simulate ptychographic data from a known two-mode probe, or impose known scan-position jitter, then run PtyINR and check whether the object error grows with the mode-mixture or position-error magnitude. A clean control is to give a conventional solver the true probe modes and exact positions under the same noise and see whether it recovers the object with higher fidelity than PtyINR; if so, the single-mode/exact-position assumption is the crucial limit of the central claim.
Extended reading notes
Core claim
PtyINR's discovery is that ptychographic blind reconstruction can be formulated as pure self-supervised neural-field fitting. The object is parameterized as two coordinate-to-value MLPs with periodic activations, giving amplitude and phase; the probe is parameterized by a multi-resolution hash-encoded ReLU network. The forward model computes the predicted far-field diffraction intensity by Fourier transform of the exit wave, and the networks are trained by minimizing a SmoothL1 loss between predicted and measured intensities. To make joint recovery stable, the probe amplitude is normalized and a mean-amplitude regularization is applied in early training. On simulated data with 40%, -540%, an
Load-bearing premise
The reconstruction assumes a single coherent probe mode and exactly known scan positions; if the real probe is partially coherent (multi-mode) or the scan positions drift, the recovered object and probe may absorb those mismatches and the claimed fidelity is not guaranteed.
Editorial extensions
If this is right
- Separate probe characterization becomes unnecessary for high-quality ptychography; the probe is recovered from the same data as the object.
- Sparse overlap and very short exposures become usable, extending ptychography to dose-sensitive and dynamic samples.
- The two-network physics-loss recipe can be carried to other probe-dependent imaging geometries such as near-field and Bragg ptychography by replacing the forward model.
- Because the object is a continuous function rather than a pixel grid, irregular scan geometries can be handled without grid-interpolation artifacts.
- With abundant clean data the method is comparable to established solvers; its reported advantage concentrates in degraded, low-overlap, and low-dose regimes.
Reading between the lines
- A testable generalization is that the stable-probe/expressive-object split of representations may be a general recipe for blind inverse problems: parameterize the globally shared unknown with a low-variance hash-encoded network and the target with a high-frequency sine network.
- The early-training probe regularization suggests a curriculum strategy where the probe is constrained until the object forms a rough structure and then released; the same trick could be exported to other self-supervised joint estimation tasks.
- Because the probe neural field is a continuous function of coordinates, a probe network trained on one beamline configuration might be transferred to new samples measured with the same optics, making reconstructions faster and more stable than starting from random probe initialization.
- The single-mode assumption is the natural place to test limits: if the method is extended to multi-mode probes by adding a mode dimension to the probe network, one can check whether the regularization still prevents degenerate solutions.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes PtyINR, a self-supervised implicit neural representation framework for joint recovery of the object and the unknown illumination probe in X-ray ptychography. The object is parameterized by a SIREN and the probe by a multi-resolution hash-encoded ReLU MLP; training minimizes a SmoothL1 diffraction-consistency loss with a probe-amplitude regularization term. The authors report simulations over scanning overlap ratios, noise conditions, and real datasets (LiCoO2 and Siemens star, FZP and MLL optics) and claim consistent state-of-the-art performance, especially in sparse and low-signal regimes.
Significance. If the empirical claims are substantiated, this is a useful advance: it removes probe pre-characterization and paired training data, is applicable to standard ptychographic forward models, and could benefit low-dose experiments. The paper ships released code, includes extensive ablation studies in the supplementary material, and evaluates on real data from two focusing systems. However, the headline 'consistently outperforms' claim is currently supported only by single-run point estimates, and key controls are unreported, so the significance is conditional.
major comments (4)
- [Results, Figs. 2–5; Supplementary Note, Fig. S15 (p. 24)] The central claim is that PtyINR 'consistently outperform[s] existing techniques' and shows 'remarkable robustness' in low-overlap/low-dose regimes. The evidence consists of single-run PSNR values. The supplement itself states that when object and probe are jointly unknown, 'the reconstruction may fail entirely with a non-negligible probability' (p. 24). No success rates, repeated-seed error bars, medians, or failure statistics are reported for the final architecture or for the baselines. Because random initialization and Adam make the method stochastic, a point estimate cannot support a consistency/robustness claim. Please report seed/initialization statistics (e.g., at least 10 runs) and success probabilities, particularly at -800% overlap and 0.003 s exposure.
- [Methods, Eq. (2); Supplementary Note, Fig. S17] Several per-scenario controls are tuned but not quantified. Eq. (2) defines the regularization coefficient λ and cutoff k, but no numerical values are given anywhere in the paper. The Methods section only reports ranges (β between 1e-4 and 1e-1, learning rate 1e-5 to 1e-4), and Fig. S17 shows ω0 varied among 30, 90, and 300 without stating which value is used for each experiment in Figs. 2–5. Without a table of per-experiment hyperparameters, the reported gains may reflect per-scenario tuning rather than the method itself. Code release helps but does not replace reporting in the manuscript.
- [Methods, Eq. (11); Results, Fig. 5e] The FRC-based resolution claim requires two independent reconstructions F1 and F2, but the paper never states how these were obtained (e.g., splitting scan positions, different random seeds, or separate measurement sets). If the two inputs are not truly independent, the half-bit threshold overestimates resolution. The protocol must be specified or replaced with a controlled metric.
- [Conclusion; Abstract] The paper acknowledges single-mode probe and exact position assumptions in the Conclusion, but the Abstract describes the method as 'generalizable' and applicable to 'a wide range of computational microscopy problems.' In practice, partial coherence or scan-position errors can be absorbed into the reconstructed object and probe fields, which would undermine the claim of recovering the true probe under low-signal conditions. Please either scope the claims to the tested assumptions or include a mismatched-model experiment (e.g., a two-mode probe or position error).
minor comments (4)
- [Results, Fig. 2] The negative overlap labels (-540%, -800%) are unintuitive; the text explains the actual overlap (95%, 50%, 30%) but the figure axes should carry a clarifying note.
- [Results, Fig. 4] The LiCoO2 amplitude images are excluded as 'non-informative.' If this is due to weak absorption, that is plausible, but the criterion should be stated and the images shown in the supplement so readers can assess the choice.
- [Supplementary Note, Fig. S15] The panel label '(Appropriate loss should be 0)' is unclear: it appears to refer to the regularization loss, but the text is ambiguous. Please rephrase and specify which loss should be zero.
- [Introduction and Results] A few grammatical issues: 'we evaluates,' 'these methods fails,' and 'it fail to preserve' should be corrected. Also, the claim 'state-of-the-art' should be qualified because recent methods such as the stochastic ADMM of Ref. [22] are cited but not benchmarked.
Circularity Check
No circularity found: PtyINR is an empirical, self-supervised forward-model fit evaluated against external baselines; no input is renamed as a prediction.
full rationale
The paper's central claim is an empirical reconstruction-quality comparison. PtyINR parameterizes the object and probe as neural fields and minimizes a physics-based loss (Eq. 2) between measured and predicted diffraction patterns. The reconstruction target is not defined in terms of the evaluation metric, and the evaluation metric (PSNR against independent simulated/experimental references) is not folded into the training objective. No fitted parameter is renamed as a prediction, and no uniqueness theorem or ansatz is smuggled in through self-citation. The author-overlapping references (e.g., [19] APG, [29] PtychoNet, [35] AD, [44] fly-scan ptychography) are used as baselines, background, or a standard acquisition model; none supplies the claimed superiority or forbids alternatives. The Supplementary Note's admission that blind reconstruction can fail with non-negligible probability (Fig. S15 and surrounding text) is a robustness limitation, not circularity. The absence of repeated-seed statistics and unreported hyperparameters (λ, k, β, ω0) is a statistical reporting concern that does not constitute a circular derivation. No specific equation or claim reduces to its own input by construction.
Assumptions & free parameters
free parameters (4)
- omega_0 (first-layer sine frequency in object SIREN) =
30, 90, or 300 depending on data regime
- beta (SmoothL1 threshold) =
between 1e-4 and 1e-1 depending on the task
- lambda (probe amplitude regularization weight) and k (regularization duration) =
not reported in main text
- learning rate =
1e-5 to 1e-4
assumptions (5)
- domain assumption The forward model is a Fourier transform of the exit wave product (Fraunhofer far-field, Eq. 1).
- domain assumption The probe is single-mode and scan positions are exact.
- ad hoc to paper The object and probe can be represented by the chosen MLP architectures (SIREN object, hash-encoding ReLU probe).
- domain assumption The simulation ground truth object is the ePIE reconstruction of a tungsten sample from Cherukara et al.
- ad hoc to paper Probe normalization P <- P/max(Ap) and the regularization term lambda * mean(Ap) guide convergence.
Cite this review
Pith. "Pith review of Learning neural representations for X-ray ptychography reconstruction with unknown probes." pith.science (2026). https://pith.science/paper/IBZRUAME
@misc{pith2026250904402,
author = {Pith},
title = {Pith review of: Learning neural representations for X-ray ptychography reconstruction with unknown probes},
year = {2026},
howpublished = {\url{https://pith.science/paper/IBZRUAME}},
note = {Machine review of arXiv:2509.04402}
}
read the original abstract
X-ray ptychography provides exceptional nanoscale resolution and is widely applied in materials science, biology, and nanotechnology. However, its full potential is constrained by the critical challenge of accurately reconstructing images when the illuminating probe is unknown. Conventional iterative methods and deep learning approaches are often suboptimal, particularly under the low-signal conditions inherent to low-dose and high-speed experiments. These limitations compromise reconstruction fidelity and restrict the broader adoption of the technique. In this work, we introduce the Ptychographic Implicit Neural Representation (PtyINR), a self-supervised framework that simultaneously addresses the object and probe recovery problem. By parameterizing both as continuous neural representations, PtyINR performs end-to-end reconstruction directly from raw diffraction patterns without requiring any pre-characterization of the probe. Extensive evaluations demonstrate that PtyINR achieves superior reconstruction quality on both simulated and experimental data, with remarkable robustness under challenging low-signal conditions. Furthermore, PtyINR offers a generalizable, physics-informed framework for addressing probe-dependent inverse problems, making it applicable to a wide range of computational microscopy problems.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
author Grote, L. et al. title Imaging Cu 2 O nanocube hollowing in solution by quantitative in situ X -ray ptychography . journal Nature Communications volume 13 , pages 4971 ( year 2022 )
work page 2022
-
[2]
author Diaz, A. , author Guizar-Sicairos, M. , author Poeppel, A. , author Menzel, A. & author Bunk, O. title Characterization of carbon fibers using X -ray phase nanotomography . journal Carbon volume 67 , pages 98--103 ( year 2014 )
work page 2014
-
[3]
author Hémonnot, C. Y. J. & author Köster, S. title Imaging of Biological Materials and Cells by X -ray Scattering and Diffraction . journal ACS Nano volume 11 , pages 8542--8559 ( year 2017 )
work page 2017
-
[4]
author Zhu, X. et al. title Measuring spectroscopy and magnetism of extracted and intracellular magnetosomes using soft X -ray ptychography . journal Proceedings of the National Academy of Sciences volume 113 , pages E8219--E8227 ( year 2016 )
work page 2016
-
[5]
author Górecki, R. et al. title Ptychographic X -ray computed tomography of porous membranes with nanoscale resolution . journal Communications Materials volume 4 , pages 1--8 ( year 2023 )
work page 2023
-
[6]
author Rose, M. et al. title Quantitative ptychographic bio-imaging in the water window . journal Optics Express volume 26 , pages 1237--1254 ( year 2018 )
work page 2018
-
[7]
author Piazza, V. et al. title Revealing the Structure of Stereociliary Actin by X -ray Nanoimaging . journal ACS Nano volume 8 , pages 12228--12237 ( year 2014 )
work page 2014
-
[8]
author Holler, M. et al. title High-resolution non-destructive three-dimensional imaging of integrated circuits . journal Nature volume 543 , pages 402--406 ( year 2017 )
work page 2017
Show all 51 references
-
[9]
title X-ray ptychography
author Pfeiffer, F. title X-ray ptychography . journal Nature Photonics volume 12 , pages 9--17 ( year 2018 )
2018
-
[10]
title Computational microscopy with coherent diffractive imaging and ptychography
author Miao, J. title Computational microscopy with coherent diffractive imaging and ptychography . journal Nature volume 637 , pages 281--295 ( year 2025 )
2025
-
[11]
author Pattammattel, A. et al. title High-sensitivity nanoscale chemical imaging with hard x-ray nano-xanes . journal Science Advances volume 6 , pages eabb3615 ( year 2020 )
2020
-
[12]
author Yan, H. et al. title Multimodal hard x-ray imaging with resolution approaching 10 nm for studies in material science . journal Nano Futures volume 2 , pages 011001 ( year 2018 )
2018
-
[13]
, author Martel, J
author Sitzmann, V. , author Martel, J. N. P. , author Bergman, A. W. , author Lindell, D. B. & author Wetzstein, G. title Implicit neural representations with periodic activation functions . In booktitle Proceedings of the 34th International Conference on Neural Information P...
2020
-
[14]
author Maiden, A. M. & author Rodenburg, J. M. title An improved ptychographical phase retrieval algorithm for diffractive imaging . journal Ultramicroscopy volume 109 , pages 1256--1262 ( year 2009 )
2009
-
[15]
, author Johnson, D
author Maiden, A. , author Johnson, D. & author Li, P. title Further improvements to the ptychographical iterative engine . journal Optica volume 4 , pages 736--745 ( year 2017 )
2017
-
[16]
, author Dierolf, M
author Thibault, P. , author Dierolf, M. , author Bunk, O. , author Menzel, A. & author Pfeiffer, F. title Probe retrieval in ptychographic coherent diffractive imaging . journal Ultramicroscopy volume 109 , pages 338--343 ( year 2009 )
2009
-
[17]
author Luke, D. R. title Relaxed averaged alternating reflections for diffraction imaging . journal Inverse Problems volume 21 , pages 37 ( year 2004 )
2004
-
[18]
author Maiden, A. M. , author Mei, W. & author Li, P. title WASP : weighted average of sequential projections for ptychographic phase retrieval . journal Optics Express volume 32 , pages 21327--21344 ( year 2024 )
2024
-
[19]
title Ptychographic phase retrieval by proximal algorithms
author Yan, H. title Ptychographic phase retrieval by proximal algorithms . journal New Journal of Physics volume 22 , pages 023035 ( year 2020 )
2020
-
[20]
, author Buzzard, G
author Zhai, Q. , author Buzzard, G. T. , author Mertes, K. , author Wohlberg, B. & author Bouman, C. A. title Projected Multi - Agent Consensus Equilibrium ( PMACE ) With Application to Ptychography . journal IEEE Transactions on Computational Imaging volume 9 , pages 1058--1...
2023
-
[21]
, author Menzel, A
author Odstrčil, M. , author Menzel, A. & author Guizar-Sicairos, M. title Iterative least-squares solver for generalized maximum-likelihood ptychography . journal Optics Express volume 26 , pages 3108--3123 ( year 2018 )
2018
-
[22]
& author Di, Z
author Bui, K. & author Di, Z. W. title A stochastic ADMM algorithm for large-scale ptychography with weighted difference of anisotropic and isotropic total variation . journal Inverse Problems volume 40 , pages 055006 ( year 2024 )
2024
-
[23]
& author Thibault, P
author Enders, B. & author Thibault, P. title A computational framework for ptychographic reconstructions . journal Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences volume 472 , pages 20160640 ( year 2016 )
2016
-
[24]
, author Elzo Aizarna, M
author Mandula, O. , author Elzo Aizarna, M. , author Eymery, J. , author Burghammer, M. & author Favre-Nicolin, V. title PyNX . Ptycho : a computing library for X -ray coherent diffraction imaging of nanostructures . journal Journal of Applied Crystallography volume 49 , page...
2016
-
[25]
author Marchesini, S. et al. title SHARP : a distributed GPU -based ptychographic solver . journal Journal of Applied Crystallography volume 49 , pages 1245--1252 ( year 2016 )
2016
-
[26]
author Nashed, Y. S. G. et al. title Parallel ptychographic reconstruction . journal Optics Express volume 22 , pages 32082--32097 ( year 2014 )
2014
-
[27]
author Cherukara, M. J. et al. title AI -enabled high-resolution scanning coherent diffraction imaging . journal Applied Physics Letters volume 117 , pages 044103 ( year 2020 )
2020
-
[28]
author Babu, A. V. et al. title Deep learning at the edge enables real-time streaming ptychographic imaging . journal Nature Communications volume 14 , pages 7059 ( year 2023 )
2023
-
[29]
, author Tsai, E
author Guan, Z. , author Tsai, E. H. , author Huang, X. , author Yager, K. G. & author Qin, H. title PtychoNet : Fast and High Quality Phase Retrieval for Ptychography . type Tech. Rep. number BNL-213637-2020-FORE , institution Brookhaven National Lab. (BNL), Upton, NY (United...
2020
-
[30]
author Gan, W. et al. title PtychoDV : Vision Transformer - Based Deep Unrolling Network for Ptychographic Image Reconstruction . journal IEEE Open Journal of Signal Processing volume 5 , pages 539--547 ( year 2024 )
2024
-
[31]
author Paszke, A. et al. title PyTorch : an imperative style, high-performance deep learning library . In booktitle Proceedings of the 33rd International Conference on Neural Information Processing Systems , number 721 , pages 8026--8037 ( year 2019 )
2019
-
[32]
author Kandel, S. et al. title Using automatic differentiation as a general framework for ptychographic reconstruction . journal Optics Express volume 27 , pages 18653--18672 ( year 2019 )
2019
-
[33]
, author Nashed, Y
author Du, M. , author Nashed, Y. S. G. , author Kandel, S. , author Gürsoy, D. & author Jacobsen, C. title Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit . journal Science Advances volume 6 , pag...
2020
-
[34]
author Du, M. et al. title Adorym: a multi-platform generic X -ray image reconstruction framework based on automatic differentiation . journal Optics Express volume 29 , pages 10000--10035 ( year 2021 )
2021
-
[35]
, author Yoo, S
author Wu, L. , author Yoo, S. , author Chu, Y. S. , author Huang, X. & author Robinson, I. K. title Dose-efficient automatic differentiation for ptychographic reconstruction . journal Optica volume 11 , pages 821--830 ( year 2024 )
2024
-
[36]
, author Mishra, A
author Hoidn, O. , author Mishra, A. A. & author Mehta, A. title Physics constrained unsupervised deep learning for rapid, high resolution scanning coherent diffraction reconstruction . journal Scientific Reports volume 13 , pages 22789 ( year 2023 )
2023
-
[37]
author Pan, X. et al. title An efficient ptychography reconstruction strategy through fine-tuning of large pre-trained deep learning model . journal iScience volume 26 ( year 2023 )
2023
-
[38]
author Zhou, H. et al. title Fourier ptychographic microscopy image stack reconstruction using implicit neural representations . journal Optica volume 10 , pages 1679--1687 ( year 2023 )
2023
-
[39]
, author Zhang, Q
author Kang, I. , author Zhang, Q. , author Yu, S. X. & author Ji, N. title Coordinate-based neural representations for computational adaptive optics in widefield microscopy . journal Nature Machine Intelligence volume 6 , pages 714--725 ( year 2024 )
2024
-
[40]
, author Sun, Y
author Liu, R. , author Sun, Y. , author Zhu, J. , author Tian, L. & author Kamilov, U. S. title Recovery of continuous 3D refractive index maps from discrete intensity-only measurements using neural fields . journal Nature Machine Intelligence volume 4 , pages 781--791 ( year 2022 )
2022
-
[41]
, author Liu, J
author Sun, Y. , author Liu, J. , author Xie, M. , author Wohlberg, B. & author Kamilov, U. S. title CoIL : Coordinate - Based Internal Learning for Tomographic Imaging . journal IEEE Transactions on Computational Imaging volume 7 , pages 1400--1412 ( year 2021 )
2021
-
[42]
author Stockmar, M. et al. title Near-field ptychography: phase retrieval for inline holography using a structured illumination . journal Scientific Reports volume 3 , pages 1927 ( year 2013 )
1927
-
[43]
author Li, P. et al. title Revealing nano-scale lattice distortions in implanted material with 3d bragg ptychography . journal Nature communications volume 12 , pages 7059 ( year 2021 )
2021
-
[44]
author Huang, X. et al. title Fly-scan ptychography . journal Scientific Reports volume 5 , pages 9074 ( year 2015 )
2015
-
[45]
author Koho, S. et al. title Fourier ring correlation simplifies image restoration in fluorescence microscopy . journal Nature Communications volume 10 , pages 3103 ( year 2019 )
2019
-
[46]
author Du, M. et al. title Predicting ptychography probe positions using single-shot phase retrieval neural network . journal Optics Express volume 32 , pages 36757--36780 ( year 2024 )
2024
-
[47]
& author Menzel, A
author Thibault, P. & author Menzel, A. title Reconstructing state mixtures from diffraction measurements . journal Nature volume 494 , pages 68--71 ( year 2013 )
2013
-
[48]
title Fast R - CNN
author Girshick, R. title Fast R - CNN . In booktitle 2015 IEEE International Conference on Computer Vision ( ICCV ) , pages 1440--1448 ( year 2015 )
2015
-
[49]
, author Evans, A
author Müller, T. , author Evans, A. , author Schied, C. & author Keller, A. title Instant neural graphics primitives with a multiresolution hash encoding . journal ACM Trans. Graph. volume 41 , pages 102:1--102:15 ( year 2022 )
2022
-
[50]
author Kingma, D. P. & author Ba, J. title Adam: A method for stochastic optimization . journal International Conference on Learning Representations (ICLR) ( year 2015 )
2015
-
[51]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.