Pith. sign in

REVIEW 3 major objections 6 minor 3 references

Relaxing Direct Ptychography Sampling Requirements via Parallax Imaging Insights

T0 review · 3 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper shows that direct ptychography, a non-iterative electron-microscopy phase-retrieval method, can be numerically upsampled by 2x–4x beyond its scan-step Nyquist limit using an insight borrowed from parallax imaging, as long as the…

desk verdict A clean theory linking parallax imaging to direct ptychography enables a working FFT-based upsampling scheme; the main soft spot is the empirically calibrated diversity threshold that sets the claimed resolution limits. read the letter →

arxiv 2507.18610 v2 pith:SQU7NURM submitted 2025-07-24 physics.optics cond-mat.mtrl-sci

Georgios Varnavides , Julie Marie Bekkevold , Stephanie M Ribet , Mary C Scott , Lewys Jones , Colin Ophus This is my paper · ORCID
classification physics.opticscond-mat.mtrl-sci PACS 42.30.Rx68.37.Ma
keywords directptychographyparallaximagingtilt-correctedbright-fieldSTEMscanNyquistlimitcontrasttransferfunctionupsamplingweakphaseobjectapproximationlow-doseelectronmicroscopy
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Direct ptychography recovers the phase of a thin electron-microscopy sample from 4D-STEM data without iteration, but its traditional resolution is capped by the scan step size through the Nyquist condition. This paper claims that cap can be lifted: it identifies parallax imaging as a truncated Taylor expansion of the direct ptychography aperture-overlap kernel $\Gamma(\mathbf{q},\mathbf{k})$, and uses that identification to reformulate direct ptychography as a loop over bright-field detector frequencies. The resulting algorithm tiles and shifts Fourier-transformed virtual bright-field images, applies the full kernel, and thereby recovers the analytical direct-ptychography contrast transfer function from scans subsampled by 2x–4x, up to the numerical aperture, when the vBF diversity ratio $\mathcal{D}_{\mathrm{vBF}} = \lambda |\mathbf{k}_{\mathrm{BF}}| |\Delta f|/s$ is about one or larger. If true, dose-sensitive materials could be acquired with large, defocused scan steps and later computationally sharpened, without giving up the accuracy of full direct ptychography. The same analysis explains why parallax imaging is so robust at low dose and why direct ptychography should win at high dose or when higher-order aberrations dominate.

What carries the argument

The load-bearing object is the complex-valued aperture overlap function $\Gamma(\mathbf{q},\mathbf{k}) = \psi^{*}(\mathbf{k})\psi(\mathbf{q}-\mathbf{k}) - \psi(\mathbf{k})\psi^{*}(\mathbf{q}+\mathbf{k})$, with probe wavefunction $\psi(\mathbf{k}) = A(\mathbf{k})e^{-i\chi(\mathbf{k})}$; it describes interference between the probe and its shifted copies at each spatial frequency $\mathbf{q}$. The mathematical bridge to parallax imaging is the Taylor expansion $\chi(\mathbf{q}\pm\mathbf{k}) \approx \chi(\mathbf{q}) \pm \nabla\chi(\mathbf{q})^{T}\cdot\mathbf{k}$, which turns $\Gamma$ into $\mathcal{B}(\mathbf{q},\mathbf{k})e^{i\nabla\chi(\mathbf{q})\cdot\mathbf{k}}$; truncating after the linear term gives parallax, while keeping the full expansion gives direct ptychography. Algorithm 1 implements the full kernel in a loop over bright-field detector frequencies $\mathbf{k}_{\mathrm{BF}}$, tiling and shifting each vBF image Fourier transform and filtering by $\Gamma/|\Gamma|$ before accumulation.

What would settle it

Acquire (or simulate) a 4D-STEM dataset with a pure higher-order aberration such as coma or spherical aberration at zero defocus, choose the scan step so that an effective $\mathcal{D}_{\mathrm{vBF}}$ computed from the aberration magnitude exceeds one, and run Algorithm 1 at 4x upsampling; if the recovered CTF does not match the analytical direct-ptychography CTF of the paper, then Equation 10 is not a general rule and the upsampling limits are specific to defocus-dominated acquisitions.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that parallax imaging is not a separate phase-retrieval trick but the first term of a controlled approximation to the direct ptychography kernel. Factoring the phase ramp $e^{i\nabla\chi(\mathbf{q})\cdot\mathbf{k}}$ out of the aperture overlap function $\Gamma(\mathbf{q},\mathbf{k}) = \psi^*(\mathbf{k})\psi(\mathbf{q}-\mathbf{k}) - \psi(\mathbf{k})\psi^*(\mathbf{q}+\mathbf{k})$ leaves an amplitude term whose phase contains $\chi(\mathbf{q})$, making the parallax CTF $-[\mathcal{A} \star \mathcal{A}](\mathbf{q})\sin[\chi(\mathbf{q})]$; direct ptychography, by contrast, keeps the full kernel and implicitly performs the $\mathrm{sgn}[\sin[\chi(\mathbf{q})]]$ phase-flipping that removes parallax's zero crossings. Because the factorization remains accurate for quadratic aberrations, Algorithm 1 can upsample a coarsely scanned dataset by tiling the Fourier transform of each virtual bright-field image onto a finer grid, shifting it by the detector frequency, filtering with the full $\Gamma$ kernel normalized by its modulus, and summing. The paper validates on simulated apoferritin and on experimental metal-organic frameworks, twisted MoS2, gold nanoparticles, and virus-like particles, including a 4x-thinned MOF dataset reconstructed from 1/16 of the original dose.

Load-bearing premise

The load-bearing premise is the empirically calibrated rule $\mathcal{D}_{\mathrm{vBF}} = \lambda|\mathbf{k}_{\mathrm{BF}}||\Delta f|/s \gtrsim 1$: the paper derives the algorithm but not this threshold, calibrating it on just three defocus values (50, 100, and 200 Å), so if the threshold does not generalize to other aberration types, detector geometries, or noise levels, the predicted upsampling factors would not hold even if the algorithm's mechanics are sound.

Editorial extensions

If this is right

  • For weak-phase samples with $\mathcal{D}_{\mathrm{vBF}} \gtrsim 1$, direct ptychography can be performed on 2x–4x subsampled, defocused scans, meaning the resolution no longer has to be tied to the scan step size.
  • The practical resolution ceiling for upsampled direct ptychography becomes the numerical aperture of the probe, the same ceiling parallax imaging already achieved.
  • At low electron fluence, direct ptychography and parallax imaging reconstructions converge, so for dose-sensitive biological specimens the substantially simpler parallax algorithm is sufficient.
  • At high fluence or with higher-order aberrations, direct ptychography outperforms parallax by recovering the contrast-transfer zero crossings that parallax imaging misses.
  • The same tiling-and-shifting upsampling recipe transfers directly to related linear phase-retrieval variants such as OBF STEM and SSB-ICOM.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the paper calibrates Equation 10 only for defocus, a natural extension would be to test whether the same diversity ratio governs upsampling for astigmatism or coma when the aberration magnitude is expressed through an effective transverse phase gradient; if it does, aberration tuning could replace defocus as the diversity source for near-focus acquisitions.
  • The tiled-shift picture treats each bright-field detector pixel as an independent aperture view, which suggests a synthetic-aperture interpretation; one could derive a Cramér–Rao bound on the reconstructed phase versus fluence and upsampling factor, quantifying when the zero-crossing recovery of direct ptychography actually becomes visible above shot noise.
  • The empirical rule $\mathcal{D}_{\mathrm{vBF}} \gtrsim 1$ likely follows from a support argument on the tiled Fourier grid—the shifted apertures must overlap in the upsampled $\mathbf{q}$-space—so deriving Equation 10 from first principles would make it portable to arbitrary aberrations and detector geometries.
  • If the low-dose convergence of parallax and direct ptychography holds for real detectors, then for frozen-hydrated biological specimens the extra computation of direct ptychography buys little; a testable crossover dose could be identified above which zero-crossing recovery matters.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper develops a theoretical connection between direct ptychography and parallax imaging (tcBF-STEM) by showing that the parallax kernel is a first-order Taylor expansion of the aperture overlap function in the aberration phase. It derives the parallax CTF as the aperture autocorrelation times -sin[χ(q)] and proposes Algorithm 1, which upsamples direct ptychography reconstructions by tiling the Fourier-transformed virtual bright-field images and applying a matched filter constructed from the full aperture overlap kernel. The authors claim that, under the weak-phase object approximation, direct ptychography can be upsampled by 2-4x beyond the scan Nyquist limit provided the vBF diversity ratio D_vBF = λ|k_BF||Δf|/s is ≳ 1 (Eq. 10), and they support this with simulated CTF recovery, low-fluence simulations on apoferritin, and experimental reconstructions of MOFs, gold nanoparticles, twisted MoS2, and virus-like particles.

Significance. If the central claim holds, the paper would make a useful contribution by decoupling direct ptychography resolution from scan step size in the weak-phase regime, with immediate applicability to dose-sensitive biological and organic materials. The strengths of the manuscript include a clean analytical derivation of the parallax CTF from the aperture overlap function (Eqs. 4, 7, 8), reproduction of the known TEM CTF modulation, a transparent algorithmic description, and a public implementation in the quantem package with notebooks for the CTF results. The conceptual framing of parallax imaging as a quadratic approximation to direct ptychography is illuminating and likely to be pedagogically valuable. The numerical and experimental demonstrations are broadly consistent with the theory, although the quantitative range of validity of the upsampling criterion is not established with the same rigor as the CTF derivation.

major comments (3)
  1. [Relaxing Sampling Requirements, Eq. (10) and Table 1] The upsampling limit is governed by the vBF diversity rule D_vBF = λ|k_BF||Δf|/s ≳ 1, which the paper calls a 'rule of thumb' and presents without derivation. The criterion is calibrated on only three defocus values (50, 100, 200 Å, Table 1) and for a single aberration type (defocus). The central quantitative claim—that upsampling factors of 2x-4x are achievable and grow with aberration magnitude—depends on this threshold. The manuscript does not show that the threshold is invariant to the upsampling factor f, detector pixel count, noise level, or aberration type. Please either provide a derivation of D_vBF from the aliasing/conditioning analysis of the reconstruction operator, or substantially broaden the numerical validation to include variations in f, noise, detector geometry, and non-defocus aberrations. As written, the abstract's statement that 'resolution is no longer tied to the scan step size' is broader than what Eq. (10) and Table 1 demonstrate.
  2. [Algorithm 1 and 'Relaxing Sampling Requirements'] Algorithm 1 tiles the sub-sampled FFT (line 3) and applies the matched filter Γ*/|Γ| (line 6), but the paper provides no conditioning or null-space analysis showing that this operation actually inverts the alias mixing caused by sub-Nyquist scan sampling. The algorithm has no explicit alias-inversion step; suppression of aliased copies must rely on phase diversity across the BF detector pixels. Without an analysis of when the linear map from the upsampled object to the measured vBF images is invertible, or at least a numerical conditioning study as a function of D_vBF, f, and noise, it is unclear whether the observed success in Figure 3 is robust or a property of the specific simulation parameters. This is load-bearing because the algorithm's advertised capability is precisely to recover information beyond the scan Nyquist limit.
  3. [Experimental Reconstructions (Figures 5 and 6)] The experimental validation is qualitative. For Figure 5, the text states that 'many of the salient features of the scan-sampled reconstruction persist' in the upsampled reconstruction, but no quantitative metric (e.g., Fourier ring correlation against the scan-sampled reference, resolution estimates, or SNR) is provided. Figure 6 similarly shows side-by-side images without quantitative comparison. Since the paper's central claim is about recovering information beyond the scan sampling limit, quantitative evaluation of the upsampled experimental reconstructions—especially for the 4x and 1/16-dose case using 6 e/Ų—would substantially strengthen the claim and is needed to support the stated limits.
minor comments (6)
  1. [Equation (2)] The second exponential in Eq. (2) appears to be missing a closing parenthesis: 'ei[𝜒(𝒒+𝒌−𝜒(𝑘))]' should likely read 'ei[𝜒(𝒒+𝒌)−𝜒(𝑘)]'. Please check and correct.
  2. [Page 4, caption of Figure 2] Typo: 'In the present of higher-order aberrations' should be 'In the presence of higher-order aberrations'.
  3. [Data Availability] The Data Availability statement contains the placeholder '[ToDo: Add Zenodo link]'. This must be resolved before publication, and the statement should specify the license and access conditions for the processed datasets and code.
  4. [Algorithm 1, line 3] The tiling operation 'tile_f' is not fully specified: it is not stated whether the tiling is performed in the detector-frequency grid after rotation or in the scan-frequency grid, nor how the edges of the sub-sampled FFT are handled (zero-padding versus periodic replication). A precise definition would improve reproducibility.
  5. [Supplementary Table 1 and text following Figure 6] The hyper-parameter optimization procedure (θ, C1,0, C1,2, φ1,2) is described only in one sentence ('we optimize ... against a self-consistent loss function given by the mean variance across the aligned BF images stack'). Additional details—initialization, bounds, number of iterations, and sensitivity to initial values—should be provided to allow others to reproduce the experimental reconstructions.
  6. [Figure 4 caption] The caption states 'Scalebars are 10 nm and 0.5 nm−1 respectively', but the figure shows multiple rows and columns with potentially different scalebars; please clarify which scalebar corresponds to which panel or indicate that all real-space scalebars are 10 nm and all reciprocal-space scalebars are 0.5 nm−1.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity; the parallax/direct-ptychography CTF relation is re-derived in-text and the upsampling validation is an internal consistency check rather than a fitted prediction.

full rationale

The paper's central derivation chain is self-contained. The aperture overlap function in Eqs. 4-5 is the standard weak-phase direct ptychography kernel, and the parallax CTF in Eq. 8 is obtained by an explicit substitution and Taylor expansion (Eqs. 7 and 9), not by assuming the conclusion. Algorithm 1 is a concrete reconstruction procedure that applies the full kernel on a tiled, upsampled frequency grid; its outputs are compared against the analytical CTF of the same linear model, which is an internal consistency check rather than a circular prediction. The vBF diversity rule of thumb in Eq. 10 is explicitly labeled a 'rule of thumb' and calibrated on Table 1; it is not derived from, nor disguised as, a first-principles prediction, so any concern about its generality is a correctness or robustness limitation, not circularity. Self-citations to prior parallax imaging work are contextual, and the key mathematical relationship is re-derived in the manuscript rather than imported unexamined. No load-bearing step reduces by construction to its inputs, and no fitted parameter is renamed as a prediction.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

No new physical entities are introduced. The paper's claims rest on the standard linear weak-phase model of STEM phase retrieval, the accuracy of per-dataset aberration fits, and an empirically calibrated diversity threshold.

free parameters (3)
  • Experiment-specific aberration coefficients and rotation angle (θ, C1,0, C1,2, φ1,2) = e.g., MOSS-6: θ=94.6°, C1,0=-108.6 nm, C1,2=11.4 nm, φ1,2=-33.6° (Supplementary Table 1)
    Required inputs to Algorithm 1; optimized per dataset against a self-consistent loss (variance across aligned BF images), not independently measured.
  • vBF diversity threshold (D_vBF ≳ 1) = 1
    Empirically calibrated from simulations at Δf = 50, 100, 200 Å (Table 1); no derivation given, stated as a rule of thumb (Eq. 10).
  • Upsampling factor f = 2x, 4x (chosen per demonstration)
    Hyperparameter selected by the user; not determined by the theory.
assumptions (4)
  • domain assumption Weak phase object approximation: sample potential proportional to induced phase shift, permitting a linear CTF formalism.
    Used throughout to define contrast transfer functions (Eq. 1-2), following Hammel and Rose (1995). The method's validity for thick or strongly scattering samples is not addressed.
  • domain assumption Pixelated detector with Dirac-delta segmentation D_j(k)=δ(k) for the analytic CTF; extension to segmented detectors only mentioned in passing.
    Eq. 4 and CTF derivations assume pixelated detector; the upsampling algorithm likewise loops over bright-field pixels, so detector pixels are treated as ideal point samples.
  • domain assumption Probe is fully coherent and described by aperture A(k) and aberration surface χ(k) with known or identifiable coefficients.
    The algorithm requires the relative rotation θ and low-order aberration coefficients as inputs; in experiments these are fitted from the data rather than known independently.
  • standard math Taylor expansion of χ(q±k) to first order in k is valid for the parallax linkage, with the Hessian term constant for quadratic aberrations.
    Eq. 9; standard Taylor series; the paper argues the omitted second-order term is a global phase for quadratic aberrations but not for higher orders.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Relaxing Direct Ptychography Sampling Requirements via Parallax Imaging Insights." pith.science (2026). https://pith.science/paper/SQU7NURM

@misc{pith2026250718610,
  author       = {Pith},
  title        = {Pith review of: Relaxing Direct Ptychography Sampling Requirements via Parallax Imaging Insights},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/SQU7NURM}},
  note         = {Machine review of arXiv:2507.18610}
}
read the original abstract

Direct ptychography enables the retrieval of information encoded in the phase of an electron wave passing through a thin sample by deconvolving the interference effects of a converged probe with known aberrations. Under the weak phase object approximation, this permits the optimal transfer of information using non-iterative techniques. However, the achievable resolution of the technique is traditionally limited by the probe step size -- setting stringent Nyquist sampling requirements. At the same time, parallax imaging has emerged as a dose-efficient phase-retrieval technique which relaxes sampling requirements and enables scan-upsampling. Here, we formulate parallax imaging as a quadratic approximation to part of the direct ptychography kernel and use this insight to enable upsampling in direct ptychography. We validate our analytical results numerically using simulated and experimental reconstructions.

Figures

Figures reproduced from arXiv: 2507.18610 by the authors.

Figure 1
Figure 1. Different views of the complex-valued aperture overlap function, Γ(𝒒, 𝒌). a) Fixing specific spatial frequencies 𝒒 and plotting over the detector frequencies 𝒌, illustrates the so-called 'double' and 'triple' overlap 'trotter' regions. b) Fixing specific detector frequencies 𝒌 and plotting over the spatial frequencies 𝒒, illustrates the effect of shifting the probe aperture and aberrations. c) Plots the part of the … view at source ↗
Figure 2
Figure 2. Contrast transfer of information for direct ptychography and parallax imaging. For quadratic aberrations, such as defocus and astigmatism (top row), parallax closely resembles direct ptychography, albeit including zero-crossings. In the present of higher-order aberrations, traditional parallax fails qualitatively to reconstruct the sample phase. Including the aberration surface Hessian (middle column), recovers some… view at source ↗
Figure 3
Figure 3. Upsampling limits in direct ptychography. Subsampled direct ptychography acquisitions (second column), upsampled to 2x (third column) and 4x (fourth column) scan resolution. The last column plots the analytical CTF the upsampled reconstructions are attempting to recover. Each row represents an increasing amount of defocus, highlighting upsampling factor limits are proportional to aberrations magnitude. Scalebars equ… view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Zero crossing recovery limits. Parallax imaging (top half) and direct ptychography (bottom half) reconstructions for simulated apoferritin proteins, and decreasing electron fluence from left to right. At finite electron fluence, the recovery of the CTF zero crossings e…
Figure 5
Figure 5. Figure 5: demonstrates the utility and limits of direct pty￾chography upsampling on experimental data of the dose￾sensitive metal organic framework (MOF), MOSS-6 (Li et al., 2025). The acquisition uses a very fine step-size of 1.05 Å, and the scan-sampled direct ptychography rec…
Figure 6
Figure 6. Figure 6: Upsampled experimental reconstructions. Scan-sampled (left half) and upsampled (right half), parallax imaging (top row) and direct ptychography (bottom row) reconstructions for various materials classes. Scalebars from left to right are 5 Å, 20 Å, 5 nm, and 50 nm respe…

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

3 extracted references · 1 linked inside Pith

  1. [3]

    Ultramicroscopy 180, 173–179

    Electron ptychographic phase imaging of light elements in crystalline materials using Wigner distri- bution deconvolution. Ultramicroscopy 180, 173–179.. https://doi.org/10.1016/j.ultramic.2017.02.006 Yang, H., Pennycook, T.J., Nellist, P .D., 2015. Efficient phase contrast imaging in STEM using a pixelated de- tector. Part II: Optimisation of imaging con...

    doi:10.1016/j.ultramic.2017.02.006 2017

  2. [2017]

    Microscopy and Microanalysis 23, 804–805

    Dose-Efficient Cryo-STEM Imaging of Whole Cells Using the Electron Microscope Pixel Array De- tector. Microscopy and Microanalysis 23, 804–805.. https://doi.org/10.1017/s1431927617004688 Varnavides, G., Ribet, S.M., Ophus, C., 2024. Tilt-Cor- rected BF-STEM. Elemental Microscopy.. https://doi. org/10.69761/xunr2166 Varnavides, G., Ribet, S.M., Zeltmann, S...

    arXiv doi:10.48550/arxiv.2309.05250

  3. [2024]

    Microscopy 74, 98–106

    Dose-efficient phase-contrast imaging of thick weak phase objects via OBF STEM using a pixelated detector. Microscopy 74, 98–106.. https://doi.org/10. 1093/jmicro/dfae051 Ophus, C., 2019. Four-Dimensional Scanning Transmis- sion Electron Microscopy (4D-STEM): From Scanning Nanodiffraction to Ptychography and Beyond. Mi- croscopy and Microanalysis 25, 563–...

    arXiv 2019

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.