Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

Iterating the Transient Light Transport Matrix for Non-Line-of-Sight Imaging

T0 review · 3 major / 4 minor · reviewed 2026-08-11 · deepseek-v4-flash

Pith's one-line read Full measurement of the relay-surface transient light transport matrix lets you compute a second-order matrix for the hidden scene, turning the relay wall into a remote active imaging system.

desk verdict A genuinely new NLOS capability—extracting second-order transient transport from a full relay-surface measurement—backed by plausible math but missing the quantitative ground-truth check that would make the central claim bulletproof. read the letter →

arxiv 2412.10300 v1 pith:N2GKMOVB submitted 2024-12-13 physics.optics cs.CV

classification physics.opticscs.CV
keywords non-line-of-sightimagingtransientlighttransportmatrixSPADarraybeamformingphasorfieldtime-of-flightdualphotographyscenerelighting
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that a single full measurement of the transient light transport matrix (TLTM) of a relay surface—recording, for every illumination position, every detection position, and every time bin, how light returns from a hidden scene—contains enough information to compute a second-order TLTM describing light transport among the hidden surfaces themselves. If true, the relay surface becomes a virtual active imaging system: the hidden scene can be relit under synthesized illumination, direct bounces can be separated from indirect ones, and dual-photography views can be obtained without new hardware. The authors build a 16x16 gated SPAD array system that samples the full first-order TLTM, then use beamforming ideas from phased arrays to focus virtual illumination at chosen hidden-scene points and image the response as a function of time. They demonstrate the three applications experimentally and argue that the same iteration can be pushed to higher-order TLTMs as SPAD arrays grow.

What carries the argument

The load-bearing object is the second-order TLTM and the linear focus-and-image operator that produces it. Equation (3) defines this operator: a projector function $P(\omega)$ carrying a focusing delay $e^{-j\omega\Delta t(\mathbf{x}_p^{(2)})}$ is multiplied into the measured $H(\mathbf{x}_p,\mathbf{x}_c,\omega)$, summed over $\mathbf{x}_p$ to form $P_F(\mathbf{x}_c,\omega)$, then propagated with the spherical phase $e^{-j\omega|\mathbf{x}_c^{(2)}-\mathbf{x}_c|/c}$ and integrated over $\mathbf{x}_c$ and $\omega$. When $\mathbf{x}_c$ lies on a regular planar grid, the inner propagation becomes a convolution and is evaluated with 2D FFTs, giving $O(kN^3\log N)$ per TLTM-2 column. Resolution is set by the Rayleigh criterion $\Delta x = 1.22\lambda_c z/D$, which under Nyquist sampling becomes $\Delta x = 1.22z/(2N)$, so the number of SPAD grid points $N$ ultimately limits how sharply the virtual illumination can be focused. Grid interpolation and a ridge-regression side-lobe-suppression step are used to sharpen the focus with the available array.

What would settle it

Place a moving object, such as a rotating fan, in the hidden scene while the relay surface is scanned, and check whether the computed second-order matrix contains time-inconsistent shadows, ghosting, or artifacts that vary with focus position; any such inconsistency would confirm that the static-scene assumption is the load-bearing premise. A more direct check is to put a physical detector at a computed hidden-surface location and compare its measured transient response with the corresponding TLTM-2 column.

Watch

Extended reading notes

Core claim

The central claim is that the first-order TLTM $H(\mathbf{x}_p,\mathbf{x}_c,t)$ measured on the relay surface can be transformed by a linear operator $f$ into the second-order TLTM $H^{(2)}(\mathbf{x}_p^{(2)},\mathbf{x}_c^{(2)},t)=f(H(\mathbf{x}_p,\mathbf{x}_c,t))$, where $\mathbf{x}_p^{(2)}$ and $\mathbf{x}_c^{(2)}$ are illumination and detection points in the hidden scene. Equation (3) realizes $f$ as a delay-and-sum beamformer in the temporal-frequency domain: it applies a focusing time shift $\Delta t(\mathbf{x}_p^{(2)})$ to the projector, integrates over relay-surface illumination and detection positions with a spherical imaging phase, and inverse-transforms in time. The extracted TLTM-2 preserves complex light transport—shadows, subsurface scattering, caustics, specular reflections—and supports scene relighting, direct/indirect separation by time gating, and dual photography through Helmholtz reciprocity. The experimental system captures the full TLTM-1 with a 16x16 gated SPAD array and a scanned laser, and the paper reports that increasing the number of SPAD pixels is equivalent to increasing exposure time for signal-to-noise ratio.

Load-bearing premise

The hidden scene must remain completely static during the full sequential scan of the relay surface, which takes minutes, because the entire first-order matrix is assembled from rows measured at different times; any motion in the hidden scene invalidates the matrix combination used to extract TLTM-2.

Editorial extensions

If this is right

  • The full first-order TLTM of a relay surface is sufficient to compute the complete second-order TLTM of the hidden scene, so no additional hardware beyond a multi-pixel time-of-flight array is needed for relighting, separation, or dual photography.
  • Hidden scenes can be relit from arbitrary directions by treating individual SPAD pixels as virtual illumination sources, and arbitrary patterns can be projected onto hidden surfaces by optimizing the projector function over space and frequency to create incoherent point sources.
  • Time-gating TLTM-2 separates the direct third-bounce component from indirect higher-bounce components, revealing multi-bounce paths, shadows, and subsurface scattering in the hidden scene.
  • Primal and dual images of the hidden scene are equivalent under Helmholtz reciprocity, and multi-pixel acquisition acquires them faster because more photons are collected in parallel, matching the quality of a longer single-pixel exposure.
  • As SPAD arrays grow, TLTM-2 resolution improves linearly, and the same iteration procedure becomes feasible for extracting TLTM-3, enabling reconstruction around two corners.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The linearity of $f$ means the same beamforming operator could be reapplied to TLTM-2 to get TLTM-3, but each iteration compounds the depth-dependent resolution loss $\Delta x = 1.22z/(2N)$, so two-corner reconstruction would need substantially larger arrays or compressed sensing.
  • The static-scene requirement is a hard practical limit: because the galvanometer scans the relay surface sequentially, any motion in the hidden scene during the multi-minute acquisition corrupts the matrix combination, so dynamic scenes would need motion compensation or simultaneous multi-point illumination.
  • The demonstrated equivalence between pixel count and exposure time suggests acquisition time can be traded against array size, but the data-rate bottleneck will then shift to processing, pointing toward compression of the TLTM as the next constraint.
  • A direct validation of the core claim would be to place a physical detector or light source at a computed hidden-scene point and compare its measured transient response with the corresponding TLTM-2 column, which the paper does not yet report.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper presents a non-line-of-sight (NLOS) imaging system that measures the full first-order transient light transport matrix (TLTM-1) on a relay surface using a gated 16x16 SPAD array and a scanned laser. The central methodological claim is that a linear operator applied to TLTM-1, given by Eq. (3), extracts a second-order TLTM, H^(2)(x_p^(2), x_c^(2), t), for surfaces in the hidden scene by computationally focusing virtual illumination and imaging the response. The authors demonstrate three applications: scene relighting with novel illumination, separation of direct and indirect light transport, and dual photography. They also report an FFT-accelerated algorithm with complexity O(k N^3 log N) for a single column of TLTM-2, and an experiment showing that increasing the number of SPAD pixels can substitute for longer exposure times.

Significance. If the extracted TLTM-2 is a faithful representation of hidden-scene light transport, this work would be a valuable step toward higher-order NLOS light transport analysis and multi-corner imaging. The FFT-based complexity reduction relative to prior virtual light transport matrix work is a concrete algorithmic contribution, and the use of a full 16x16 SPAD array to capture the complete TLTM-1 is a useful hardware demonstration. The supplementary shadow and water-versus-milk experiments are falsifiable checks that go beyond simple 3D reconstruction. However, the central equivalence between Eq. (3) and true hidden-scene transport is not validated against any ground-truth matrix, and the experimental demonstrations are largely qualitative. No code, data, or synthetic test is provided to support the headline claim. The paper is therefore promising but not yet established.

major comments (3)
  1. [Eq. (3), Sec. 6.1, Fig. 4B, Supp. S6] The central claim that TLTM-1 contains sufficient information to compute the full TLTM-2 is not validated. Equation (3) is a composition of a band-limiting projector P(omega), a finite-aperture beamformer, and a diffraction-based imaging step; each of these operations is lossy, as the paper itself acknowledges through the missing-cone discussion and the residual illumination observed in Sec. 6.1. The demonstrations in Fig. 4B and Supp. S6 are qualitative and are consistent with, but do not uniquely require, genuine hidden-scene transport; the same observations could plausibly arise from the PSF and side lobes of the virtual focusing system. I recommend adding a synthetic or laboratory validation in which a hidden scene with known transport properties is simulated or directly measured, and the extracted H^(2) is compared quantitatively against a ground-truth TLTM-2 entry or column.
  2. [Sec. 3.1, Eq. (6), Sec. 7] There is an algebraic error in the resolution derivation. From Eq. (5) with lambda_s = lambda_c/2 and D = N * lambda_s, one obtains Delta_x = 1.22 * lambda_c * z / (N * lambda_c/2) = 2.44 z / N, not 1.22 z / (2 N) as printed in Eq. (6). The Discussion's example (z = 2 m, N = 100, approximately 5 cm resolution) corresponds to Delta_x = 2.44 z / N ≈ 4.9 cm, not to the printed Eq. (6). Please correct Eq. (6) and ensure that all subsequent quantitative statements use the corrected formula.
  3. [Sec. 5, Eq. (3)] The extraction of TLTM-2 assumes that all rows and columns of the measured TLTM-1 are mutually consistent, meaning that the hidden scene and the imaging system remain static over the full sequential acquisition, which takes minutes per dataset as described in Sec. 5. This assumption should be stated explicitly as a limitation and, ideally, validated with a stability check such as repeated measurement of a reference row or column. If the scene or system drifts during acquisition, the linear combination in Eq. (3) does not represent any single light transport state and the resulting TLTM-2 would be physically meaningless.
minor comments (4)
  1. [Sec. 4.3] The sentence 'Helmholtz reciprocity is used to treat each SPAD pixel xp as a virtual illumination source, and each laser position xc is a point on the virtual aperture' appears to reverse the physical roles of detector and illumination; please clarify whether xp and xc are used consistently with their definitions in Eq. (3).
  2. [Supp. S5, Fig. S7] The PSNR growth values are inconsistent between the text (0.186 vs. 0.184) and the figure caption (10.806 vs. 10.236), and no error bars or statistical tests are reported; please unify the numbers and quantify the uncertainty.
  3. [Eq. (3), Supp. S2.2.2] The focusing delay is written as Delta t(x_p^(2)) in Eq. (3), but in Supplement S2.2.2 it depends on both the relay-surface position x_p and the focus point; please make this dependence explicit in the notation.
  4. [Sec. 6.2.2] The sentence 'the test set is used to generate the projector function ... while the test set is used to generate the reconstruction' uses 'test set' twice; one of these should almost certainly be 'training set'.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: TLTM-2 is computed from TLTM-1 by a geometry-derived linear transform, and the validations are independent of the focusing construction.

full rationale

The derivation chain is not circular. Equation (3) defines the second-order TLTM as f(H), where f is a linear delay-and-sum focusing operation over the measured illumination positions followed by a phasor-field diffraction reconstruction over the detection positions; both stages use geometry-derived time delays rather than parameters fitted to the claimed output. The three applications (relighting, direct/indirect separation, dual photography) are post-processing of this transform, but they are validated against known scene geometry and physical effects (the n/W illumination sequence, the vase shadow appearing and disappearing with the vase, and the water-versus-milk scattering difference) that are independent of the focusing construction. The optimized projector functions in Sections 3.1.2 and 6.1.1 use an explicit training/test split, so the reported focusing improvements and projected patterns are not evaluated on the data used to fit the coefficients; the sentence in Section 6.2.2 that says 'test set' twice is evidently a typo, since the parallel passage in Section 6.1.1 correctly states training/test. The paper relies heavily on self-authored prior work for the phasor-field framework, missing-cone analysis, and SPAD hardware, but these are externally published and validated results, not unverified uniqueness claims; no load-bearing argument reduces to a self-citation. The acknowledged limitation that ideal focusing is assumed (Section 6.2.1) and the lack of a ground-truth TLTM-2 comparison are correctness or validation concerns, not circularity.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The central claim rests on the established phasor field framework and standard linear light transport assumptions, plus the practical assumption of a static scene. The only hand-chosen algorithmic parameters are regularization and interpolation settings that affect quality but not the existence of the linear operator. No new physical entities are introduced.

free parameters (5)
  • Central phasor field wavelength lambda_c = 6 cm (typical, set by Nyquist criterion)
    Chosen as twice the SPAD pixel spacing on the relay wall (Section 3.1). It sets the phasor field wavelength and thus the focusing resolution; not fitted to data but a key algorithmic choice.
  • Temporal width sigma of Gaussian projector = 5*lambda_c/c
    Defined in Supplement S2.1, inherited from prior phasor field work [16]. Controls the temporal bandwidth of the virtual illumination.
  • Ridge regularization lambda_R = Not reported
    Used in Eqs. 9 and 14 to prevent overfitting in side-lobe suppression and incoherent focusing. Chosen by hand; no value or sensitivity analysis provided.
  • Grid interpolation factor = Not specified
    Interpolating H along x_p to reduce effective pixel spacing (Section 3.1.1). The interpolation factor is not quantified and affects the claimed resolution improvement.
  • Surface voxel selection threshold (max filter) = Not specified
    In Section 4.1.2, voxels are selected by applying a max filter along depth to isolate a 2D surface. The threshold for including voxels is a processing choice influencing the projected patterns.
assumptions (5)
  • domain assumption Phasor field framework validity: the relay surface can be modeled as a virtual phased array where each point emits a coherent virtual wave that propagates into the hidden scene.
    Invoked throughout Section 3 and Supplement S2; inherited from prior work [16,22,23] by the same group and others. The entire TLTM-2 extraction rests on this model.
  • domain assumption The hidden scene remains static during the full sequential acquisition of TLTM-1.
    Implicit in Section 5 (Hardware): the galvanometer scans the relay surface sequentially over minutes, so the scene must not change during the measurement for the matrix to be consistent.
  • standard math Light transport is linear and time-invariant.
    Standard assumption used throughout the TLTM formalism and the linear operator f in Eq. 1.
  • standard math Helmholtz reciprocity holds for the relay surface and hidden scene.
    Used in Section 4.3 and Supplement S5.1 to relate primal and dual images; standard but only approximate for non-Lambertian surfaces.
  • domain assumption A planar relay surface with a regular grid is available for FFT acceleration; when the grid is irregular, a slower backprojection is used.
    Section S3 relies on a regular grid for Fourier-based convolution; the paper compensates for the actual SPAD grid's non-uniformity and holes with interpolation and side-lobe suppression.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Iterating the Transient Light Transport Matrix for Non-Line-of-Sight Imaging." pith.science (2026). https://pith.science/paper/N2GKMOVB

@misc{pith2026241210300,
  author       = {Pith},
  title        = {Pith review of: Iterating the Transient Light Transport Matrix for Non-Line-of-Sight Imaging},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/N2GKMOVB}},
  note         = {Machine review of arXiv:2412.10300}
}
read the original abstract

Active imaging systems sample the Transient Light Transport Matrix (TLTM) for a scene by sequentially illuminating various positions in this scene using a controllable light source, and then measuring the resulting spatiotemporal light transport with time of flight (ToF) sensors. Time-resolved Non-line-of-sight (NLOS) imaging employs an active imaging system that measures part of the TLTM of an intermediary relay surface, and uses the indirect reflections of light encoded within this TLTM to "see around corners". Such imaging systems have applications in diverse areas such as disaster response, remote surveillance, and autonomous navigation. While existing NLOS imaging systems usually measure a subset of the full TLTM, development of customized gated Single Photon Avalanche Diode (SPAD) arrays \cite{riccardo_fast-gated_2022} has made it feasible to probe the full measurement space. In this work, we demonstrate that the full TLTM on the relay surface can be processed with efficient algorithms to computationally focus and detect our illumination in different parts of the hidden scene, turning the relay surface into a second-order active imaging system. These algorithms allow us to iterate on the measured, first-order TLTM, and extract a \textbf{second order TLTM for surfaces in the hidden scene}. We showcase three applications of TLTMs in NLOS imaging: (1) Scene Relighting with novel illumination, (2) Separation of direct and indirect components of light transport in the hidden scene, and (3) Dual Photography. Additionally, we empirically demonstrate that SPAD arrays enable parallel acquisition of photons, effectively mitigating long acquisition times.

Figures

Figures reproduced from arXiv: 2412.10300 by the authors.

Figure 1
Figure 1. Emerging SPAD arrays enable the capture of the full Transient Light Transport Matrix (TLTM) of the Relay Surface in Non-Line-of-Imaging. Fast computational algorithms iterate on the TLTM and extract the second-order TLTM of the hidden scene around the corner. This is accomplished by computationally focusing our illumination on different parts of the hidden scene and then computing the corresponding spatiotemporal li… view at source ↗
Figure 2
Figure 2. (A) Active Imaging System for measuring Transient Light Transport Matrix, which contains information about (i) Diffuse reflections (ii), specular reflections, and (iii) indirect components of Light Transport. (B) Non-line-of-sight Imaging System using Time of flight detectors is an active imaging system that measures the TLTM of the relay surface. (C) Existing acquisition schemes - Confocal and Non-Confocal - captur… view at source ↗
Figure 3
Figure 3. Our NLOS imaging system consisting of laser, galvanometer, and SPAD Array. The right figure shows the SPAD pixels focused on the relay surface for large field of view, mimicking a virtual phased array system at the relay wall. 4.3 Dual Photography and Denoising In the phasor field framework, Helmholtz reciprocity is used to treat each SPAD pixel xp is treated as a virtual illumination source, and each laser position… view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: (A) Hidden scene shown on the left. The non-transient, 3D reconstruction generated is shown in the middle (front view) and on the right (3D view). (B) We display 3 columns of TLTM-2 for three locations in the hidden scene from Panel(A). Row 1, 2, and 3 show the impact …
Figure 5
Figure 5. Figure 5: (A) The left image shows the hidden scene while the middle image rough location for the illumination on the relay surface. The image on the right shows the front view of the 3D light field. Each single image is generated by averaging reconstructions over a 4x4 subgroup…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Optimized Sampling for Non-Line-of-Sight Imaging Using Modified Fast Fourier Transforms

    eess.IV 2025-01 conditional novelty 6.0 of 10

    Scaled and non-uniform FFT variants of the Rayleigh-Sommerfeld diffraction algorithm reconstruct NLOS scenes with flexible sampling grids and depth-dependent voxel sizes at FFT-level complexity.

Reference graph

Works this paper leans on

54 extracted references · 45 canonical work pages · cited by 1 Pith paper

  1. [1]

    Fast-Gated 16 16 SPAD Array with 16 on-chip 6 ps Time-to-Digital Converters for Non-Line-of-Sight Imaging,

    S. Riccardo, E, Conca, V. Sesta, A. Velten, and A. Tosi, “Fast-Gated 16 16 SPAD Array with 16 on-chip 6 ps Time-to-Digital Converters for Non-Line-of-Sight Imaging,” IEEE Sensors Journal , pp. 1–1, 2022. 2, 3, 4, 5, 10

  2. [2]

    O’Toole, Optical linear algebra for computational light transport

    M. O’Toole, Optical linear algebra for computational light transport . University of Toronto (Canada), 2016. 3, 5

  3. [3]

    Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport,

    M. O’Toole, F. Heide, L. Xiao, M. B. Hullin, W. Heidrich, and K. N. Kutulakos, “Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport,” ACM Trans. Graph., vol. 33, no. 4, pp. 87:1–87:11, Jul

  4. [4]

    Synthetic lighting for photography,

    H. Paul, “Synthetic lighting for photography,” http://www. graficaobscura. com/synth/index. html , 1992. 3, 5

  5. [5]

    Fast separation of direct and global components of a scene using high frequency illumination,

    S. K. Nayar, G. Krishnan, M. D. Grossberg, and R. Raskar, “Fast separation of direct and global components of a scene using high frequency illumination,” ACM Transactions on Graphics, vol. 25, no. 3, pp. 935–944, Jul

  6. [6]

    Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging,

    A. Velten, T. Willwacher, O. Gupta, A. Veeraraghavan, M. G. Bawendi, and R. Raskar, “Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging,” Nature Communications , vol. 3, p. 745, Mar. 2012. [Online]. Available: https://www.nature.com/articles/ncomms1747 3, 4, 5, 1

  7. [7]

    Time-gated single-photon detection module with 110 ps transition time and up to 80 MHz repetition rate,

    M. Buttafava, G. Boso, A. Ruggeri, A. Dalla Mora, and A. Tosi, “Time-gated single-photon detection module with 110 ps transition time and up to 80 MHz repetition rate,” Review of Scientific Instruments , vol. 85, no. 8, p. 083114, Aug. 2014, publisher: American Institute of Physics. [Online]. Available: https://aip.scitation.org/doi/10.1063/1.4893385 3

  8. [8]

    Non-line-of-sight imaging,

    D. Faccio, A. Velten, and G. Wetzstein, “Non-line-of-sight imaging,” Nature Reviews Physics , vol. 2, no. 6, pp. 318–327, Jun. 2020, number: 6 Publisher: Nature Publishing Group. [Online]. Available: https://www.nature.com/articles/s42254-020-0174-8 3

Show all 54 references
  1. [9]

    Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,

    X. Liu, S. Bauer, and A. Velten, “Phasor field diffraction based reconstruction for fast non-line-of-sight imaging systems,” Nature Communications, vol. 11, no. 1, pp. 1–13, Apr. 2020, number: 1 Publisher: Nature Publishing Group. [Online]. Available: https://www.nature.com/ar...

  2. [10]

    Non-line-of-sight imaging using a time-gated single photon avalanche diode,

    M. Buttafava, J. Zeman, A. Tosi, K. Eliceiri, and A. Velten, “Non-line-of-sight imaging using a time-gated single photon avalanche diode,” Optics Express , vol. 23, no. 16, pp. 20 997–21 011, Aug. 2015. [Online]. Available: https://www.osapublishing.org/oe/abstract.cfm?uri=oe-...

  3. [11]

    Fast-Gated 16 1 SPAD Array for Non-Line-of-Sight Imaging Applications,

    M. Renna, J. H. Nam, M. Buttafava, F. Villa, A. Velten, and A. Tosi, “Fast-Gated 16 1 SPAD Array for Non-Line-of-Sight Imaging Applications,” Instruments, vol. 4, no. 2, p. 14, Jun. 2020, number: 2 Publisher: Multidisciplinary Digital Publishing Institute. [Online]. Available:...

  4. [12]

    A Gradient-Gated SPAD Array for Non-Line-of-Sight Imaging,

    J. Zhao, F. Gramuglia, P. Keshavarzian, E.-H. Toh, M. Tng, L. Lim, V. Dhulla, E. Quek, M.-J. Lee, and E. Charbon, “A Gradient-Gated SPAD Array for Non-Line-of-Sight Imaging,”IEEE Journal of Selected Topics in Quantum Electronics, pp. 1–10, 2023, conference Name: IEEE Journal o...

  5. [13]

    Recent Advances in Imaging Around Corners,

    T. Maeda, G. Satat, T. Swedish, L. Sinha, and R. Raskar, “Recent Advances in Imaging Around Corners,” Oct. 2019, arXiv:1910.05613 [cs, eess]. [Online]. Available: http://arxiv.org/abs/1910.05613 3

  6. [14]

    Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes,

    R. Geng, Y. Hu, and Y. Chen, “Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes,” APSIPA Transactions on Signal and Information Processing , vol. 11, no. 1,

  7. [15]

    Wave-based non-line-of-sight imaging using fast f-k migration,

    D. B. Lindell, G. Wetzstein, and M. O’Toole, “Wave-based non-line-of-sight imaging using fast f-k migration,” ACM Transactions on Graphics , vol. 38, no. 4, pp. 1–13, Aug. 2019. [Online]. Available: https://dl.acm.org/doi/10.1145/3306346.3322937 4

  8. [16]

    Non-line-of-sight imaging using phasor-field virtual wave optics,

    X. Liu, I. Guilln, M. La Manna, J. H. Nam, S. A. Reza, T. Huu Le, A. Jarabo, D. Gutierrez, and A. Velten, “Non-line-of-sight imaging using phasor-field virtual wave optics,” Nature, vol. 572, no. 7771, pp. 620–623, Aug. 2019, number: 7771 Publisher: Nature Publishing Group. [O...

  9. [17]

    Non-line-of-sight-imaging using dynamic relay surfaces,

    M. L. Manna, J.-H. Nam, S. A. Reza, A. Velten, and A. Velten, “Non-line-of-sight-imaging using dynamic relay surfaces,” Optics Express, vol. 28, no. 4, pp. 5331–5339, Feb. 2020, publisher: Optica Publishing Group. [Online]. Available: https://opg.optica.org/oe/abstract.cfm?uri...

  10. [18]

    Non-line-of-sight imaging with arbitrary illumination and detection pattern,

    X. Liu, J. Wang, L. Xiao, Z. Shi, X. Fu, and L. Qiu, “Non-line-of-sight imaging with arbitrary illumination and detection pattern,” Nature Communications , vol. 14, no. 1, p. 3230, Jun. 2023. [Online]. Available: https://www.nature.com/articles/s41467-023-38898-4 4

  11. [19]

    Dynamic non-line-of-sight imaging system based on the optimization of point spread functions,

    C. Pei, A. Zhang, Y. Deng, F. Xu, J. Wu, D. U.-L. Li, H. Qiao, L. Fang, and Q. Dai, “Dynamic non-line-of-sight imaging system based on the optimization of point spread functions,” Optics Express , vol. 29, no. 20, pp. 32 349–32 364, Sep. 2021, publisher: Optica Publishing Grou...

  12. [20]

    Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second,

    J. H. Nam, E. Brandt, S. Bauer, X. Liu, M. Renna, A. Tosi, E. Sifakis, and A. Velten, “Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second,” Nature Communications , vol. 12, no. 1, p. 6526, Dec. 2021. [Online]. Available: https://www.nature.com/articles...

  13. [21]

    Virtual Mirrors: Non-Line-of-Sight Imaging Beyond the Third Bounce,

    D. Royo, T. Sultan, A. Muoz, K. Masumnia-Bisheh, E. Brandt, D. Gutierrez, A. Velten, and J. Marco, “Virtual Mirrors: Non-Line-of-Sight Imaging Beyond the Third Bounce,” ACM Transactions on Graphics, vol. 42, no. 4, pp. 140:1–140:15, Jul. 2023. [Online]. Available: https://dl.a...

  14. [22]

    Phasor field waves: A Huygens-like light transport model for non-line-of-sight imaging applications,

    S. A. Reza, M. L. Manna, S. Bauer, A. Velten, and A. Velten, “Phasor field waves: A Huygens-like light transport model for non-line-of-sight imaging applications,” Optics Express , vol. 27, no. 20, pp. 29 380–29 400, Sep. 2019, publisher: Optical Society of America. [Online]. ...

  15. [23]

    Phasor field waves: a mathematical treatment,

    J. A. Teichman, “Phasor field waves: a mathematical treatment,” Optics Express , vol. 27, no. 20, pp. 27 500–27 506, Sep. 2019, publisher: Optical Society of America. [Online]. Available: https: //www.osapublishing.org/oe/abstract.cfm?uri=oe-27-20-27500 4, 2

  16. [24]

    Paraxial theory of phasor-field imaging,

    J. Dove and J. H. Shapiro, “Paraxial theory of phasor-field imaging,” Optics Express, vol. 27, no. 13, pp. 18 016– 18 037, Jun. 2019. [Online]. Available: https://www.osapublishing.org/oe/abstract.cfm?uri=oe-27-13-18016 4, 6

  17. [25]

    Paraxial phasor-field physical optics,

    ——, “Paraxial phasor-field physical optics,” Optics Express , vol. 28, no. 14, pp. 21 095–21 109, Jul. 2020, publisher: Optical Society of America. [Online]. Available: https://www.osapublishing.org/oe/abstract.cfm? uri=oe-28-14-21095 4, 6

  18. [26]

    Nonparaxial phasor-field propagation,

    ——, “Nonparaxial phasor-field propagation,” Optics Express , vol. 28, no. 20, pp. 29 212–29 229, Sep. 2020, publisher: Optical Society of America. [Online]. Available: https://www.osapublishing.org/oe/abstract.cfm? uri=oe-28-20-29212 4

  19. [27]

    Speckled speckled speckle,

    ——, “Speckled speckled speckle,” Optics Express, vol. 28, no. 15, pp. 22 105–22 120, Jul. 2020, publisher: Optical Society of America. [Online]. Available: https://www.osapublishing.org/oe/abstract.cfm?uri=oe-28-15-22105 4

  20. [28]

    Theory of phasor-field imaging,

    J. J. M. Dove, “Theory of phasor-field imaging,” Ph.D. dissertation, Massachusetts Institute of Technology, 2020. 4, 2

  21. [29]

    Phasor field waves: experimental demonstrations of wave-like properties,

    S. A. Reza, M. La Manna, S. Bauer, and A. Velten, “Phasor field waves: experimental demonstrations of wave-like properties,” Optics Express , vol. 27, no. 22, p. 32587, Oct. 2019. [Online]. Available: https://www.osapublishing.org/abstract.cfm?URI=oe-27-22-32587 4, 2

  22. [30]

    Towards a more accurate light transport model for non-line-of-sight imaging,

    T. Sultan, S. A. Reza, and A. Velten, “Towards a more accurate light transport model for non-line-of-sight imaging,” Optics Express , vol. 32, no. 5, pp. 7731–7761, Feb. 2024, publisher: Optica Publishing Group. [Online]. Available: https://opg.optica.org/oe/abstract.cfm?uri=o...

  23. [31]

    Analysis of Feature Visibility in Non-Line-Of-Sight Measurements,

    X. Liu, S. Bauer, and A. Velten, “Analysis of Feature Visibility in Non-Line-Of-Sight Measurements,” in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Long Beach, CA, USA: IEEE, Jun. 2019, pp. 10 132–10 140. [Online]. Available: https://ieeexplore...

  24. [32]

    Low-budget transient imaging using photonic mixer devices,

    F. Heide, M. B. Hullin, J. Gregson, and W. Heidrich, “Low-budget transient imaging using photonic mixer devices,” ACM Transactions on Graphics , vol. 32, no. 4, pp. 1–10, Jul. 2013. [Online]. Available: https://dl.acm.org/doi/10.1145/2461912.2461945 4

  25. [33]

    Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors,

    F. Heide, L. Xiao, W. Heidrich, and M. B. Hullin, “Diffuse Mirrors: 3D Reconstruction from Diffuse Indirect Illumination Using Inexpensive Time-of-Flight Sensors,” in 2014 IEEE Conference on Computer Vision and Pattern Recognition . Columbus, OH, USA: IEEE, Jun. 2014, pp. 3222...

  26. [34]

    Becker, Advanced time-correlated single photon counting techniques , ser

    W. Becker, Advanced time-correlated single photon counting techniques , ser. Springer series in chemical physics. Berlin ; New York: Springer, 2005, no. 81, oCLC: ocm61320823. 4, 10

  27. [35]

    Robust Monte Carlo Methods For Light Transport Simulation,

    E. Veach, “Robust Monte Carlo Methods For Light Transport Simulation,” PhD thesis, Stanford University , Dec. 1997. 4 17

  28. [36]

    Dual Photography,

    P. Sen, B. Chen, G. Garg, S. R. Marschner, M. Horowitz, M. Levoy, and H. P. A. Lensch, “Dual Photography,” in ACM SIGGRAPH 2005 Papers , ser. SIGGRAPH ’05. New York, NY, USA: ACM, 2005, pp. 745–755. [Online]. Available: http://doi.acm.org/10.1145/1186822.1073257 4, 5, 10

  29. [37]

    Fast Non-line-of-sight Imaging with Non- planar Relay Surfaces,

    C. Gu, T. Sultan, K. Masumnia-Bisheh, L. Waller, and A. Velten, “Fast Non-line-of-sight Imaging with Non- planar Relay Surfaces,” in 2023 IEEE International Conference on Computational Photography (ICCP) , Jul. 2023, pp. 1–12, iSSN: 2472-7636. 4, 7, 3

  30. [38]

    The post-processing of ultrasonic array data using the total focusing method,

    C. Holmes, B. Drinkwater, and P. Wilcox, “The post-processing of ultrasonic array data using the total focusing method,” Insight - Non-Destructive Testing and Condition Monitoring , vol. 46, no. 11, pp. 677–680, Nov. 2004. 5

  31. [39]

    Li and P

    J. Li and P. Stoica, MIMO Radar Signal Processing . John Wiley & Sons, Oct. 2008. 5

  32. [40]

    Defect detection using ultrasonic arrays: The multi-mode total focusing method,

    J. Zhang, B. W. Drinkwater, P. D. Wilcox, and A. J. Hunter, “Defect detection using ultrasonic arrays: The multi-mode total focusing method,” NDT & E International , vol. 43, no. 2, pp. 123–133, Mar. 2010. [Online]. Available: https://www.sciencedirect.com/science/article/pii/...

  33. [41]

    L. W. Schmerr, Fundamentals of ultrasonic phased arrays , ser. Solid mechanics and its applications. Cham Heidelberg: Springer, 2015, no. 215. 5, 7, 3

  34. [42]

    Beamforming: a versatile approach to spatial filtering,

    B. Van Veen and K. Buckley, “Beamforming: a versatile approach to spatial filtering,” IEEE ASSP Magazine , vol. 5, no. 2, pp. 4–24, Apr. 1988, conference Name: IEEE ASSP Magazine. 5

  35. [43]

    Primal-dual coding to probe light transport,

    M. O’Toole, R. Raskar, and K. N. Kutulakos, “Primal-dual coding to probe light transport,” ACM Transactions on Graphics , vol. 31, no. 4, pp. 39:1–39:11, Jul. 2012. [Online]. Available: https://doi.org/10.1145/2185520.2185535 5

  36. [44]

    Kernel Nystrm method for light transport,

    J. Wang, Y. Dong, X. Tong, Z. Lin, and B. Guo, “Kernel Nystrm method for light transport,” in ACM SIGGRAPH 2009 papers , ser. SIGGRAPH ’09. New York, NY, USA: Association for Computing Machinery, Jul. 2009, pp. 1–10. [Online]. Available: https://dl.acm.org/doi/10.1145/1576246....

  37. [45]

    Optical computing for fast light transport analysis,

    M. O’Toole and K. N. Kutulakos, “Optical computing for fast light transport analysis,” ACM Transactions on Graphics , vol. 29, no. 6, pp. 164:1–164:12, Dec. 2010. [Online]. Available: https: //dl.acm.org/doi/10.1145/1882261.1866165 5

  38. [46]

    Virtual Light Transport Matrices for Non-Line-of-Sight Imaging,

    J. Marco, A. Jarabo, J. H. Nam, X. Liu, M. . Cosculluela, A. Velten, and D. Gutierrez, “Virtual Light Transport Matrices for Non-Line-of-Sight Imaging,” in 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Oct. 2021, pp. 2420–2429, iSSN: 2380-7504. 5, 9, 4

  39. [47]

    J. W. Goodman, Introduction to Fourier optics , 3rd ed. Englewood, Colo: Roberts & Co, 2005, oCLC: ocm56632414. 6, 1

  40. [48]

    Hecht, Optics, 5th ed

    E. Hecht, Optics, 5th ed. Boston: Pearson Education, Inc, 2017. 6

  41. [49]

    Ring and Radius Sampling Based Phasor Field Diffraction Algorithm for Non-Line-of-Sight Reconstruction,

    D. Jiang, X. Liu, J. Luo, Z. Liao, A. Velten, and X. Lou, “Ring and Radius Sampling Based Phasor Field Diffraction Algorithm for Non-Line-of-Sight Reconstruction,” IEEE Transactions on Pattern Analysis and Ma- chine Intelligence , vol. 44, no. 11, pp. 7841–7853, Nov. 2022, con...

  42. [50]

    FPGA Accelerator for Real-Time Non-Line-of-Sight Imaging,

    Z. Liao, D. Jiang, X. Liu, A. Velten, Y. Ha, and X. Lou, “FPGA Accelerator for Real-Time Non-Line-of-Sight Imaging,” IEEE Transactions on Circuits and Systems I: Regular Papers , vol. 69, no. 2, pp. 721–734, Feb. 2022, conference Name: IEEE Transactions on Circuits and Systems...

  43. [54]

    Second, we demonstrate the difference in scattering properties of water and milk when these are placed in the hidden scene

    First, we show how focusing on the virtual illumination helps reveal shadows in higher-order bounces. Second, we demonstrate the difference in scattering properties of water and milk when these are placed in the hidden scene. S6.1 Complex Light Transport: 4th Bounce Shadow In ...

  44. [2006]

    Available: https://doi.org/10.1145/1141911.1141977 3, 5

    [Online]. Available: https://doi.org/10.1145/1141911.1141977 3, 5

  45. [2014]

    Available: http://doi.acm.org/10.1145/2601097.2601103 3, 5

    [Online]. Available: http://doi.acm.org/10.1145/2601097.2601103 3, 5

  46. [2022]

    Available: http://www.nowpublishers.com/article/Details/SIP-2021-0019 3

    [Online]. Available: http://www.nowpublishers.com/article/Details/SIP-2021-0019 3

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.