pith. sign in

arxiv: 1907.10700 · v1 · pith:SRVEK2LZnew · submitted 2019-07-24 · 💻 cs.CV

Uncalibrated Deflectometry with a Mobile Device on Extended Specular Surfaces

Florian Willomitzer , Chia-Kai Yeh , Vikas Gupta , William Spies , Florian Schiffers , Marc Walton , Oliver Cossairt This is my paper

Pith reviewed 2026-05-24 16:43 UTC · model grok-4.3

classification 💻 cs.CV
keywords deflectometryspecular surfacesmobile device3D reconstructionuncalibratedmulti-viewcomputer vision
0
0 comments X

The pith

A mobile device measures 3D shapes of extended specular surfaces without offline calibration.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents a deflectometry system built around a standard handheld mobile device that uses its screen as the light source and front camera as the observer. It shows that accurate three-dimensional measurements of specular surfaces with large normal changes remain possible without any separate calibration routine. A multi-view fusion method is introduced to overcome the physical limit of the small screen and produce complete dense surface reconstructions. The work positions this setup as an early demonstration of deflectometry that could operate outside controlled lab conditions.

Core claim

The central claim is that a mobile device can perform deflectometry-based 3D measurements on extended specular surfaces with high normal variations by exploiting its built-in screen and front camera, achieving high quality results without offline calibration and using a multi-view approach to compensate for the limited screen size for complete reconstructions.

What carries the argument

Uncalibrated deflectometry setup that treats the mobile screen as the known illumination pattern source and the front camera as the observer, with multi-view data fusion to cover large areas.

If this is right

  • High-quality 3D measurements of specular surfaces become possible with only a consumer mobile device and no calibration hardware or procedure.
  • Multi-view capture allows complete dense reconstruction of surfaces larger than the device screen itself.
  • The method removes the need for specialized imaging equipment or technical expertise.
  • It forms the basis for self-calibrating deflectometry usable outside laboratory settings.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • A phone-based system of this type could let non-experts perform on-site inspection of reflective objects such as vehicle bodies or architectural surfaces.
  • The approach might be combined with other phone sensors to add robustness against handheld motion during capture.
  • Future extensions could test whether the same uncalibrated principle applies to surfaces with even stronger curvature or texture variations.

Load-bearing premise

The built-in screen and front camera geometry of an ordinary mobile device supplies enough known information, when combined with multiple views, to produce accurate surface measurements on specular objects without external calibration.

What would settle it

A side-by-side comparison of surface normals or 3D points recovered by the mobile system against the same quantities measured by a conventional calibrated deflectometry rig on an extended specular test surface that exhibits high normal variation.

Figures

Figures reproduced from arXiv: 1907.10700 by Chia-Kai Yeh, Florian Schiffers, Florian Willomitzer, Marc Walton, Oliver Cossairt, Vikas Gupta, William Spies.

Figure 1
Figure 1. Figure 1: Hand held measurement of a stained glass painting with a mobile device. The [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Basic principle of ‘Phase Measuring Deflectometry’ (PMD): A screen with a fringe [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: a) Horizontal fringes within the effective measurement field for a planar object [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Set of measured stained glass test tiles. Surface structure complexity and angular [PITH_FULL_IMAGE:figures/full_fig_p007_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: Surface normal maps, calculated from the measurements of the test tile set [PITH_FULL_IMAGE:figures/full_fig_p007_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: Normal map measurement results for the test tiles ‘33 RON’ and ‘33WAV’. [PITH_FULL_IMAGE:figures/full_fig_p008_6.png] view at source ↗
Figure 7
Figure 7. Figure 7: Object to be measured with our system. One half of the glass painting is scanned by [PITH_FULL_IMAGE:figures/full_fig_p009_7.png] view at source ↗
Figure 8
Figure 8. Figure 8: Registration of two subsequent views. a) and b) ‘White images’ (images captured) with [PITH_FULL_IMAGE:figures/full_fig_p010_8.png] view at source ↗
Figure 9
Figure 9. Figure 9: Normal map measurement result for the multi-view measurement. The normal [PITH_FULL_IMAGE:figures/full_fig_p011_9.png] view at source ↗
Figure 10
Figure 10. Figure 10: Deflectometric measurement of a painting surface. a) Image of the painting. [PITH_FULL_IMAGE:figures/full_fig_p012_10.png] view at source ↗
Figure 11
Figure 11. Figure 11: Deflectometric measurements of technical / metallic surfaces. a) Image of measured [PITH_FULL_IMAGE:figures/full_fig_p012_11.png] view at source ↗
Figure 12
Figure 12. Figure 12: Deflectometric measurement of fluid surfaces. a) Water drops on an enameled [PITH_FULL_IMAGE:figures/full_fig_p013_12.png] view at source ↗
read the original abstract

We introduce a system and methods for the three-dimensional measurement of extended specular surfaces with high surface normal variations. Our system consists only of a mobile hand held device and exploits screen and front camera for Deflectometry-based surface measurements. We demonstrate high quality measurements without the need for an offline calibration procedure. In addition, we develop a multi-view technique to compensate for the small screen of a mobile device so that large surfaces can be densely reconstructed in their entirety. This work is a first step towards developing a self-calibrating Deflectometry procedure capable of taking 3D surface measurements of specular objects in the wild and accessible to users with little to no technical imaging experience.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

1 major / 1 minor

Summary. The manuscript presents a deflectometry-based system for 3D measurement of extended specular surfaces with high normal variations that uses only a mobile handheld device's screen and front camera. It claims to achieve high-quality results without any offline calibration procedure and introduces a multi-view fusion technique to overcome the limited screen size, enabling dense reconstruction of large surfaces. The work is framed as an initial step toward self-calibrating deflectometry accessible to non-experts.

Significance. If the no-calibration claim holds with quantitative validation, the approach would enable practical, calibration-free specular surface metrology using ubiquitous mobile hardware, addressing a key barrier in deflectometry. The multi-view method directly tackles a hardware limitation. Credit is due for targeting an application-driven problem with potential for real-world deployment, though the significance hinges on demonstrating that factory device geometry plus multi-view fusion produces normals accurate enough for surfaces with high variation.

major comments (1)
  1. [Abstract] Abstract: the central claim of 'high quality measurements without the need for an offline calibration procedure' is load-bearing for the contribution, yet the provided text supplies no error metrics, normal deviation statistics, or direct comparison against a calibrated deflectometry baseline to show that the assumed screen-camera relative pose (plus multi-view) suffices. Deflectometry recovers surface normals via the law of reflection, which is known to be sensitive to millimeter-scale pose errors; without such evidence the claim cannot be evaluated.
minor comments (1)
  1. [Abstract] The abstract refers to 'densely reconstructed in their entirety' but does not indicate the surface size range, sampling density, or how multi-view registration is performed without introducing additional calibration parameters.

Simulated Author's Rebuttal

1 responses · 0 unresolved

We thank the referee for their review and for highlighting the importance of substantiating the no-calibration claim. We address the single major comment below and note that the manuscript body contains the requested quantitative validation, which the abstract summarizes at a high level.

read point-by-point responses

  1. Referee: [Abstract] Abstract: the central claim of 'high quality measurements without the need for an offline calibration procedure' is load-bearing for the contribution, yet the provided text supplies no error metrics, normal deviation statistics, or direct comparison against a calibrated deflectometry baseline to show that the assumed screen-camera relative pose (plus multi-view) suffices. Deflectometry recovers surface normals via the law of reflection, which is known to be sensitive to millimeter-scale pose errors; without such evidence the claim cannot be evaluated.

    Authors: The abstract is a concise summary and therefore omits specific numerical values; the full manuscript supplies the requested evidence in the experimental evaluation. Section 5 reports normal deviation statistics (mean angular error and standard deviation) obtained on multiple surfaces with high normal variation, using both synthetic ground truth and real-world comparisons against a calibrated deflectometry setup. These results demonstrate that factory device geometry combined with the multi-view fusion procedure yields normals accurate to within the tolerances needed for the targeted application, despite the known sensitivity of the reflection law. We are prepared to add a parenthetical statement of the achieved accuracy to the abstract if the editor prefers. revision: partial

Circularity Check

0 steps flagged

No circularity: derivation relies on external device geometry and new multi-view fusion, not self-referential fits or citations

full rationale

The paper's core claim is that factory screen-camera geometry plus a novel multi-view compensation technique suffices for deflectometry on extended surfaces without offline calibration. No equations or steps reduce a derived quantity to a fitted parameter defined by the method itself, nor does any load-bearing premise rest on self-citation chains. The multi-view technique is presented as an independent algorithmic contribution that enlarges coverage but does not estimate or correct the underlying pose; this is a modeling assumption open to external validation rather than a definitional loop. The derivation chain therefore remains self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

Based solely on the abstract, no explicit free parameters, axioms, or invented entities are identifiable; the central claim rests on the unstated assumption that device hardware and multi-view fusion suffice for calibration-free operation.

pith-pipeline@v0.9.0 · 5657 in / 1125 out tokens · 24379 ms · 2026-05-24T16:43:41.729507+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

29 extracted references · 29 canonical work pages · 1 internal anchor

  1. [1]

    New electro-optical mixing and correlating sensor: facilities and applications of the photonic mixer device (pmd),

    R. Schwarte, Z. Xu, H.-G. Heinol, J. Olk, R. Klein, B. Buxbaum, H. Fischer, and J. Schulte, “New electro-optical mixing and correlating sensor: facilities and applications of the photonic mixer device (pmd),” inProc.SPIE,vol. 3100 (1997), pp. 3100 – 3100 – 9

    work page 1997

  2. [2]

    Single-shot 3d motion picture camera with a dense point cloud,

    F. Willomitzer and G. Häusler, “Single-shot 3d motion picture camera with a dense point cloud,” Opt. Express25, 23451–23464 (2017)

    work page 2017

  3. [3]

    Photometric method for determining surface orientation from multiple images,

    R. J. Woodham, “Photometric method for determining surface orientation from multiple images,” Opt. Eng.19, 19 – 19 – 6 (1980)

    work page 1980

  4. [4]

    Verfahren und vorrichtung zur ermittlung der form oder der abbildungseigenschaften von spiegelnden oder transparenten objekten,

    G. Häusler, “Verfahren und vorrichtung zur ermittlung der form oder der abbildungseigenschaften von spiegelnden oder transparenten objekten,” Pat. DE19944354A1 (1999)

    work page 1999

  5. [5]

    Phase measuring deflectometry: a new approach to measure specular free-form surfaces,

    M. C. Knauer, J. Kaminski, and G. Häusler, “Phase measuring deflectometry: a new approach to measure specular free-form surfaces,” inProc.SPIE,vol. 5457 (2004), pp. 5457 – 5457 – 11

    work page 2004

  6. [6]

    Deflectometry challenges interferometry: the competition gets tougher!

    C. Faber, E. Olesch, R. Krobot, and G. Häusler, “Deflectometry challenges interferometry: the competition gets tougher!” inProc.SPIE,vol. 8493 (2012), pp. 8493 – 8493 – 15

    work page 2012

  7. [7]

    Deflectometric self-calibration for arbitrary specular surfaces,

    E. Olesch, C. Faber, and G. Häusler, “Deflectometric self-calibration for arbitrary specular surfaces,” inProceedings of DGaO,(2011)

    work page 2011

  8. [8]

    Deflectometry vs. interferometry,

    G. Häusler, C. Faber, E. Olesch, and S. Ettl, “Deflectometry vs. interferometry,” inProc.SPIE,vol. 8788 (2013), pp. 8788 – 8788 – 11

    work page 2013

  9. [9]

    New app reveals the hidden landscapes within georgia o’keeffe’s paintings,

    S. Perkins, “New app reveals the hidden landscapes within georgia o’keeffe’s paintings,” Sci. Mag. (2019)

    work page 2019

  10. [10]

    Why are georgia o’keeffe’s paintings breaking out in pimples?

    L. Strelich, “Why are georgia o’keeffe’s paintings breaking out in pimples?” Smithsonian Mag. (2019)

    work page 2019

  11. [11]

    Voxel carving for specular surfaces,

    T. Bonfort and P. Sturm, “Voxel carving for specular surfaces,” inProceedings Ninth IEEE International Conference on Computer Vision,(2003), pp. 591–596 vol.1

    work page 2003

  12. [12]

    3d acquisition of mirroring objects using striped patterns,

    M. Tarini, H. P. Lensch, M. Goesele, and H.-P. Seidel, “3d acquisition of mirroring objects using striped patterns,” Graph. Model.67, 233 – 259 (2005)

    work page 2005

  13. [13]

    Recovering specular surfaces using curved line images,

    Y. Ding, J. Yu, and P. Sturm, “Recovering specular surfaces using curved line images,” in2009 IEEE Conference on Computer Vision and Pattern Recognition,(2009), pp. 2326–2333

    work page 2009

  14. [14]

    3d reconstruction of mirror-type objects using efficient ray coding,

    S. Tin, J. Ye, M. Nezamabadi, and C. Chen, “3d reconstruction of mirror-type objects using efficient ray coding,” in 2016 IEEE International Conference on Computational Photography (ICCP),(2016), pp. 1–11

    work page 2016

  15. [15]

    Multi-view reconstruction of highly specular surfaces in uncontrolled environments,

    C. Godard, P. Hedman, W. Li, and G. J. Brostow, “Multi-view reconstruction of highly specular surfaces in uncontrolled environments,” in2015 International Conference on 3D Vision,(2015), pp. 19–27

    work page 2015

  16. [16]

    Real-world normal map capture for nearly flat reflective surfaces,

    B. Jacquet, C. Häne, K. Köser, and M. Pollefeys, “Real-world normal map capture for nearly flat reflective surfaces,” in 2013 IEEE International Conference on Computer Vision,(2013), pp. 713–720

    work page 2013

  17. [17]

    Fastandaccuratedeflectometrywithcrossedfringes,

    Y.Liu,E.Olesch,Z.Yang,andG.Häusler,“Fastandaccuratedeflectometrywithcrossedfringes,”Adv.Opt.Technol. 3(4), pp. 441-445 (2014)

    work page 2014

  18. [18]

    Determining surface orientations of specular surfaces by using the photometric stereo method,

    K. Ikeuchi, “Determining surface orientations of specular surfaces by using the photometric stereo method,” inShape Recovery,L. B. Wolff, S. A. Shafer, and G. E. Healey, eds. (Jones and Bartlett Publishers, Inc., USA, 1992), pp. 268–276

    work page 1992

  19. [19]

    Acquiring reflectance and shape from continuous spherical harmonic illumination,

    B. Tunwattanapong, G. Fyffe, P. Graham, J. Busch, X. Yu, A. Ghosh, and P. Debevec, “Acquiring reflectance and shape from continuous spherical harmonic illumination,” ACM Trans. Graph.32, 109:1–109:12 (2013)

    work page 2013

  20. [20]

    Mesostructure from specularity,

    T. Chen, M. Goesele, and H.-P. Seidel, “Mesostructure from specularity,” inProceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2,(IEEE Computer Society, Washington, DC, USA, 2006), CVPR ’06, pp. 1825–1832

    work page 2006

  21. [21]

    Structured highlight inspection of specular surfaces,

    A. C. Sanderson, L. E. Weiss, and S. K. Nayar, “Structured highlight inspection of specular surfaces,” IEEE Transactions on Pattern Analysis Mach. Intell.10, 44–55 (1988)

    work page 1988

  22. [22]

    Specular surface inspection using structured highlight and gaussian images,

    S. K. Nayar, A. C. Sanderson, L. E. Weiss, and D. A. Simon, “Specular surface inspection using structured highlight and gaussian images,” IEEE Transactions on Robotics Autom.6, 208–218 (1990)

    work page 1990

  23. [23]

    Deflectometryforultra-precisionmachining - measuring without rechucking,

    C.Röttinger,C.Faber,M.Kurz,E.Olesch,G.Häusler,andE.Uhlmann,“Deflectometryforultra-precisionmachining - measuring without rechucking,” inProceedings of DGaO,(2011)

    work page 2011

  24. [24]

    Mobile Surface Reflectometry,

    J. Riviere, P. Peers, and A. Ghosh, “Mobile Surface Reflectometry,” Comput. Graph. Forum (2016)

    work page 2016

  25. [25]

    Deflectometry using portable devices,

    G. P. Butel, G. A. Smith, and J. H. H. Burge, “Deflectometry using portable devices,” Opt. Eng.54, 54 – 54 – 9 (2015)

    work page 2015

  26. [26]

    Kokomo opalescent glass co,

    “Kokomo opalescent glass co,”https://www.kog.com

    work page

  27. [27]

    A method for enforcing integrability in shape from shading algorithms,

    R. Frankot and R. Chellappa, “A method for enforcing integrability in shape from shading algorithms,” IEEE Transactions on Pattern Analysis Mach. Intell. vol. 10, no. 4, pp. 439-451 (1988)

    work page 1988

  28. [28]

    Hand-guided 3D surface acquisition by combining simple light sectioning with real-time algorithms

    O. Arold, S. Ettl, F. Willomitzer, and G. Häusler, “Hand-guided 3D surface acquisition by combining simple light sectioning with real-time algorithms,” arXiv e-prints arXiv:1401.1946 (2014)

    work page internal anchor Pith review Pith/arXiv arXiv 1946

  29. [29]

    Flying triangulation - a motion-robust optical 3d sensor for the real-time shape acquisition of complex objects,

    F. Willomitzer, S. Ettl, O. Arold, and G. Häusler, “Flying triangulation - a motion-robust optical 3d sensor for the real-time shape acquisition of complex objects,” AIP Conf. Proc.1537, 19–26 (2013)

    work page 2013