Using a Digital Twin for Fringe Projection Profilometry Optimisation
Pith reviewed 2026-05-20 08:33 UTC · model grok-4.3
The pith
A Blender digital twin for fringe projection profilometry finds parameter settings that transfer to hardware and cut required images by 48 percent.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The authors built a digital twin in Blender that matches the physical fringe projection profilometry hardware via Zhang calibration, gamma response, and ray-traced rendering. Systematic optimization inside the twin of phase-shift count, camera-projector spacing, and fringe density produced parameter sets that, when applied to the real system, reduced images per measurement by 48 percent from 36 to 21 and lowered mean symmetrical mean Chamfer distance by 74 percent for stripe count changes.
What carries the argument
The Blender digital twin that replicates the physical FPP system and supports automated parameter search across geometry and phase-shifting choices before hardware use.
If this is right
- Optimal settings discovered in the twin can be used on the physical system to require only 21 images instead of 36 per measurement.
- Mean symmetrical mean Chamfer distance falls by 74 percent when fringe stripe count is tuned via the twin.
- Both geometric parameters such as camera-projector spacing and algorithmic choices such as phase shifting become jointly optimizable in simulation.
- The same digital-twin workflow applies to three representative metrology artefacts and yields measurable reconstruction gains.
Where Pith is reading between the lines
- The approach could shorten setup time for other structured-light metrology techniques that share similar calibration and rendering requirements.
- Non-specialists might reach high-precision results more quickly if the twin automates what currently requires expert trial-and-error.
- Periodic re-calibration of the twin against fresh physical measurements could keep optimization quality high over time.
Load-bearing premise
The Blender digital twin must replicate the physical fringe projection system's response to parameter changes so that simulation results transfer directly to real hardware.
What would settle it
Transferring the digital-twin-optimized parameters to the physical fringe projection profilometry system and finding neither a drop in image count nor an improvement in symmetrical mean Chamfer distance would show the central claim is false.
Figures
read the original abstract
Fringe projection profilometry (FPP) is a widely used technique for measuring object surface form and three-dimensional (3D) geometry, capable of delivering high-precision, high-resolution measurements when paired with suitable cameras and projectors. However, in practical deployments, identifying parameter configurations that maximise precision while satisfying real-world constraints remains challenging. To address this, we present an automated digital twin framework implemented in Blender, an open-source 3D software package that provides a ray-traced rendering environment that enables accurate simulation of physical systems. We replicated the physical setup in our digital twin by matching characterisation quality, gamma response, and characterisation images. Accurate system characterisation using Zhang's method [1], to obtain intrinsic and extrinsic parameters, is shown to be critical for achieving high precision. Using this digital twin, we then demonstrate systematic exploration and optimisation of key parameters, including phase-shift count, camera-projector spacing, and fringe density. These parameters span both system geometry (e.g. camera-projector positioning) and algorithmic choices, such as 2D phase-shifting and unwrapping methods [2]. Three measurement artefacts, representative of real world metrology scenarios, were used to benchmark the system. The symmetrical mean Chamfer distance (SMCD), computed between ground-truth and reconstructed meshes, was used to evaluate reconstruction quality. After optimisation within the digital twin, transferring the optimal parameters to the physical system reduced the number of required images per measurement by 48% (from 36 to 21). A reduction of 74.0% mean SMCD was also achieved for fringe pattern stripe count alteration. A 36.9% mean SMCD was obtained for adjusting the camera and projector spacing purely in the digital-twin.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a digital twin framework in Blender for optimizing fringe projection profilometry (FPP) parameters including phase-shift count, fringe density, and camera-projector spacing. The physical system is replicated by matching characterisation quality, gamma response, and images, with calibration via Zhang's method. Optimisation uses symmetrical mean Chamfer distance (SMCD) on three representative artefacts. Transfer of optimal parameters to hardware is reported to reduce images per measurement by 48% (36 to 21), with 74.0% mean SMCD reduction for stripe count changes and 36.9% mean SMCD improvement for spacing adjustments performed in the twin.
Significance. If the digital twin faithfully reproduces physical error sources, the approach offers a practical route to parameter optimisation that reduces physical trial-and-error in high-precision 3D metrology. The use of an open-source ray-tracing environment, standard calibration, and quantitative SMCD metrics on real-world artefacts supports potential reproducibility and applicability.
major comments (1)
- [Abstract and Methods] The transfer results (48% image reduction and 74% SMCD improvement) are load-bearing for the central claim, yet the manuscript reports no quantitative SMCD comparison between the digital twin and physical system for any shared, unoptimized baseline parameter set. Without this, it remains unclear whether the Blender twin reproduces dominant physical error sources (gamma nonlinearity, camera noise, lens distortion residuals) or instead exploits simulation-specific artifacts.
minor comments (3)
- Clarify the precise definition and computation of SMCD, including how ground-truth meshes are obtained and aligned.
- Provide details on the optimisation algorithm, search space, and convergence criteria used within the digital twin.
- Include error bars or statistical measures for all reported SMCD and image-count improvements.
Simulated Author's Rebuttal
We thank the referee for their insightful comments on our manuscript. We address the major comment point-by-point below and outline the revisions we will make to strengthen the validation of our digital twin approach.
read point-by-point responses
-
Referee: [Abstract and Methods] The transfer results (48% image reduction and 74% SMCD improvement) are load-bearing for the central claim, yet the manuscript reports no quantitative SMCD comparison between the digital twin and physical system for any shared, unoptimized baseline parameter set. Without this, it remains unclear whether the Blender twin reproduces dominant physical error sources (gamma nonlinearity, camera noise, lens distortion residuals) or instead exploits simulation-specific artifacts.
Authors: We agree with the referee that a direct quantitative SMCD comparison between the digital twin and the physical system for a shared unoptimized baseline parameter set would strengthen the evidence that the simulation reproduces dominant physical error sources. The manuscript currently validates the twin by matching characterisation quality, gamma response, and images via Zhang's method. To address this point, we will revise the manuscript to include SMCD values computed on both the physical system and digital twin under identical baseline conditions (e.g., the default 36-image configuration). This comparison will be added to the Methods section to quantify fidelity and support the parameter transfer results. revision: yes
Circularity Check
No significant circularity; optimizations validated via independent physical measurements
full rationale
The paper constructs a Blender digital twin by matching physical characterization parameters (gamma response, Zhang's method intrinsics/extrinsics, and images), then optimizes parameters such as phase-shift count and fringe density inside the simulation to minimize SMCD. Optimal settings are transferred to the physical FPP hardware, where reductions in image count (48%) and SMCD (74%) are measured directly on real artefacts. No equations reduce reported gains to quantities defined by the same fitted parameters; physical evaluations function as external benchmarks. No self-citations are load-bearing, no ansatzes are smuggled, and no predictions collapse to inputs by construction. The chain is empirical and externally falsifiable.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption The Blender digital twin accurately replicates the physical system's optical properties when characterization images and gamma response are matched.
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
We replicated the physical setup in our digital twin by matching characterisation quality, gamma response, and characterisation images... minimising mean SMCD... reduced the number of required images per measurement by 48% (from 36 to 21).
-
IndisputableMonolith/Foundation/AlexanderDuality.leanalexander_duality_circle_linking unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
Accurate system characterisation using Zhang’s method... phase extraction and unwrapping... multi-frequency temporal unwrapping
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Zhang, Camera Calibration, in: Computer Vision, Springer, Cham, 2021, pp
Z. Zhang, Camera Calibration, in: Computer Vision, Springer, Cham, 2021, pp. 130–131. URL:https://link.springer.com/rwe/10. 1007/978-3-030-63416-2_164. doi:10.1007/978-3-030-63416-2_164
-
[2]
C. Zuo, L. Huang, M. Zhang, Q. Chen, A. Asundi, Temporal phase unwrapping algorithms for fringe projection profilometry: A comparativereview, OpticsandLasersinEngineering85(2016)84– 103
work page 2016
-
[3]
S. Feng, C. Zuo, L. Zhang, T. Tao, Y. Hu, W. Yin, J. Qian, Q. Chen, Calibration of fringe projection profilometry: A comparative review, Optics and Lasers in Engineering 143 (2021) 106622
work page 2021
- [4]
-
[5]
W. M. W. Norhaimi, Z. Sauli, H. Aris, V. Retnasamy, R. Vairavan, M. H. A. Aziz, Digital Fringe Projection System for Round Shaped Breast Tumor Detection 13 (2020)
work page 2020
-
[6]
L. Hinz, S. Metzner, P. Müller, R. Schulte, H.-B. Besserer, S. Wack- enrohr, C. Sauer, M. Kästner, T. Hausotte, S. Hübner, F. Nürnberger, B.Schleich,B.-A.Behrens,S.Wartzack,M.Merklein,E.Reithmeier, Weston et al.:Preprint submitted to ElsevierPage 9 of 10 Blender FPP Digital Twin Fringe Projection Profilometry in Production Metrology: A Multi- Scale Compar...
work page 2021
-
[7]
Place: Basel, Switzerland
-
[8]
K. Papachristou, P. F. Katsakiori, P. Papadimitroulas, L. Strigari, G. C. Kagadis, Digital Twins’ Advancements and Applications in Healthcare, Towards Precision Medicine, Journal of Personalized Medicine 14 (2024) 1101
work page 2024
-
[9]
M.Attaran,B.G.Celik, DigitalTwin:Benefits,usecases,challenges, and opportunities, Decision Analytics Journal 6 (2023) 100165
work page 2023
-
[10]
Publisher: Multidisciplinary Digital Publishing Institute
P.Nguyen,M.Kim,E.Nichols,H.-S.Yoon, AI-DrivenDigitalTwins for Manufacturing: A Review Across Hierarchical Manufacturing System Levels, Sensors 26 (2026) 124. Publisher: Multidisciplinary Digital Publishing Institute
work page 2026
-
[11]
B.Ribbens,V.A.Jacobs,S.Vanlanduit,J.Buytaert, ProjectionMoiré profilometry simulation software for algorithm validation and setup optimalisation, 2013, pp. 87–96
work page 2013
-
[12]
K. Ueda, K. Ikeda, O. Koyama, M. Yamada, Fringe projection profilometry system verification for 3D shape measurement using virtual space of game engine, Optical Review 28 (2021) 723–729
work page 2021
-
[13]
B. O. Community, Blender - a 3D modelling and rendering package,
-
[14]
URL:http://www.blender.org
-
[15]
A. Puljčan, D. Zoraja, T. Petković, Simulation of Structured Light 3D Scanning using Blender, in: 2022 International Symposium ELMAR, 2022, pp. 215–220. URL:https://ieeexplore.ieee.org/ document/9899809. doi:10.1109/ELMAR55880.2022.9899809, iSSN: 1334- 2630
-
[16]
A.d.F.Lemos,B.V.Nagy, Real-timeObjectPositioninginVibrating Environments Using DeepLabV3+ and ResNet50-based Semantic Segmentation, Periodica Polytechnica Mechanical Engineering 69 (2025) 347–368
work page 2025
-
[17]
Imagingtoday, foreseeing tomorrow
K.A.Riihiaho,T.Rossi,I.Pölönen,HYPERBLEND:SIMULATING SPECTRALREFLECTANCEANDTRANSMITTANCEOFLEAF TISSUE WITH BLENDER, ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences V-3-2022 (2022) 471–476.ConferenceName:XXIVISPRSCongress“Imagingtoday, foreseeing tomorrow”, Commission III - 2022 edition, 6–11 June 2022, Nice, Franc...
work page 2022
-
[18]
S. Zhang, Recent progresses on real-time 3D shape measurement using digital fringe projection techniques, ????
-
[19]
C. Zuo, S. Feng, L. Huang, T. Tao, W. Yin, Q. Chen, Phase shifting algorithms for fringe projection profilometry: A review, Optics and Lasers in Engineering 109 (2018) 23–59
work page 2018
-
[20]
X. Su, W. Chen, Reliability-guided phase unwrapping algorithm: a review, Optics and Lasers in Engineering 42 (2004) 245–261
work page 2004
-
[21]
Sturm, Pinhole Camera Model, in: Computer Vision, Springer, Cham, 2021, pp
P. Sturm, Pinhole Camera Model, in: Computer Vision, Springer, Cham, 2021, pp. 983–986. URL:https://link.springer.com/rwe/10. 1007/978-3-030-63416-2_472. doi:10.1007/978-3-030-63416-2_472
-
[22]
H. Yuen, J. Princen, J. Illingworth, J. Kittler, Comparative study of Hough Transform methods for circle finding, Image and Vision Computing 8 (1990) 71–77
work page 1990
-
[23]
O. Icasio-Hernández, A. Rocha De La Cruz, B. Muralikrishnan, V. Lee, W. Ren, J.-J. Gonzalez-Barbosa, VDI/VDE 2634-2 and ISO 10360-13 performance evaluation tests, and systematic errors in structured light systems, Precision Engineering 88 (2024) 804–814
work page 2024
-
[24]
M.Zhang,Q.Chen,T.Tao,S.Feng,Y.Hu,H.Li,C.Zuo, Robustand efficient multi-frequency temporal phase unwrapping: optimal fringe frequency and pattern sequence selection, Optics Express 25 (2017) 20381
work page 2017
-
[25]
A. Horé, D. Ziou, Image Quality Metrics: PSNR vs. SSIM, in: 201020thInternationalConferenceonPatternRecognition,2010,pp. 2366–2369. URL:https://ieeexplore.ieee.org/abstract/document/ 5596999. doi:10.1109/ICPR.2010.579, iSSN: 1051-4651
-
[26]
M. Akmal Butt, P. Maragos, Optimum design of chamfer distance transforms, IEEE Transactions on Image Processing 7 (1998) 1477– 1484
work page 1998
-
[27]
Z. Wu, W. Tao, N. Lv, H. Zhao, Optimization of parameters for a fringe projection measurement system by use of an improved differential evolution method, Optics Express 32 (2024) 3632–3646. Publisher: Optica Publishing Group
work page 2024
-
[28]
C. Wang, P. Zhou, J. Zhu, Deep learning-based end-to-end 3D depth recovery from a single-frame fringe pattern with the MSUNet++ network, Optics Express 31 (2023) 33287–33298. Publisher: Optica Publishing Group
work page 2023
-
[29]
B. Wang, W. Chen, J. Qian, S. Feng, Q. Chen, C. Zuo, Single-shot super-resolved fringe projection profilometry (SSSR-FPP): 100,000 frames-per-second 3D imaging with deep learning, Light: Science & Applications 14 (2025) 70. Publisher: Nature Publishing Group
work page 2025
-
[30]
C. Zhou, Y. Wang, X. Qi, S. Si, H. Li, Synthetic training datasets generating for fringe projection profilometry based on deep learning, in: Thirteenth International Conference on Information Optics and Photonics (CIOP 2022), volume 12478, SPIE, 2022, pp. 416–424. URL:https://www.spiedigitallibrary. org/conference-proceedings-of-spie/12478/124781N/ Synthe...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.