REVIEW 4 major objections 7 minor 20 references
DOGE: An Extrinsic Orientation and Gyroscope Bias Estimation for Visual-Inertial Odometry Initialization
T0 review · 4 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read A rotation-only constraint can estimate the camera-IMU extrinsic rotation and gyroscope bias together during visual-inertial initialization, before translation parallax exists.
desk verdict A genuinely new rotation-only extrinsic/gyro-bias estimator with strong experiments, but the pure-rotation claim lacks an observability condition and overreaches. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the normal epipolar constraint (NEC), which replaces the standard epipolar constraint with the coplanarity of epipolar-plane normal vectors, making the two-view cost depend only on rotation through the minimum eigenvalue of the matrix of normal-vector outer products. DOGE writes the rotation between two camera frames as the extrinsic rotation conjugated with the gyroscope preintegration, then linearizes that expression in the gyroscope bias error and the extrinsic orientation error. That linearized rotation is inserted into the NEC cost, and the minimization of the sum of minimum eigenvalues over keyframe pairs is solved with iteratively reweighted least squares, using an eigenvalue-based weight, a per-feature-pair weight derived from propagated pixel and IMU covariance, and a chi-square test to reject outliers. A maximum a posteriori step, implemented with an iterated error-state Kalman filter, carries the estimates across sliding windows before translation parallax arrives.
What would settle it
Run the estimator on a synthetic sequence with pure rotation and zero translation; if it returns biased values even with zero pixel noise, or if the cost is flat along some direction, the rotation-only constraint is not identifiable. A cheaper check is to evaluate the observability matrix of the linearized constraint at a pure-rotation trajectory and inspect its null space.
Extended reading notes
Core claim
The central claim is that the six-dimensional error state consisting of gyroscope bias correction and extrinsic orientation error is identifiable from normal epipolar constraints alone, even in pure-rotation motion. The paper rewrites the inter-frame rotation as a function of the gyroscope measurements and the extrinsic rotation, linearizes the product in the two error terms, and substitutes this expression into the NEC minimum-eigenvalue cost. The resulting cost is minimized by iteratively reweighted least squares with a chi-square outlier test, and a maximum a posteriori estimator then propagates and refines the estimates across sliding windows until translation parallax accumulates. The paper shows that this yields accurate extrinsic rotation and gyroscope bias estimates with fewer keyframes than methods that wait for translation or that post-optimize with visual-inertial bundle adjustment.
Load-bearing premise
The method assumes that the cost built from two keyframe pairs and a first-order linearization pins down all six unknowns (gyroscope bias and extrinsic rotation) even when the camera is not moving sideways; if that cost is flat or ambiguous, the estimator cannot converge.
Editorial extensions
If this is right
- If the rotation-only constraint is identifiable, VIO initialization no longer needs to wait for translation excitation, cutting startup latency in applications such as AR and drone navigation.
- Joint estimation of gyroscope bias and extrinsic rotation lets a VIO system recalibrate online after temperature or mechanical deformation changes the camera-IMU mounting, without an offline calibration tool.
- The chi-square failure detector gives the system a practical signal to wait for more data, so a bad initialization is less likely to be accepted.
- The MAP refinement across sliding windows makes the rotation and bias estimates improve continuously before translation arrives, giving the full VIO estimator a better warm start.
Reading between the lines
- The paper does not prove observability; an analytic observability condition for the rotation-only cost would settle whether two keyframe pairs are always sufficient, and would show the motion profiles under which the six unknowns separate.
- The weighting strategy is not tied to VIO: the same eigenvalue-based cost with per-feature covariance weighting could be applied to other geometric vision problems that minimize an eigenvalue, such as essential-matrix or homography estimation.
- The failure-detection pass rate could be reused as a drift trigger: when the chi-square pass rate drops during operation, the system could re-run the rotation-only calibration rather than only using it at startup.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes DOGE, a VIO initialization method that jointly estimates the camera-IMU extrinsic orientation and gyroscope bias using normal epipolar constraints (NEC). The central idea is to substitute a first-order model of the gyro-preintegrated rotation, parameterized by gyro-bias error δb_g and extrinsic-orientation error δθ_CI, into the NEC cost and minimize the minimum eigenvalue of the moment matrix M_ij. The method adds λ and feature-pair weighting, a Chi-square-based failure detector, and an IESKF/MAP refinement. Experiments on EuRoC and on a simulated pure-rotation scene compare favorably with VINS-Mono and Drt-VIO in accuracy, robustness, and runtime.
Significance. If the rotation-only solvability were established, the method would be a practically useful contribution to VIO initialization under loose or deformed extrinsics, because it would remove the requirement of translation parallax for rotational calibration and would lower initialization latency. The paper is commendable for deriving the coupled constraint, for the explicit weighting/outlier-rejection modules, and for documenting runtimes and failure-detection rates. However, the main theoretical claim is not supported as stated: the proposed cost has a symmetry (and hence a continuum of minima) when the motion is a pure rotation about a fixed axis, so the abstract's assertion that the problem 'can be solved in pure-rotation cases' needs qualification, and the two-keyframe-pair sufficiency argument is incomplete.
major comments (4)
- [Section III-A, Eqs. (8)-(12)] The rotation-only cost is not well posed for the pure-rotation cases claimed in the Abstract. Suppose all relative rotations are pure rotations about a fixed IMU axis n. Then every measured preintegrated rotation gamma_hat_ij and every correction Exp(J_b delta_b) (for delta_b parallel to n) is a rotation about n, so the predicted camera rotation X gamma_hat_ij Exp(J_b delta_b) X^{-1} is a rotation about the single camera axis q = R_CI n. Replacing X by X Exp(alpha n) leaves each predicted camera rotation exactly unchanged, because Exp(alpha n) commutes with gamma_hat_ij and with Exp(J_b delta_b). Hence the objective in Eq. (12) is constant along a one-parameter (and, if delta_b is also aligned with n, two-parameter) family of parameter values, lambda_min(M_ij) has a continuum of global minima, and the stacked Jacobian is rank-deficient. This is not an artifact of the first-order approximation in Eq. (9): it is an exact symmetry of the nonlinear cost. The paper should state an explicit rotational-excitation condition (for example, that the set of inter-frame rotation axes spans at least two dimensions) and should qualify the claim that the problem 'can be solved in pure-rotation cases.'
- [Section III-A, 'the size of K is at least 2'] The sufficiency argument for K >= 2 is incomplete. Even if the NEC provides three independent constraints per two-view setup for the rotation itself, the constraints in Eq. (12) are functions of the composite quantity X gamma_hat_ij Exp(J_b delta_b) X^{-1}; dependencies among these constraints as functions of the six unknowns are not ruled out. The fixed-axis example above shows that the stacked residual can have rank at most five (or lower) despite K >= 2. Please provide an observability/identifiability analysis of the stacked cost, or a numerical rank test of the Jacobian of Eq. (12), and state the conditions under which a unique global minimum exists.
- [Section III-A, Eq. (10)] The Jacobian J_theta_CI in Eq. (10) appears to be derived for a left perturbation of R_CI, whereas the manifold operators in Eq. (1) and the state update in Eq. (20) adopt the right-perturbation convention R ⊞ θ = R Exp(θ). Under the right-perturbation R_CI = bR_CI Exp(delta_theta_CI), the derivative of gamma_Ci_Cj with respect to delta_theta_CI is bR_CI (gamma_Ii_Ij^T - I), not bR_CI gamma_Ii_Ij^T bR_CI^T - I. Please clarify the perturbation convention used in the LM optimization and correct Eq. (10) if the right-perturbation convention is intended.
- [Section IV-B, Figs. 1 and 6] The simulation used to support the pure-rotation claim employs pure rotation with jointly varying roll, pitch, and yaw (Fig. 1), which provides the rotational excitation needed to avoid the fixed-axis degeneracy. It therefore does not validate the unqualified statement that the method works in pure-rotation cases. An additional experiment with rotation about a single fixed axis (e.g., a turntable motion) is needed; with the current formulation, the estimated extrinsic orientation should be non-identifiable in that scenario, confirming the need for an excitation condition.
minor comments (7)
- [Title and Abstract] 'An Extrinsic Orientation and Gyroscope Bias Estimation' is ungrammatical; consider 'Extrinsic Orientation and Gyroscope Bias Estimation' or 'A Method for Estimating Extrinsic Orientation and Gyroscope Bias.'
- [Section III-A, before Eq. (9)] The sentence introducing Eq. (9) is missing punctuation and the word 'as'; please revise for clarity.
- [Eq. (14)] The IMU preintegration covariance term carries a stray superscript k; the covariance of gamma_Ii_Ij does not depend on the point index.
- [Section IV-A] 'cause' should be 'because'; the caption of Fig. 2 also ends without a period.
- [Section IV-B] The sequence list 'V1 02, V1 03, V2 02, and V1 03' repeats V1 03; the last item is probably V2 03.
- [Section III-A] The sentence 'bγ_Ci_Cj represents the rotation estimation from frame Ci to frame Cj, which is also equal to bR_CiCj' introduces bR_CiCj before it is defined.
- [Fig. 4 caption] 'Ablation expriment' should be 'Ablation experiment.'
Circularity Check
No significant circularity: the DOGE rotation-only cost is derived in-paper from standard NEC and IMU preintegration, and no fitted parameter is renamed as a prediction.
full rationale
The paper's central claim is that joint extrinsic orientation and gyroscope bias can be estimated from a rotation-only NEC residual. That residual is constructed explicitly in the paper: Eq. (9) propagates first-order errors through the preintegrated rotation, Eq. (11) builds M_ij from that perturbed rotation and the bearing vectors, and Eq. (12) minimizes the minimum eigenvalue. No target quantity from EuRoC or the simulated dataset is used to define the objective, and no constant appearing in the method is fitted to the reported errors. The hand-set values (0.5-pixel noise, Cauchy kernel, epsilon=0.8) affect robustness only and are not the quantities being predicted. The only substantive self-citation is reference [3], used for the downstream velocity and gravity stage after the extrinsic orientation and gyroscope bias have already been estimated; it is not load-bearing for the rotation-only derivation, which is self-contained. The observability concern raised for exact pure rotation about a fixed axis is a correctness or excitation-condition issue, not a circularity: even if Eq. (12) were degenerate in a particular motion regime, that would not make the derivation equivalent to its own inputs by construction. Since the derivation chain is independent of the experimental targets and the core estimator is not justified by a self-citation loop, the appropriate circularity finding is none.
Assumptions & free parameters
free parameters (2)
- failure detection threshold epsilon =
0.8
- assumed feature observation noise std =
0.5 pixel
assumptions (6)
- domain assumption Standard IMU measurement model: gyro noise is Gaussian white noise n_g ~ N(0, sigma_g^2 I), and gyro bias evolves as a random walk with sigma_bg^2.
- domain assumption First-order error-state approximation gamma = hat_gamma Exp(J_b delta_b + J_theta delta_theta) is accurate over the operating range of extrinsic errors up to 20 degrees.
- ad hoc to paper The minimum eigenvalue residual of the NEC moment matrix remains a valid and sufficiently informative cost for rotation estimation even when translation parallax is zero or near-zero (pure-rotation cases).
- domain assumption Deformation changes only the rotational part of the extrinsic parameters; the translational part changes at the millimeter level and can be ignored.
- domain assumption Gyroscope bias is constant within each sliding window during initialization.
- ad hoc to paper Each two-view setup with more than five co-visible points provides three independent constraints from NEC, so K>=2 is sufficient for the six unknowns.
Cite this review
Pith. "Pith review of DOGE: An Extrinsic Orientation and Gyroscope Bias Estimation for Visual-Inertial Odometry Initialization." pith.science (2026). https://pith.science/paper/TSXO2JK3
@misc{pith2026241208135,
author = {Pith},
title = {Pith review of: DOGE: An Extrinsic Orientation and Gyroscope Bias Estimation for Visual-Inertial Odometry Initialization},
year = {2026},
howpublished = {\url{https://pith.science/paper/TSXO2JK3}},
note = {Machine review of arXiv:2412.08135}
}
read the original abstract
Most existing visual-inertial odometry (VIO) initialization methods rely on accurate pre-calibrated extrinsic parameters. However, during long-term use, irreversible structural deformation caused by temperature changes, mechanical squeezing, etc. will cause changes in extrinsic parameters, especially in the rotational part. Existing initialization methods that simultaneously estimate extrinsic parameters suffer from poor robustness, low precision, and long initialization latency due to the need for sufficient translational motion. To address these problems, we propose a novel VIO initialization method, which jointly considers extrinsic orientation and gyroscope bias within the normal epipolar constraints, achieving higher precision and better robustness without delayed rotational calibration. First, a rotation-only constraint is designed for extrinsic orientation and gyroscope bias estimation, which tightly couples gyroscope measurements and visual observations and can be solved in pure-rotation cases. Second, we propose a weighting strategy together with a failure detection strategy to enhance the precision and robustness of the estimator. Finally, we leverage Maximum A Posteriori to refine the results before enough translation parallax comes. Extensive experiments have demonstrated that our method outperforms the state-of-the-art methods in both accuracy and robustness while maintaining competitive efficiency.
Figures
Figures from the paper (1 more)
Reference graph
Works this paper leans on
-
[1]
Instant visual odometry initialization for mobile ar,
A. Concha, M. Burri, J. Briales, C. Forster, and L. Oth, “Instant visual odometry initialization for mobile ar,” IEEE Transactions on Visualization and Computer Graphics, vol. 27, no. 11, pp. 4226–4235, 2021
work page 2021
-
[2]
Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam,
C. Campos, R. Elvira, J. J. G. Rodr ´ıguez, J. M. Montiel, and J. D. Tard ´os, “Orb-slam3: An accurate open-source library for visual, visual–inertial, and multimap slam,” IEEE Transactions on Robotics , vol. 37, no. 6, pp. 1874–1890, 2021
2021
-
[3]
A rotation-translation-decoupled solution for robust and efficient visual-inertial initialization,
Y . He, B. Xu, Z. Ouyang, and H. Li, “A rotation-translation-decoupled solution for robust and efficient visual-inertial initialization,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 739–748, 2023
work page 2023
-
[4]
Stereo-nec: Enhancing stereo visual-inertial slam initialization with normal epipolar constraints,
W. Wang, C. Chou, G. Sevagamoorthy, K. Chen, Z. Chen, Z. Feng, Y . Xia, F. Cai, Y . Xu, and P. Mordohai, “Stereo-nec: Enhancing stereo visual-inertial slam initialization with normal epipolar constraints,” in IEEE International Conference on Robotics and Automation (ICRA) , pp. 2691–2697, 2024
work page 2024
-
[5]
Unified temporal and spa- tial calibration for multi-sensor systems,
P. Furgale, J. Rehder, and R. Siegwart, “Unified temporal and spa- tial calibration for multi-sensor systems,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1280–1286, IEEE, 2013
work page 2013
-
[6]
Vins-mono: A robust and versatile monoc- ular visual-inertial state estimator,
T. Qin, P. Li, and S. Shen, “Vins-mono: A robust and versatile monoc- ular visual-inertial state estimator,” IEEE Transactions on Robotics , vol. 34, no. 4, pp. 1004–1020, 2018
2018
-
[7]
Openvins: A research platform for visual-inertial estimation,
P. Geneva, K. Eckenhoff, W. Lee, Y . Yang, and G. Huang, “Openvins: A research platform for visual-inertial estimation,” in IEEE Interna- tional Conference on Robotics and Automation (ICRA) , pp. 4666– 4672, IEEE, 2020
work page 2020
-
[8]
Robust initialization of monocular visual-inertial estimation on aerial robots,
T. Qin and S. Shen, “Robust initialization of monocular visual-inertial estimation on aerial robots,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pp. 4225–4232, IEEE, 2017
work page 2017
Show all 20 references
-
[9]
Estimator initialization in vision- aided inertial navigation with unknown camera-imu calibration,
T.-C. Dong-Si and A. I. Mourikis, “Estimator initialization in vision- aided inertial navigation with unknown camera-imu calibration,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1064–1071, IEEE, 2012
2012
-
[10]
Online initialization and automatic camera-imu extrinsic calibration for monocular visual-inertial slam,
W. Huang and H. Liu, “Online initialization and automatic camera-imu extrinsic calibration for monocular visual-inertial slam,” in IEEE Inter- national Conference on Robotics and Automation (ICRA) , pp. 5182– 5189, IEEE, 2018
2018
-
[11]
Finding the exact rotation between two images independently of the translation,
L. Kneip, R. Siegwart, and M. Pollefeys, “Finding the exact rotation between two images independently of the translation,” in in Springer European Conference on Computer Vision (ECCV) , pp. 696–709, Springer, 2012
2012
-
[12]
Direct optimization of frame-to-frame rotation,
L. Kneip and S. Lynen, “Direct optimization of frame-to-frame rotation,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV) , pp. 2352–2359, 2013
2013
-
[13]
Imu preinte- gration on manifold for efficient visual-inertial maximum-a-posteriori estimation,
C. Forster, L. Carlone, F. Dellaert, and D. Scaramuzza, “Imu preinte- gration on manifold for efficient visual-inertial maximum-a-posteriori estimation,” in Robotics: Science and Systems XI , 2015
2015
-
[14]
J. K. Uhlmann, Dynamic map building and localization: new theoret- ical foundations. PhD thesis, University of Oxford, 1995
1995
-
[15]
The probabilistic normal epipolar constraint for frame-to-frame rotation optimization under uncertain feature positions,
D. Muhle, L. Koestler, N. Demmel, F. Bernard, and D. Cremers, “The probabilistic normal epipolar constraint for frame-to-frame rotation optimization under uncertain feature positions,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),...
2022
-
[16]
Kalman filters on differentiable manifolds,
D. He, W. Xu, and F. Zhang, “Kalman filters on differentiable manifolds,” arXiv preprint arXiv:2102.03804 , 2021
2021 arXiv
-
[17]
The euroc micro aerial vehicle datasets,
M. Burri, J. Nikolic, P. Gohl, T. Schneider, J. Rehder, S. Omari, M. W. Achtelik, and R. Siegwart, “The euroc micro aerial vehicle datasets,” The International Journal of Robotics Research , vol. 35, no. 10, pp. 1157–1163, 2016
2016
-
[18]
An iterative image registration technique with an application to stereo vision,
B. D. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision,” in 7th international joint confer- ence on Artificial intelligence (IJCAI) , vol. 2, pp. 674–679, 1981
1981
-
[19]
Good features to track,
J. Shi et al. , “Good features to track,” in Proceedings of IEEE con- ference on computer vision and pattern recognition (CVPR) , pp. 593– 600, IEEE, 1994
1994
-
[20]
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,
M. A. Fischler and R. C. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Commun. ACM, vol. 24, no. 6, pp. 381–395, 1981
1981
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.