Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

GoTrack: Generic 6DoF Object Pose Refinement and Tracking

T0 review · 3 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This paper claims that a single synthetic-trained flow network can refine and track 6DoF poses of unseen objects and reaches state-of-the-art RGB-only results on BOP, YCB-V, and RBOT benchmarks.

desk verdict GoTrack is a clean, simple flow-based 6DoF refiner/tracker with a genuine frame-to-frame twist; the BOP refinement SOTA claim is the softest part because the baselines are leaderboard-sourced and may not be controlled. read the letter →

arxiv 2506.07155 v1 pith:OSXKNAQT submitted 2025-06-08 cs.CV

Van Nguyen Nguyen , Christian Forster , Sindi Shkodrani , Vincent Lepetit , Bugra Tekin , Cem Keskin , Tomas Hodan This is my paper
classification cs.CV
keywords 6DoFobjectposeestimationtrackingrefinementopticalflowunseenobjectstemplate-basedPnP-RANSACanalysis-by-synthesis
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces GoTrack, a CAD-based method for refining and tracking the 6DoF pose of rigid objects that has never seen the target object at training time. It claims that by framing both model-to-frame registration and frame-to-frame registration as optical flow estimation, a single simple pipeline reaches state-of-the-art RGB-only accuracy on the BOP refinement benchmarks and on YCB-V and RBOT tracking, while being faster and needing no extra pose-scoring network. The method is trained once on synthetic renderings, so if the claim holds, real applications like robotic manipulation and AR/VR tracking get a generic pose tracker that transfers across objects and image types out of the box.

What carries the argument

The central machinery is the pair of registration types borrowed from SLAM, both realized as optical flow. Model-to-frame flow is predicted by a two-branch transformer decoder (from CroCo v2 with a dense prediction transformer head) on top of frozen DINOv2 features; it outputs per-template-pixel flow and visibility, which are lifted to 2D-3D correspondences using template depth and solved by EPnP combined with RANSAC. Frame-to-frame flow is computed by a small off-the-shelf optical flow network (RAFT) between consecutive crops and propagates the previous inlier set; the inlier ratio after propagation decides whether to re-trigger model-to-frame registration. The weighted inlier ratio q = s'/s serves as the pose confidence score for selecting among multiple refinement hypotheses.

What would settle it

Take a video of an object category that is absent from the MegaPose-GSO training set (for example, a specular or translucent object) and run GoTrack with the 0.8 inlier threshold as the only trigger for template-to-frame registration. If the ADD-S tracking accuracy stays high while the re-projected model drift grows, the claim that frame-to-frame propagation with that threshold preserves pose accuracy is refuted.

Watch

Extended reading notes

Core claim

GoTrack's core claim is that 6DoF pose refinement and tracking of unseen rigid objects can be reduced to two optical-flow problems. For model-to-frame registration, a transformer decoder on frozen DINOv2 features predicts a dense flow field and a visibility mask between a rendered RGB-D template and the input crop; those predictions yield weighted 2D-3D correspondences, and PnP-RANSAC recovers the pose. For tracking, a lightweight pretrained flow network propagates the previous frame's inlier correspondences to the current frame, and the heavier template-to-frame alignment runs only when the propagated inlier ratio drops below 0.8. The paper reports that this design reaches state-of-the-art RGB-only accuracy on BOP refinement and YCB-V/RBOT tracking without ever training on the test objects, and that its weighted inlier ratio q doubles as a pose quality score, removing the scoring network required by prior render-and-compare pipelines.

Load-bearing premise

The load-bearing premise is that a flow-and-visibility network trained only on synthetic rendered household objects transfers to arbitrary real images—including grayscale, heavily occluded, and hand-manipulated scenes—well enough that pose estimates from PnP-RANSAC on its predicted correspondences are accurate.

Editorial extensions

If this is right

  • A single network trained on synthetic images can refine and track novel objects in RGB and grayscale video without object-specific fine-tuning.
  • The expensive model-to-frame registration runs only occasionally—about every 50th frame on YCB-V—so tracking is roughly six times cheaper than running refinement at every frame.
  • The weighted inlier ratio q selects the best pose among multiple refinement hypotheses, so the pipeline needs one neural network instead of separate refinement and scoring networks.
  • Because flow correspondences work from appearance rather than contours, the tracker keeps working on textureless objects and on objects where multiple poses share the same silhouette.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper: because the method already outputs dense 2D-2D correspondences, disabling the PnP stage would yield a generic 2D object tracker for novel instances, a use the authors mention but do not evaluate.
  • Beyond the paper: the inlier-ratio trigger assumes propagated flow quality tracks pose error; on fast motion, blur, or occlusions that assumption can fail, so a content-aware trigger based on flow uncertainty is a testable improvement.
  • Beyond the paper: the template-based coarse stage could be replaced by any pose estimator, so GoTrack should act as a drop-in refiner for other single-image detection pipelines.
  • Beyond the paper: the model-free extension the authors propose as future work—using the first observed frame as a pseudo-model—would make the whole pipeline independent of CAD models, dramatically widening applicability to unknown objects.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. GoTrack proposes a CAD-based, object-agnostic 6DoF pose refinement and tracking method. A transformer decoder trained on DINOv2 features predicts, from a rendered template and an input crop, a dense optical flow field and a visibility mask; the resulting 2D-3D correspondences are solved by PnP-RANSAC, and a weighted inlier ratio serves as a pose confidence score without a separate scoring network. For tracking, GoTrack propagates previous-frame correspondences with an off-the-shelf RAFT optical flow model, and triggers the more expensive template-to-frame registration only when the inlier ratio falls below a threshold. The paper reports state-of-the-art RGB-only refinement results on seven BOP datasets against MegaPose and GenFlow, and state-of-the-art tracking results on YCB-V, RBOT, and HOT3D, with code and trained models released.

Significance. If the headline comparisons are protocol-matched, GoTrack is a significant contribution: it reaches or exceeds the accuracy of substantially heavier refinement pipelines using a simpler architecture, fewer neural networks, no dedicated scoring network, and public code. The frame-to-frame consistency idea is principled and the reported efficiency gains are valuable for practical tracking. The evaluation covers standard benchmarks and includes unseen-object generalization against object-specific trained baselines, which is a notable strength. However, the significance of the refinement claims rests on whether the leaderboard-sourced MegaPose/GenFlow numbers were obtained under the same coarse-pose and multi-hypothesis conditions as GoTrack's, and the tracking claims rest on initialization-matched comparisons.

major comments (3)
  1. [Sec. 4.1, Table 1] The headline refinement comparison is not demonstrably controlled. The table labels blocks as 'Refinement using a single hypothesis from FoundPose', 'Refinement using a single hypothesis from GigaPose', and 'Pose refinement using 5 hypotheses from GigaPose', which implies that MegaPose and GenFlow were run under exactly those coarse-pose and hypothesis-number conditions. Yet the text states that the MegaPose and GenFlow results are 'sourced from the BOP leaderboard [28]', and no leaderboard entry IDs, per-dataset coarse-pose specifications, or protocol-equivalence evidence are given. The reported margins are small (e.g., average AR 66.4 vs 63.4 for single-hypothesis refinement from FoundPose, and 71.2 vs 69.4 for 5-hypothesis refinement from GigaPose, with GenFlow higher on IC-BIN at 55.1 vs 54.4), so a mismatch in initialization or hypothesis handling could reverse the claimed state-of-the-art result. The authors should either rerun the baselines under the identical protocol or document the exact configuration of the leaderboard entries used, or temper the claim to 'competitive with' rather than 'state-of-the-art'.
  2. [Sec. 4.2, Table 2] The YCB-V tracking comparison is confounded by initialization. GoTrack is initialized with a FoundPose coarse pose, while PoseCNN and PoseRBPF use PoseCNN-based initializations, and the authors note that PoseCNN pose estimates are not publicly available. Tracking accuracy is strongly sensitive to the initial pose, and the baselines were trained on the test objects while GoTrack was not. This does not invalidate the comparison, but it means Table 2 does not cleanly support an unqualified 'state-of-the-art on YCB-V tracking' claim. Please evaluate GoTrack with PoseCNN initialization (or another common initialization), or explicitly frame the result as 'state-of-the-art among RGB-only trackers initialized from FoundPose'.
  3. [Sec. 3.3, Sec. 4.2] The central tracking mechanism is defined by hyperparameters that are never ablated. The mixing ratio r (set to 2), the trigger threshold tau_i (set to 0.8), and the 10K-correspondence cap are used without sensitivity analysis, even though the text states that lower r gives smoother but more drift-prone tracking and higher r gives jittery tracking. Since the paper's efficiency and stability claims depend on these choices, an ablation varying r and tau_i - reporting trigger frequency, runtime, accuracy, and drift behavior on RBOT or YCB-V - would substantially strengthen the paper. Without it, the reader cannot tell how robust the proposed tracking algorithm is to its own parameters.
minor comments (4)
  1. [Sec. 4.1] The sentence 'Compared to GenFlow, our refiner achieves +1.3 ARMSPD and -0.5 AR' appears to have the metrics swapped; the table shows GoTrack's AR is higher and MSPD is slightly lower, so it should likely read '+1.3 AR and -0.5 MSPD'.
  2. [Table 1] The table row numbering skips from 9 to 12; rows 10 and 11 are missing, which makes it harder to reference the individual configuration rows.
  3. [Sec. 4.2] The phrasing 'the accuracy is measured by AUC w.r.t. the ADD and and ADD(-S) pose error functions' contains a duplicated 'and'.
  4. [Appendix B] The HOT3D evaluation is performed on the training split because test annotations are unavailable; this should be stated in the main text's experimental setup rather than only in the appendix, since it affects how the reader interprets the quantitative tracking claim.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity; the pose refiner is validated on external benchmarks and the confidence score is an internal-consistency measure used only for ranking hypotheses.

full rationale

GoTrack's derivation chain is self-contained against external benchmarks. The flow/visibility network is trained on the MegaPose-GSO synthetic dataset with ground-truth poses and rendered templates; at test time it is applied to BOP, YCB-V, RBOT, and HOT3D with no fine-tuning on the test objects. The final pose comes from PnP-RANSAC on the predicted 2D-3D correspondences, so the state-of-the-art claim is not obtained by fitting a parameter to the target metric. The pose confidence score q = s'/s is computed from the inlier correspondences of the pose estimated by PnP; although this is an internal consistency score, it is used only to rank alternative refined hypotheses and does not enter the pose-fitting equations for a given hypothesis. This is analogous to RANSAC inlier scoring, not a self-definitional reduction. Self-citations (FoundPose, GigaPose, CNOS, BOP Challenge report) are to independently published methods or benchmarks; they provide coarse poses or baseline numbers, but no load-bearing premise is justified solely by a self-citation. The concern that leaderboard-sourced baselines may not match GoTrack's coarse-pose/hypothesis protocol is a validity or correctness issue, not a circularity: it does not make the method's output equivalent to its inputs by construction.

Assumptions & free parameters 6 free parameters · 3 assumptions · 0 invented entities

The paper does not introduce new physical entities. It relies on standard pretrained components (DINOv2, RAFT) and a set of hand-set hyperparameters. The most significant assumptions are about generalization from synthetic training data and the reliability of off-the-shelf optical flow for the tracking task.

free parameters (6)
  • visibility threshold tau_v = 0.3
    Threshold on predicted visibility mask for including correspondences; chosen by hand.
  • re-projection threshold tau_r = 4 px
    RANSAC inlier threshold for PnP; chosen by hand.
  • inlier-ratio trigger tau_i = 0.8
    Triggers model-to-frame re-registration when frame-to-frame inlier ratio falls below; tuned for tracking.
  • mixing ratio r = 2
    Controls ratio of correspondences taken from previous vs current frame when combining sets; tuned for jitter/drift trade-off.
  • number of templates = 800
    Templates rendered for coarse pose retrieval; chosen as a practical trade-off between coverage and compute.
  • crop resolution = 280x280 px
    Input resolution for template and crop; chosen by hand.
assumptions (3)
  • domain assumption DINOv2 features generalize to arbitrary unseen objects for both template retrieval and flow prediction
    The entire pipeline depends on this, since DINOv2 is frozen and not fine-tuned on target objects; the paper provides empirical evidence on BOP/RBOT/YCB-V.
  • domain assumption Synthetic MegaPose-GSO PBR training with augmentation transfers to real images
    The flow/mask network is trained only on synthetic data and applied to real benchmarks; this is a standard assumption in this line of work.
  • domain assumption Off-the-shelf RAFT-Small optical flow is reliable for frame-to-frame propagation in the tested scenarios
    Tracking relies on RAFT to propagate correspondences; if it fails often, the method degrades or increases compute.

how reviews work

0 comments
Cite this review

Pith. "Pith review of GoTrack: Generic 6DoF Object Pose Refinement and Tracking." pith.science (2026). https://pith.science/paper/OSXKNAQT

@misc{pith2026250607155,
  author       = {Pith},
  title        = {Pith review of: GoTrack: Generic 6DoF Object Pose Refinement and Tracking},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/OSXKNAQT}},
  note         = {Machine review of arXiv:2506.07155}
}
read the original abstract

We introduce GoTrack, an efficient and accurate CAD-based method for 6DoF object pose refinement and tracking, which can handle diverse objects without any object-specific training. Unlike existing tracking methods that rely solely on an analysis-by-synthesis approach for model-to-frame registration, GoTrack additionally integrates frame-to-frame registration, which saves compute and stabilizes tracking. Both types of registration are realized by optical flow estimation. The model-to-frame registration is noticeably simpler than in existing methods, relying only on standard neural network blocks (a transformer is trained on top of DINOv2) and producing reliable pose confidence scores without a scoring network. For the frame-to-frame registration, which is an easier problem as consecutive video frames are typically nearly identical, we employ a light off-the-shelf optical flow model. We demonstrate that GoTrack can be seamlessly combined with existing coarse pose estimation methods to create a minimal pipeline that reaches state-of-the-art RGB-only results on standard benchmarks for 6DoF object pose estimation and tracking. Our source code and trained models are publicly available at https://github.com/facebookresearch/gotrack

Figures

Figures reproduced from arXiv: 2506.07155 by the authors.

Figure 1
Figure 1. Given a CAD model of the target object, our method can [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overview of the proposed efficient pipeline for 6DoF pose estimation. Each object is first onboarded by rendering RGB-D templates of its 3D model, and by extracting DINOv2 [50] feature maps from RGB channels of the templates. At inference, we first crop the input image around a 2D object detection (from CNOS [47]) and retrieve a template that shows the object in a similar pose as in the crop by the BoW-based approac… view at source ↗
Figure 3
Figure 3. [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (9 more)
Figure 4
Figure 4. Figure 4: Example results of the GoTrack refiner on LM-O [5], YCB-V [79], and T-LESS [23]. The input image is shown in the first column, and the template retrieved using the BoW-based approach [51] in the second. The third and fourth columns show the predictions of our network, …
Figure 5
Figure 5. Figure 5: Visualization of tracking. Tiles and show crops of the previous and the current frame, respectively. Tile shows a template rendered with the previous pose estimate. Tile shows the masked template-to-frame flow, which is visualized for all frames but actually used only …
Figure 6
Figure 6. Figure 6: Example results of the GoTrack refiner on LM-O [5]. 14 [PITH_FULL_IMAGE:figures/full_fig_p014_6.png]
Figure 7
Figure 7. Figure 7: Example results of the GoTrack refiner on T-LESS [22]. 15 [PITH_FULL_IMAGE:figures/full_fig_p015_7.png]
Figure 8
Figure 8. Figure 8: Example results of the GoTrack refiner on HB [31]. 16 [PITH_FULL_IMAGE:figures/full_fig_p016_8.png]
Figure 9
Figure 9. Figure 9: Example results of the GoTrack refiner on YCBV [79]. 17 [PITH_FULL_IMAGE:figures/full_fig_p017_9.png]
Figure 10
Figure 10. Figure 10: Example results of the GoTrack refiner on IC-BIN [10]. 18 [PITH_FULL_IMAGE:figures/full_fig_p018_10.png]
Figure 11
Figure 11. Figure 11: Example results of the GoTrack refiner on TUDL [25]. 19 [PITH_FULL_IMAGE:figures/full_fig_p019_11.png]
Figure 12
Figure 12. Figure 12: Example results of the GoTrack refiner on ITODD [12]. 20 [PITH_FULL_IMAGE:figures/full_fig_p020_12.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Robust 6-DoF Object Pose Tracking with Built-In Recovery under Occlusions and Rapid Object Motions

    cs.CV 2026-07 conditional novelty 5.0 of 10

    An ICG+-based RGB-D tracker with SuperPoint matching, a keyframe store, cycle-consistency failure detection, and TEASER++ recovery matches SOTA accuracy at 57.6 FPS and is most robust under occlusion and fast motion.

Reference graph

Works this paper leans on

82 extracted references · 76 canonical work pages · cited by 1 Pith paper

  1. [28]

    BOP challenge 2023 on detection, segmentation and pose estimation of seen and unseen rigid objects

    Tom ´aˇs Hoda ˇn, Martin Sundermeyer, Yann Labb ´e, Van Nguyen Nguyen, Gu Wang, Eric Brachmann, Bertram Drost, Vincent Lepetit, Carsten Rother, and Ji ˇr´ı Matas. BOP challenge 2023 on detection, segmentation and pose estimation of seen and unseen rigid objects. Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2024. 2, 3, 5, 6, 7, 12

    work page 2023

  2. [1]

    Super-fibonacci spirals: Fast, low-discrepancy sampling of so (3)

    Marc Alexa. Super-fibonacci spirals: Fast, low-discrepancy sampling of so (3). In CVPR, 2022. 5

    2022

  3. [2]

    ZS6D: Zero- Shot 6D Object Pose Estimation Using Vision Transformers

    Philipp Ausserlechner, David Haberger, Stefan Thalhammer, Jean-Baptiste Weibel, and Markus Vincze. ZS6D: Zero- Shot 6D Object Pose Estimation Using Vision Transformers

  4. [3]

    Intro- ducing hot3d: An egocentric dataset for 3d hand and object tracking

    Prithviraj Banerjee, Sindi Shkodrani, Pierre Moulon, Shreyas Hampali, Fan Zhang, Jade Fountain, Edward Miller, Selen Basol, Richard Newcombe, Robert Wang, et al. Intro- ducing hot3d: An egocentric dataset for 3d hand and object tracking. arXiv preprint arXiv:2406.09598, 2024. 1, 7, 12, 13

    arXiv 2024

  5. [4]

    Real-time image-based tracking of planes using efficient second-order minimization

    Selim Benhimane and Ezio Malis. Real-time image-based tracking of planes using efficient second-order minimization. In IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004. 1, 3

    work page 2004

  6. [5]

    Learning 6D Object Pose Estimation Using 3D Object Coordinates

    Eric Brachmann, Alexander Krull, Frank Michel, Stefan Gumhold, Jamie Shotton, and Carsten Rother. Learning 6D Object Pose Estimation Using 3D Object Coordinates. In ECCV, 2014. 2, 6, 7, 14

    work page 2014

  7. [6]

    Comport, Eric Marchand, Muriel Pressigout, and Francois Chaumette

    Andrew I. Comport, Eric Marchand, Muriel Pressigout, and Francois Chaumette. Real-time markerless tracking for augmented reality: The virtual visual servoing framework. IEEE Transactions on Visualization and Computer Graph- ics, 2006. 1, 3

    work page 2006

  8. [7]

    Robust 3D tracking with descriptor fields

    Alberto Crivellaro and Vincent Lepetit. Robust 3D tracking with descriptor fields. In CVPR, 2014. 1, 3

    work page 2014

Show all 82 references
  1. [8]

    PoseRBPF: A Rao–Blackwellized particle filter for 6-D object pose tracking

    Xinke Deng, Arsalan Mousavian, Yu Xiang, Fei Xia, Timo- thy Bretl, and Dieter Fox. PoseRBPF: A Rao–Blackwellized particle filter for 6-D object pose tracking. IEEE Transac- tions on Robotics, 2021. 1, 3, 6, 7, 8, 12

    2021

  2. [9]

    BlenderProc: Reducing the reality gap with photorealistic rendering

    Maximilian Denninger, Martin Sundermeyer, Dominik Winkelbauer, Dmitry Olefir, Tom ´aˇs Hoda ˇn, Youssef Zidan, Mohamad Elbadrawy, Markus Knauer, Harinandan Katam, and Ahsan Lodhi. BlenderProc: Reducing the reality gap with photorealistic rendering. RSS Workshops, 2020. 4

    2020

  3. [10]

    Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd

    Andreas Doumanoglou, Rigas Kouskouridas, Sotiris Malas- siotis, and Tae-Kyun Kim. Recovering 6D Object Pose and Predicting Next-Best-View in the Crowd. InCVPR, 2016. 2, 7, 18

    2016

  4. [11]

    Google scanned objects: A high- quality dataset of 3D scanned household items

    Laura Downs, Anthony Francis, Nate Koenig, Brandon Kin- man, Ryan Hickman, Krista Reymann, Thomas B McHugh, and Vincent Vanhoucke. Google scanned objects: A high- quality dataset of 3D scanned household items. ICRA, 2022. 4

    2022

  5. [12]

    Introducing MVTec ITODD – A dataset for 3D object recognition in industry

    Bertram Drost, Markus Ulrich, Paul Bergmann, Philipp Hartinger, and Carsten Steger. Introducing MVTec ITODD – A dataset for 3D object recognition in industry. InICCVW,

  6. [13]

    Real-time visual tracking of complex structures

    Tom Drummond and Roberto Cipolla. Real-time visual tracking of complex structures. IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 2002. 1, 3

    2002

  7. [14]

    Simultaneous local- ization and mapping: part i

    Hugh Durrant-Whyte and Tim Bailey. Simultaneous local- ization and mapping: part i. IEEE robotics & automation magazine, 2006. 2, 5

    2006

  8. [15]

    Project Aria: A new tool for egocentric multi-modal AI research,

    Jakob Engel, Kiran Somasundaram, Michael Goesele, Al- bert Sun, Alexander Gamino, Andrew Turner, Arjang Talat- tof, Arnie Yuan, Bilal Souti, Brighid Meredith, Cheng Peng, Chris Sweeney, Cole Wilson, Dan Barnes, Daniel DeTone, David Caruso, Derek Valleroy, Dinesh Ginjupalli, Du...

  9. [16]

    M. A. Fischler and R. C. Bolles. Random sample consen- sus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 1981. 2, 3, 4

    1981

  10. [17]

    Deep 6-DOF tracking

    Mathieu Garon and Jean-Franc ¸ois Lalonde. Deep 6-DOF tracking. IEEE transactions on visualization and computer graphics, 2017. 1, 3

    2017

  11. [18]

    A framework for evaluating 6-DoF object track- ers

    Mathieu Garon, Denis Laurendeau, and Jean-Franc ¸ois Lalonde. A framework for evaluating 6-DoF object track- ers. In ECCV, 2018. 3

    2018

  12. [19]

    RAPID - a video rate object tracker

    Chris Harris and Carl Stennett. RAPID - a video rate object tracker. In BMVC, 1990. 1, 3

    1990

  13. [20]

    Bradski, Kurt Konolige, and Nassir Navab

    Stefan Hinterstoißer, Vincent Lepetit, Slobodan Ilic, Stefan Holzer, Gary R. Bradski, Kurt Konolige, and Nassir Navab. Model Based Training, Detection and Pose Estimation of Texture-Less 3D Objects in Heavily Cluttered Scenes. In ACCV, 2012. 12

    2012

  14. [21]

    EPOS: Esti- mating 6D pose of objects with symmetries

    Tom ´aˇs Hoda ˇn, D ´aniel Bar ´ath, and Ji ˇr´ı Matas. EPOS: Esti- mating 6D pose of objects with symmetries. CVPR, 2020. 1

    2020

  15. [22]

    T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-Less Ob- jects

    Tomas Hodan, Pavel Haluza, Stepan Obdrzalek, Jiri Matas, Manolis Lourakis, and Xenophon Zabulis. T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-Less Ob- jects. 2017. 2, 7, 15

    2017

  16. [23]

    T-LESS: An RGB-D dataset for 6D pose estimation of texture-less ob- jects

    Tom ´aˇs Hoda ˇn, Pavel Haluza, ˇStˇep´an Obdrˇz´alek, Jiˇr´ı Matas, Manolis Lourakis, and Xenophon Zabulis. T-LESS: An RGB-D dataset for 6D pose estimation of texture-less ob- jects. WACV, 2017. 6

    2017

  17. [24]

    On evalu- ation of 6D object pose estimation

    Tom ´aˇs Hodaˇn, Jiˇr´ı Matas, and ˇStˇep´an Obdrˇz´alek. On evalu- ation of 6D object pose estimation. ECCVW, 2016. 12

    2016

  18. [25]

    BOP: Benchmark for 6D object pose esti- mation

    Tom ´aˇs Hodaˇn, Frank Michel, Eric Brachmann, Wadim Kehl, Anders Glent Buch, Dirk Kraft, Bertram Drost, Joel Vidal, Stephan Ihrke, Xenophon Zabulis, Caner Sahin, Fabian Man- hardt, Federico Tombari, Tae-Kyun Kim, Ji ˇr´ı Matas, and Carsten Rother. BOP: Benchmark for 6D object...

    2018

  19. [26]

    Bop: Bench- mark for 6D Object Pose Estimation

    Tomas Hodan, Frank Michel, Eric Brachmann, Wadim Kehl, Anders Glentbuch, Dirk Kraft, Bertram Drost, Joel Vidal, Stephan Ihrke, Xenophon Zabulis, and Others. Bop: Bench- mark for 6D Object Pose Estimation. In ECCV, 2018. 2, 7

    2018

  20. [27]

    BOP Challenge 2020 on 6D Object Localization

    Tomas Hodan, Martin Sundermeyer, Bertram Drost, Yann Labb´e, Eric Brachmann, Frank Michel, Carsten Rother, and Jiri Matas. BOP Challenge 2020 on 6D Object Localization. In ECCV, 2020. 7

    2020

  21. [29]

    Single-Stage 6D Object Pose Estimation

    Yinlin Hu, Pascal Fua, Wei Wang, and Mathieu Salzmann. Single-Stage 6D Object Pose Estimation. In CVPR, 2020. 2

    2020

  22. [30]

    Depth- based object tracking using a robust gaussian filter

    Jan Issac, Manuel W ¨uthrich, Cristina Garcia Cifuentes, Jean- nette Bohg, Sebastian Trimpe, and Stefan Schaal. Depth- based object tracking using a robust gaussian filter. In ICRA,

  23. [31]

    Homebreweddb: RGB-D Dataset for 6D Pose Estimation of 3D Objects

    Roman Kaskman, Sergey Zakharov, Ivan Shugurov, and Slo- bodan Ilic. Homebreweddb: RGB-D Dataset for 6D Pose Estimation of 3D Objects. In ICCV Workshops, 2019. 2, 7, 16

    2019

  24. [32]

    SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again

    Wadim Kehl, Fabian Manhardt, Federico Tombari, Slobodan Ilic, and Nassir Navab. SSD-6D: Making RGB-Based 3D Detection and 6D Pose Estimation Great Again. In ICCV,

  25. [33]

    Adam: A method for stochastic opti- mization

    Diederik P Kingma. Adam: A method for stochastic opti- mization. arXiv preprint arXiv:1412.6980, 2014. 7

    2014 arXiv

  26. [34]

    CosyPose: Consistent multi-view multi-object 6D pose estimation

    Yann Labb ´e, Justin Carpentier, Mathieu Aubry, and Josef Sivic. CosyPose: Consistent multi-view multi-object 6D pose estimation. ECCV, 2020. 1, 2

    2020

  27. [35]

    MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare

    Yann Labb ´e, Lucas Manuelli, Arsalan Mousavian, Stephen Tyree, Stan Birchfield, Jonathan Tremblay, Justin Carpentier, Mathieu Aubry, Dieter Fox, and Josef Sivic. MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare. In CoRL, 2022. 1, 2, 3, 4, 5, 6, 7

    2022

  28. [36]

    EPnP: An accurate O(n) solution to the PnP problem

    Vincent Lepetit, Francesc Moreno-Noguer, and Pascal Fua. EPnP: An accurate O(n) solution to the PnP problem. IJCV,

  29. [37]

    DeepIM: Deep iterative matching for 6d pose estimation

    Yi Li, Gu Wang, Xiangyang Ji, Yu Xiang, and Dieter Fox. DeepIM: Deep iterative matching for 6d pose estimation. ECCV, 2018. 1, 2, 3

    2018

  30. [38]

    CDPN: Coordinates-Based Disentangled Pose Network for Real- Time RGB-Based 6DoF Object Pose Estimation

    Zhigang Li, Gu Wang, and Xiangyang Ji. CDPN: Coordinates-Based Disentangled Pose Network for Real- Time RGB-Based 6DoF Object Pose Estimation. In ICCV,

  31. [39]

    Keypoint-based category-level ob- ject pose tracking from an rgb sequence with uncertainty es- timation

    Yunzhi Lin, Jonathan Tremblay, Stephen Tyree, Patricio A Vela, and Stan Birchfield. Keypoint-based category-level ob- ject pose tracking from an rgb sequence with uncertainty es- timation. In ICRA, 2022. 3

    2022

  32. [40]

    Xingyu Liu, Ruida Zhang, Chenyangguang Zhang, Bowen Fu, Jiwen Tang, Xiquan Liang, Jingyi Tang, Xiaotian Cheng, Yukang Zhang, Gu Wang, and Xiangyang Ji. GDRNPP. https : / / github . com / shanice - l / gdrnpp_bop2022, 2022. 1, 2

    2022

  33. [41]

    Lucas and Takeo Kanade

    Bruce D. Lucas and Takeo Kanade. An iterative image reg- istration technique with an application to stereo vision. In Proceedings of the 7th International Joint Conference on Ar- tificial Intelligence, 1981. 1, 3

    1981

  34. [42]

    3d model-based 6d object pose tracking on rgb images using particle filtering and heuristic optimization

    Mateusz Majcher and Bogdan Kwolek. 3d model-based 6d object pose tracking on rgb images using particle filtering and heuristic optimization. In VISIGRAPP (5: VISAPP) ,

  35. [43]

    Meta. Quest 3. https://www.meta.com/quest/ quest-3/, 2023. 1

    2023

  36. [44]

    GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects

    Sungphill Moon, Hyeontae Son, Dongcheol Hur, and Sang- wook Kim. GenFlow: Generalizable Recurrent Flow for 6D Pose Refinement of Novel Objects. In arXiv preprint arXiv:2403.11510, 2024. 1, 2, 3, 4, 6, 7

    2024 arXiv

  37. [45]

    The levenberg-marquardt algorithm: imple- mentation and theory

    Jorge J Mor ´e. The levenberg-marquardt algorithm: imple- mentation and theory. In Numerical analysis: proceedings of the biennial Conference held at Dundee, year=2006, or- ganization=Springer. 4

    2006

  38. [46]

    PIZZA: A Power- ful Image-Only Zero-Shot Zero-CAD Approach to 6 DoF Tracking

    Van Nguyen Nguyen, Yuming Du, Yang Xiao, Michael Ramamonjisoa, and Vincent Lepetit. PIZZA: A Power- ful Image-Only Zero-Shot Zero-CAD Approach to 6 DoF Tracking. 2022. 3

    2022

  39. [47]

    CNOS: A Strong Base- line for CAD-based Novel Object Segmentation

    Van Nguyen Nguyen, Thibault Groueix, Georgy Ponimatkin, Vincent Lepetit, and Tomas Hodan. CNOS: A Strong Base- line for CAD-based Novel Object Segmentation. In ICCVW,

  40. [48]

    Gigapose: Fast and robust novel object pose estimation via one correspondence

    Van Nguyen Nguyen, Thibault Groueix, Mathieu Salzmann, and Vincent Lepetit. Gigapose: Fast and robust novel object pose estimation via one correspondence. In CVPR, 2024. 1, 7

    2024

  41. [49]

    Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions

    Van Nguyen Nguyen, Yinlin Hu, Yang Xiao, Mathieu Salz- mann, and Vincent Lepetit. Templates for 3D Object Pose Estimation Revisited: Generalization to New Objects and Robustness to Occlusions. In CVPR, 2022. 1

    2022

  42. [50]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 2, 4, 5, 6

    2023 arXiv

  43. [51]

    Found- pose: Unseen object pose estimation with foundation fea- tures

    Evin Pınar ¨Ornek, Yann Labb ´e, Bugra Tekin, Lingni Ma, Cem Keskin, Christian Forster, and Tomas Hodan. Found- pose: Unseen object pose estimation with foundation fea- tures. In ECCV, 2024. 1, 2, 3, 4, 5, 6, 7, 12, 13

    2024

  44. [52]

    Feature harvesting for tracking-by-detection

    Mustafa ¨Ozuysal, Vincent Lepetit, Franc ¸ois Fleuret, and Pascal Fua. Feature harvesting for tracking-by-detection. In Ale ˇs Leonardis, Horst Bischof, and Axel Pinz, editors, ECCV, 2006. 1, 3

    2006

  45. [53]

    Pix2pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimation

    Kiru Park, Timothy Patten, and Markus Vincze. Pix2pose: Pixel-Wise Coordinate Regression of Objects for 6D Pose Estimation. In ICCV, 2019. 2

    2019

  46. [54]

    BB8: A Scalable, Accu- rate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects Without Using Depth

    Mahdi Rad and Vincent Lepetit. BB8: A Scalable, Accu- rate, Robust to Partial Occlusion Method for Predicting the 3D Poses of Challenging Objects Without Using Depth. In ICCV, 2017. 1, 2 10

    2017

  47. [55]

    Vi- sion transformers for dense prediction

    Ren ´e Ranftl, Alexey Bochkovskiy, and Vladlen Koltun. Vi- sion transformers for dense prediction. In ICCV, 2021. 4, 6

    2021

  48. [56]

    Fusing points and lines for high performance tracking

    Edward Rosten and Tom Drummond. Fusing points and lines for high performance tracking. In ICCV, 2005. 1, 3

    2005

  49. [57]

    ORB: an efficient alternative to SIFT or SURF

    Ethan Rublee, Vincent Rabaud, Kurt Konolige, and Gary Bradski. ORB: an efficient alternative to SIFT or SURF. In ICCV, 2011. 1, 3

    2011

  50. [58]

    Optimal local searching for fast and robust textureless 3D object tracking in highly clut- tered backgrounds

    Byung-Kuk Seo, Hanhoon Park, Jong-Il Park, Stefan Hin- terstoisser, and Slobodan Ilic. Optimal local searching for fast and robust textureless 3D object tracking in highly clut- tered backgrounds. IEEE Transactions on Visualization and Computer Graphics, 2014. 1, 3

    2014

  51. [59]

    A direct method for ro- bust model-based 3D object tracking from a monocular RGB image

    Byung-Kuk Seo and Harald Wuest. A direct method for ro- bust model-based 3D object tracking from a monocular RGB image. In ECCVW, 2016. 1, 3

    2016

  52. [60]

    OpenGL programming guide: the offi- cial guide to learning OpenGL, versions 3.0 and 3.1

    Dave Shreiner et al. OpenGL programming guide: the offi- cial guide to learning OpenGL, versions 3.0 and 3.1. Pearson Education, 2009. 5

    2009

  53. [61]

    Iryna Skrypnyk and David G. Lowe. Scene modelling, recognition and tracking with invariant image features. In ISMAR, 2004. 1, 3

    2004

  54. [62]

    Srt3d: A sparse region- based 3d object tracking approach for the real world

    Manuel Stoiber, Martin Pfanne, Klaus H Strobl, Rudolph Triebel, and Alin Albu-Sch ¨affer. Srt3d: A sparse region- based 3d object tracking approach for the real world. Inter- national Journal of Computer Vision , 2022. 1, 3, 6, 7, 8, 12

    2022

  55. [63]

    Iterative corresponding geometry: Fusing region and depth for highly efficient 3D tracking of textureless objects

    Manuel Stoiber, Martin Sundermeyer, and Rudolph Triebel. Iterative corresponding geometry: Fusing region and depth for highly efficient 3D tracking of textureless objects. In CVPR, 2022. 3

    2022

  56. [64]

    Bop Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects

    Martin Sundermeyer, Tom ´aˇs Hodaˇn, Yann Labbe, Gu Wang, Eric Brachmann, Bertram Drost, Carsten Rother, and Ji ˇr´ı Matas. Bop Challenge 2022 on Detection, Segmentation and Pose Estimation of Specific Rigid Objects. In CVPR, 2023. 2

    2022

  57. [65]

    Raft: Recurrent all-pairs field transforms for optical flow

    Zachary Teed and Jia Deng. Raft: Recurrent all-pairs field transforms for optical flow. In ECCV, 2020. 2, 3, 4, 5

    2020

  58. [66]

    Sinha, and Pascal Fua

    Bugra Tekin, Sudipta N. Sinha, and Pascal Fua. Real-Time Seamless Single Shot 6D Object Pose Prediction. In CVPR,

  59. [67]

    Large-displacement 3d object tracking with hybrid non-local optimization

    Xuhui Tian, Xinran Lin, Fan Zhong, and Xueying Qin. Large-displacement 3d object tracking with hybrid non-local optimization. In ECCV, 2022. 1, 3, 6, 7, 8, 12

    2022

  60. [68]

    A region-based gauss-newton approach to real-time monocular multiple object tracking

    Henning Tjaden, Ulrich Schwanecke, Elmar Sch ¨omer, and Daniel Cremers. A region-based gauss-newton approach to real-time monocular multiple object tracking. TPAMI, 2018. 2, 6, 7, 8

    2018

  61. [69]

    Stable real- time 3D tracking using online and offline information.PAMI,

    Luca Vacchetti, Vincent Lepetit, and Pascal Fua. Stable real- time 3D tracking using online and offline information.PAMI,

  62. [70]

    6- PACK: Category-level 6D pose tracker with anchor-based keypoints

    Chen Wang, Roberto Mart ´ın-Mart´ın, Danfei Xu, Jun Lv, Cewu Lu, Li Fei-Fei, Silvio Savarese, and Yuke Zhu. 6- PACK: Category-level 6D pose tracker with anchor-based keypoints. In ICRA, 2020. 3

    2020

  63. [71]

    GDR-Net: Geometry-Guided Direct Regres- sion Network for Monocular 6D Object Pose Estimation

    Gu Wang, Fabian Manhardt, Federico Tombari, and Xi- angyang Ji. GDR-Net: Geometry-Guided Direct Regres- sion Network for Monocular 6D Object Pose Estimation. In CVPR, 2021. 1

    2021

  64. [72]

    Deep active contours for real-time 6-DoF object tracking

    Long Wang, Shen Yan, Jianan Zhen, Yu Liu, Maojun Zhang, Guofeng Zhang, and Xiaowei Zhou. Deep active contours for real-time 6-DoF object tracking. In ICCV, 2023. 1, 3, 6, 7, 8, 12

    2023

  65. [73]

    Croco v2: Improved cross-view completion pre- training for stereo matching and optical flow

    Philippe Weinzaepfel, Thomas Lucas, Vincent Leroy, Yohann Cabon, Vaibhav Arora, Romain Br ´egier, Gabriela Csurka, Leonid Antsfeld, Boris Chidlovskii, and J ´erˆome Revaud. Croco v2: Improved cross-view completion pre- training for stereo matching and optical flow. InICCV, 2023. 4, 6

    2023

  66. [74]

    Bundletrack: 6D pose track- ing for novel objects without instance or category-level 3D models

    Bowen Wen and Kostas Bekris. Bundletrack: 6D pose track- ing for novel objects without instance or category-level 3D models. In IROS, 2021. 3

    2021

  67. [75]

    se(3)-TrackNet: Data-driven 6D pose tracking by calibrating image residuals in synthetic domains

    Bowen Wen, Chaitanya Mitash, Baozhang Ren, and Kostas E Bekris. se(3)-TrackNet: Data-driven 6D pose tracking by calibrating image residuals in synthetic domains. In IROS,

  68. [76]

    BundleSDF: Neural 6-DoF tracking and 3D reconstruction of unknown objects

    Bowen Wen, Jonathan Tremblay, Valts Blukis, Stephen Tyree, Thomas M ¨uller, Alex Evans, Dieter Fox, Jan Kautz, and Stan Birchfield. BundleSDF: Neural 6-DoF tracking and 3D reconstruction of unknown objects. In CVPR, 2023. 3

    2023

  69. [77]

    Foundationpose: Unified 6d pose estimation and tracking of novel objects

    Bowen Wen, Wei Yang, Jan Kautz, and Stan Birchfield. Foundationpose: Unified 6d pose estimation and tracking of novel objects. arXiv preprint arXiv:2312.08344, 2023. 1, 2, 3, 4, 5

    2023 arXiv

  70. [78]

    Probabilistic object tracking using a range camera

    Manuel W ¨uthrich, Peter Pastor, Mrinal Kalakrishnan, Jean- nette Bohg, and Stefan Schaal. Probabilistic object tracking using a range camera. In IROS, 2013. 3

    2013

  71. [79]

    PoseCNN: A convolutional neural network for 6D object pose estimation in cluttered scenes

    Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, and Dieter Fox. PoseCNN: A convolutional neural network for 6D object pose estimation in cluttered scenes. RSS, 2018. 2, 6, 7, 8, 12, 13, 17

    2018

  72. [80]

    PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes

    Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, and Dieter Fox. PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes. 2018. 2, 7

    2018

  73. [81]

    Shugurov, and Slobodan Ilic

    Sergey Zakharov, Ivan S. Shugurov, and Slobodan Ilic. DPOD: 6D Pose Object Detector and Refiner. In ICCV,

  74. [2019]

    model-to-frame registration

    1, 2 11 Appendix In this appendix, we provide details about the eval- uation metrics used in the object tracking experiments (Sec. A). We also provide quantitative tracking results on the HOT3D [3] dataset (Sec. B), and additional qualitative results for both refinement and tr...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.