Pith. sign in

REVIEW 3 major objections 4 minor 184 references

To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software

T0 review · 3 major / 4 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Unified perception gets one taxonomy, three named levels

desk verdict A genuinely useful AV perception taxonomy with a small internal contradiction the authors can fix before publication. read the letter →

arxiv 2508.20892 v1 pith:DLHAPC62 submitted 2025-08-28 cs.CV cs.RO

Loïc Stratil , Felix Fent , Esteban Rivera , Markus Lienkamp This is my paper
classification cs.CVcs.RO
keywords unifiedperceptionautonomousdrivingsceneunderstandingmulti-objecttrackingmotionpredictiontaxonomydetection-tracking-predictionrepresentationflow
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey sets out to give unified perception — the autonomous-driving idea of merging object detection, tracking, and motion prediction into shared modules instead of separate pipeline stages — a systematic map. Its claim is that every method in this scattered literature lands in one of three named levels: Early Unified Perception (detection + tracking), Late Unified Perception (tracking + prediction), or Full Unified Perception (all three), and that the dividing axis is tracking. The paper sorts methods by how tracking is done (explicit identity assignment vs. implicit temporal continuity in latent features) and by what representation flows between stages (bounding boxes, latent features, or occupancy). A reader gets a shared vocabulary for comparing systems, a way to spot empty design cells, and a statement of why the field's fragmentation has been blocking progress.

What carries the argument

The organizing device is a three-level taxonomy centered on tracking. The levels are defined by which adjacent tasks share a module; the tracking formulation axis distinguishes explicit tracking (persistent object identities, assigned either after the network or inside it) from implicit tracking (soft temporal continuity in latent space), and the representation-flow axis distinguishes bounding-box, latent-feature, and occupancy intermediates. This machinery does the classification work: it decides which level a method belongs to, which training constraints apply (e.g., post-network association is ruled out in Late and Full Unified Perception because it would break joint reasoning), and which

What would settle it

Search for a published or constructable unified perception system that performs detection and prediction in one module with no identity assignment and no temporal-continuity mechanism in its latent features — e.g., a pure occupancy-flow predictor from raw sensors. If such a system performs competitively and cannot be placed in the taxonomy except by relabeling 'implicit tracking' as any temporal correlation, the tracking-centered claim is weakened. A second test: a controlled benchmark holding the backbone fixed and toggling only explicit vs implicit tracking would show whether the tracking ax

Watch

Extended reading notes

Core claim

The paper's central claim is that unified perception is a design space, not a single architecture genre, and that the space is organized by the tracking stage. The taxonomy names three levels of task integration: Early Unified Perception integrates detection with tracking; Late Unified Perception integrates tracking with prediction; Full Unified Perception integrates detection, tracking, and prediction, optionally absorbing localization. Within that, tracking formulation is the load-bearing axis: explicit tracking assigns persistent identities via post-network or in-network association, while implicit tracking keeps temporal continuity in latent representations without committing to identiti

Load-bearing premise

The taxonomy assumes tracking — persistent identity or at least temporal continuity — is the necessary hinge between detection and prediction in every unified perception system; if a unified method built on shared scene occupancy or flow needs no tracking-like structure, the organizing axis would misclassify or omit it.

Editorial extensions

If this is right

  • Early Unified Perception methods, because they output bounding boxes with identities, are always explicitly tracked; no implicit-tracking or occupancy-based EUP method exists yet.
  • Late Unified Perception cannot use post-network association: a hard association step after the network would sever the joint tracking-prediction optimization, so LUP is forced toward either implicit affinity-based tracking or in-network differentiable association.
  • Full Unified Perception absorbs planning-adjacent methods only up to prediction; methods that extend to planning (e.g., end-to-end planners) are deliberately excluded from the level.
  • Intermediate representation choice is predictive of design constraints: bounding-box interfaces create differentiability bottlenecks and information compression, while latent representations avoid both and allow modular submodule replacement.
  • Open research directions follow directly: unified-vs-modular benchmarking, closed-loop evaluation, modality balance (EUP is image-heavy, FUP is LiDAR-heavy), and semi- or self-supervised training to reduce joint-task annotation cost.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper: if tracking is truly the central axis, then identity-free occupancy-flow models are a stress test — a system that predicts future occupancy without any notion of object permanence may fit the taxonomy only by stretching 'implicit tracking' to mean any temporal consistency.
  • Beyond the paper: the taxonomy suggests a concrete controlled experiment — hold one detection backbone fixed and vary only the tracking formulation (implicit vs explicit); divergence in performance would show the tracking axis is causally meaningful, while no divergence would suggest the taxonomy is descriptive rather than functional.
  • Beyond the paper: the open 'occupancy intermediate representation' cell hints at a next generation of unified perception that treats the scene as a field rather than as a set of tracked instances, shifting evaluation from identity metrics toward occupancy and flow metrics.
  • Beyond the paper: the survey's own closed-source statistics (31.1% in EUP, 85.7% in LUP, 75.0% in FUP) imply that the least-studied levels are the least reproducible, so progress may depend as much on releasing artifacts as on proposing new algorithms.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. This survey proposes a taxonomy for unified perception in autonomous driving, organizing methods into Early, Late, and Full Unified Perception (EUP, LUP, FUP) along three axes: task integration, tracking formulation (explicit/implicit, PNA/INA), and representation flow. It reviews a large set of existing joint detection/tracking/prediction methods, tabulates their attributes (modality, input, paradigm, output, architecture, learning strategy, datasets, code availability), and discusses intermediate representations, training strategies, and future research directions.

Significance. If the taxonomy is internally consistent, it fills a clear gap in the survey literature by providing the first systematic framework covering EUP, LUP, and FUP, and by positioning them relative to modular and end-to-end stacks. The paper's strengths are its broad method coverage, explicit scope decisions (e.g., separating FUP from planning), structured tables, and concrete discussion of representational and training trade-offs. The main risk to the central claim is the consistent application of the tracking-formulation axis, and the manuscript currently contains several internal contradictions on exactly this point.

major comments (3)
  1. [Sec. V and Table III] The taxonomy's PNA/INA axis is applied inconsistently at the LUP boundary. Sec. V states: 'As tracking is addressed in union with prediction, PNA is not feasible, as post hoc association would break the joint reasoning process and prevent shared optimization between tasks.' Yet the same section describes MTP [118] as generating tracking hypotheses via 'a deterministic, non-differentiable process external to the network, a form of PNA,' and Table III includes MTP as an LUP method under 'Imp. T.' If MTP is PNA, then PNA is feasible in LUP; if PNA is infeasible, then MTP is misclassified. Please revise the claim (e.g., 'full end-to-end PNA is not feasible') and align the MTP table entry with the text.
  2. [Sec. IV.C and Table II] Sec. IV.C states 'As the association is performed internally, JDTQ methods are inherently INA.' Two paragraphs later, TransTrack [75] is classified as JDTQ but described as relying on 'post-decoding IoU matching, which makes it PNA,' and Table II lists it as 'JDTQ - PNA.' This directly contradicts the 'inherently INA' claim and the definition of JDTQ. Either TransTrack should be treated as a boundary/hybrid case, or the general statement should be qualified to exclude methods with external association.
  3. [Sec. VI.C and Table IV] Sec. VI.C introduces 'an alternative field' that 'generates occupancy outputs without relying on object detection, implicit tracking, and prediction as separate goals,' then groups Khurana et al. [179] and Occ4Cast [180] under this description. However, the subsection heading is 'Occupancy Output and Implicit Tracking' and Table IV labels both methods 'Imp. T.' This is an internal contradiction in the tracking axis that affects the completeness claim for FUP. Please reclassify these methods, or revise the narrative to explain why they are considered implicit tracking despite the text saying they do not rely on it.
minor comments (4)
  1. [Fig. 4] The caption uses 'JQDT' while the text and Table II consistently use 'JDTQ.' Please correct the typo.
  2. [General formatting] There are numerous LaTeX spacing artifacts, e.g., 'V oxelNeXt,' 'V oxel,' and similar in tables and body text. Please fix the source to render 'Voxel...' correctly.
  3. [Tables III and IV] The legends for paradigm abbreviations ('Imp. T', 'Exp. T', 'A+M', 'M', etc.) are split across table footnotes and are not fully self-contained. A reader should be able to parse the tables without going back to Sec. III. Please add complete legend entries directly under each table.
  4. [Sec. VII.C] The open-source statistics (31.1% EUP, 85.7% LUP, 75.0% FUP) are stated without derivation. Since 'Code' availability is marked only as ✓/✗ in Tables II-IV, please clarify how these percentages are computed and which entries count as open-source.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity; the survey's taxonomy is an organizing framework, not a derivation, and its self-citations are not load-bearing.

full rationale

This is a survey paper, so the circularity test applies to the claimed derivation chain behind the taxonomy. The taxonomy (EUP/LUP/FUP) is introduced in Sec. III as a structured way to organize existing methods by task integration, tracking formulation, and representation flow; it is not fitted to data, and no quantity is predicted from a fitted parameter. The three paradigms are defined by which of detection/tracking/prediction are unified, and the subsequent sections classify externally published methods into those categories. No step reduces to its own input by construction. The self-citations ([7], [24], [122], with [122] also one of the surveyed LUP methods) are ordinary references to prior work from the same group; none is used as the sole justification for the taxonomy's validity, and no 'uniqueness theorem' from the authors' prior work is invoked to forbid alternative organizations. The paper explicitly differentiates its scope from Dal'Col et al. [33], so the 'first comprehensive framework' claim is a positioning statement, not a derived result. The skeptic's identified tension—Sec. V asserts PNA is not feasible in LUP while describing MTP's external hypothesis generation as 'a form of PNA, meaning MTP does not fully realize end-to-end implicit tracking'—is an internal classification inconsistency, not a circularity: the contradiction does not make the taxonomy's content equivalent to its inputs. Therefore score 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The survey's factual content comes from cited literature; its only new construction is the taxonomy, which is a classification scheme rather than a fitted model. No free parameters or physical entities are introduced. The main implicit assumptions concern completeness and the centrality of tracking.

assumptions (3)
  • domain assumption The selected set of papers is a comprehensive and representative sample of unified perception.
    Sections IV-VI select and classify methods based on the authors' judgment; no systematic search protocol or inclusion criteria is given, so comprehensiveness is assumed.
  • domain assumption Tracking is the central intermediate stage connecting detection and prediction.
    Sec. III states 'the central design element across all unified perception paradigms is tracking, which serves as the intermediate stage connecting object detection and motion prediction.'
  • domain assumption Explicit/implicit tracking and PNA/INA categories cleanly partition all unified perception methods.
    Sec. III adopts PNA/INA from Cai et al.; Sec. V's MTP case shows a borderline PNA method inside LUP, so the partition is not fully clean.

how reviews work

0 comments
Cite this review

Pith. "Pith review of To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software." pith.science (2026). https://pith.science/paper/DLHAPC62

@misc{pith2026250820892,
  author       = {Pith},
  title        = {Pith review of: To New Beginnings: A Survey of Unified Perception in Autonomous Vehicle Software},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/DLHAPC62}},
  note         = {Machine review of arXiv:2508.20892}
}
read the original abstract

Autonomous vehicle perception typically relies on modular pipelines that decompose the task into detection, tracking, and prediction. While interpretable, these pipelines suffer from error accumulation and limited inter-task synergy. Unified perception has emerged as a promising paradigm that integrates these sub-tasks within a shared architecture, potentially improving robustness, contextual reasoning, and efficiency while retaining interpretable outputs. In this survey, we provide a comprehensive overview of unified perception, introducing a holistic and systemic taxonomy that categorizes methods along task integration, tracking formulation, and representation flow. We define three paradigms -Early, Late, and Full Unified Perception- and systematically review existing methods, their architectures, training strategies, datasets used, and open-source availability, while highlighting future research directions. This work establishes the first comprehensive framework for understanding and advancing unified perception, consolidates fragmented efforts, and guides future research toward more robust, generalizable, and interpretable perception.

Figures

Figures reproduced from arXiv: 2508.20892 by the authors.

Figure 1
Figure 1. Perception is either modular or implicitly learned within end-to-end driving software stacks. Unified perception, an [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Unified perception paradigms: Modular AV stacks perform perception sequentially. Through our taxonomy, we identify [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Overview of proposed taxonomy with in- and outputs. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: The EUP paradigm with its three sub-paradigms: joint [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Overview of the two tracking paradigms in unified per [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]
Figure 6
Figure 6. Figure 6: Common prediction output representation types. For [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: Common intermediate representations propagated in [PITH_FULL_IMAGE:figures/full_fig_p014_7.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

184 extracted references · 59 canonical work pages

  1. [118]

    Mtp: Multi- hypothesis tracking and prediction for reduced error propagation

    Xinshuo Weng, Boris Ivanovic, and Marco Pavone. Mtp: Multi- hypothesis tracking and prediction for reduced error propagation. In 2022 IEEE Intelligent Vehicles Symposium (IV) , pages 1218–1225. IEEE, 2022

    2022

  2. [75]

    Transtrack: Multiple object tracking with transformer

    Peize Sun, Jinkun Cao, Yi Jiang, Rufeng Zhang, Enze Xie, Zehuan Yuan, Changhu Wang, and Ping Luo. Transtrack: Multiple object tracking with transformer. arXiv preprint arXiv:2012.15460 , 2020

    arXiv 2012

  3. [179]

    Point cloud forecasting as a proxy for 4d occupancy forecasting

    Tarasha Khurana, Peiyun Hu, David Held, and Deva Ramanan. Point cloud forecasting as a proxy for 4d occupancy forecasting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1116–1124, 2023

    work page 2023

  4. [180]

    Lidar-based 4d occupancy completion and forecasting

    Xinhao Liu, Moonjun Gong, Qi Fang, Haoyu Xie, Yiming Li, Hang Zhao, and Chen Feng. Lidar-based 4d occupancy completion and forecasting. In 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 11102–11109. IEEE, 2024

    work page 2024

  5. [1]

    Autoware on board: Enabling autonomous vehicles with embedded systems

    Shinpei Kato, Shota Tokunaga, Yuya Maruyama, Seiya Maeda, Manato Hirabayashi, Yuki Kitsukawa, Abraham Monrroy, Tomohito Ando, Yusuke Fujii, and Takuya Azumi. Autoware on board: Enabling autonomous vehicles with embedded systems. In 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS) , pages 287–296. IEEE, 2018

    2018

  6. [2]

    Apollo: Open source autonomous driving plat- form

    Baidu Apollo Team. Apollo: Open source autonomous driving plat- form. https://www.apollo.auto/apollo-self-driving, 2017. Accessed: April 24, 2025

    2017

  7. [3]

    Planning- oriented autonomous driving

    Yihan Hu, Jiazhi Yang, Li Chen, Keyu Li, Chonghao Sima, Xizhou Zhu, Siqi Chai, Senyao Du, Tianwei Lin, Wenhai Wang, et al. Planning- oriented autonomous driving. In Proceedings of the IEEE/CVF confer- ence on computer vision and pattern recognition , pages 17853–17862, 2023

    2023

  8. [4]

    LingoQA: Visual Question Answering for Autonomous Driving

    Ana-Maria Marcu, Long Chen, Jan H ¨unermann, Alice Karnsund, Benoit Hanotte, Prajwal Chidananda, Saurabh Nair, Vijay Badri- narayanan, Alex Kendall, Jamie Shotton, and Oleg Sinavski. LingoQA: Visual Question Answering for Autonomous Driving. arXiv preprint arXiv:2312.14115, 2023

    arXiv 2023

Show all 184 references
  1. [5]

    Hydra-mdp: End- to-end multimodal planning with multi-target hydra-distillation

    Zhenxin Li, Kailin Li, Shihao Wang, Shiyi Lan, Zhiding Yu, Yishen Ji, Zhiqi Li, Ziyue Zhu, Jan Kautz, Zuxuan Wu, et al. Hydra-mdp: End- to-end multimodal planning with multi-target hydra-distillation. arXiv preprint arXiv:2406.06978, 2024. 16

    2024 arXiv

  2. [6]

    Robustness-aware 3d object detection in autonomous driving: A review and outlook

    Ziying Song, Lin Liu, Feiyang Jia, Yadan Luo, Caiyan Jia, Guoxin Zhang, Lei Yang, and Li Wang. Robustness-aware 3d object detection in autonomous driving: A review and outlook. IEEE Transactions on Intelligent Transportation Systems, 2024

    2024

  3. [7]

    Scenario understanding and motion prediction for au- tonomous vehicles—review and comparison

    Phillip Karle, Maximilian Geisslinger, Johannes Betz, and Markus Lienkamp. Scenario understanding and motion prediction for au- tonomous vehicles—review and comparison. IEEE Transactions on Intelligent Transportation Systems, 23(10):16962–16982, 2022

    2022

  4. [8]

    3D object detection for autonomous driving: A comprehensive survey

    Jiageng Mao, Shaoshuai Shi, Xiaogang Wang, and Hongsheng Li. 3D object detection for autonomous driving: A comprehensive survey. International Journal of Computer Vision , 131(8):1909–1963, 2023

    1909

  5. [9]

    3d object detection from images for autonomous driving: a survey

    Xinzhu Ma, Wanli Ouyang, Andrea Simonelli, and Elisa Ricci. 3d object detection from images for autonomous driving: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence , 46(5):3537–3556, 2023

    2023

  6. [10]

    Echoes beyond points: Unleashing the power of raw radar data in multi- modality fusion

    Yang Liu, Feng Wang, Naiyan Wang, and Zhao-Xiang Zhang. Echoes beyond points: Unleashing the power of raw radar data in multi- modality fusion. Advances in Neural Information Processing Systems , 36:53964–53982, 2023

    2023

  7. [11]

    Multi- modal 3d object detection in autonomous driving: A survey and taxonomy

    Li Wang, Xinyu Zhang, Ziying Song, Jiangfeng Bi, Guoxin Zhang, Haiyue Wei, Liyao Tang, Lei Yang, Jun Li, Caiyan Jia, et al. Multi- modal 3d object detection in autonomous driving: A survey and taxonomy. IEEE Transactions on Intelligent Vehicles, 8(7):3781–3798, 2023

    2023

  8. [12]

    Radar-camera fusion for object detection and semantic segmentation in autonomous driving: A comprehensive review

    Shanliang Yao, Runwei Guan, Xiaoyu Huang, Zhuoxiao Li, Xiangyu Sha, Yong Yue, Eng Gee Lim, Hyungjoon Seo, Ka Lok Man, Xiaohui Zhu, et al. Radar-camera fusion for object detection and semantic segmentation in autonomous driving: A comprehensive review. IEEE Transactions on Inte...

  9. [13]

    A review of lidar- based 3d object detection via deep learning approaches towards robust connected and autonomous vehicles

    Nang Htet Htet Aung, Paramin Sangwongngam, Rungroj Jintametha- sawat, Shashi Shah, and Lunchakorn Wuttisittikulkij. A review of lidar- based 3d object detection via deep learning approaches towards robust connected and autonomous vehicles. IEEE Transactions on Intelligent Vehi...

    2024

  10. [14]

    Multiple object tracking: A literature review

    Wenhan Luo, Junliang Xing, Anton Milan, Xiaoqin Zhang, Wei Liu, and Tae-Kyun Kim. Multiple object tracking: A literature review. Artificial intelligence, 293:103448, 2021

    2021

  11. [15]

    Multiple object tracking in recent times: A literature review

    M Bashar, S Islam, KK Hussain, MB Hasan, ABMA Rahman, and MH Kabir. Multiple object tracking in recent times: A literature review. arXiv preprint arXiv:2209.04796 , 2022

    2022

  12. [16]

    A system- atic survey on recent deep learning-based approaches to multi-object tracking

    Harshit Agrawal, Agrya Halder, and Pratik Chattopadhyay. A system- atic survey on recent deep learning-based approaches to multi-object tracking. Multimedia Tools and Applications , 83(12):36203–36259, 2024

    2024

  13. [17]

    Multi-object tracking: a systematic literature review

    Saif Hassan, Ghulam Mujtaba, Asif Rajput, and Noureen Fatima. Multi-object tracking: a systematic literature review. Multimedia Tools and Applications, 83(14):43439–43492, 2024

    2024

  14. [18]

    Data association in multiple object tracking: A survey of recent techniques

    Lionel Rakai, Huansheng Song, ShiJie Sun, Wentao Zhang, and Yanni Yang. Data association in multiple object tracking: A survey of recent techniques. Expert systems with applications , 192:116300, 2022

    2022

  15. [19]

    A review of tracking and trajectory prediction methods for autonomous driving

    Florin Leon and Marius Gavrilescu. A review of tracking and trajectory prediction methods for autonomous driving. Mathematics, 9(6):660, 2021

    2021

  16. [20]

    A survey on trajectory-prediction methods for autonomous driving

    Yanjun Huang, Jiatong Du, Ziru Yang, Zewei Zhou, Lin Zhang, and Hong Chen. A survey on trajectory-prediction methods for autonomous driving. IEEE Transactions on Intelligent Vehicles, 7(3):652–674, 2022

    2022

  17. [21]

    Incorporating driving knowledge in deep learning based vehicle trajectory prediction: A survey

    Zhezhang Ding and Huijing Zhao. Incorporating driving knowledge in deep learning based vehicle trajectory prediction: A survey. IEEE Transactions on Intelligent Vehicles, 8(8):3996–4015, 2023

    2023

  18. [22]

    Machine learning for autonomous vehicle’s trajectory prediction: A comprehensive survey, challenges, and future research directions

    Vibha Bharilya and Neetesh Kumar. Machine learning for autonomous vehicle’s trajectory prediction: A comprehensive survey, challenges, and future research directions. Vehicular Communications, 46:100733, 2024

    2024

  19. [23]

    A review of deep learning-based vehicle motion prediction for au- tonomous driving

    Renbo Huang, Guirong Zhuo, Lu Xiong, Shouyi Lu, and Wei Tian. A review of deep learning-based vehicle motion prediction for au- tonomous driving. Sustainability, 15(20):14716, 2023

    2023

  20. [24]

    Evaluating pedestrian trajectory prediction methods with respect to autonomous driving

    Nico Uhlemann, Felix Fent, and Markus Lienkamp. Evaluating pedestrian trajectory prediction methods with respect to autonomous driving. IEEE Transactions on Intelligent Transportation Systems , 2024

    2024

  21. [25]

    Vision meets robotics: The kitti dataset

    Andreas Geiger, Philip Lenz, Christoph Stiller, and Raquel Urtasun. Vision meets robotics: The kitti dataset. The international journal of robotics research, 32(11):1231–1237, 2013

    2013

  22. [26]

    nuscenes: A multimodal dataset for autonomous driving

    Holger Caesar, Varun Bankiti, Alex H Lang, Sourabh V ora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. nuscenes: A multimodal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern r...

    2020

  23. [27]

    Scalability in perception for autonomous driving: Waymo open dataset

    Pei Sun, Henrik Kretzschmar, Xerxes Dotiwalla, Aurelien Chouard, Vijaysai Patnaik, Paul Tsui, James Guo, Yin Zhou, Yuning Chai, Benjamin Caine, et al. Scalability in perception for autonomous driving: Waymo open dataset. In Proceedings of the IEEE/CVF conference on computer vi...

    2020

  24. [28]

    Recent advancements in end-to-end autonomous driving using deep learning: A survey

    Pranav Singh Chib and Pravendra Singh. Recent advancements in end-to-end autonomous driving using deep learning: A survey. IEEE Transactions on Intelligent Vehicles, 9(1):103–118, 2023

    2023

  25. [29]

    A survey of end-to-end driving: Architectures and training methods

    Ardi Tampuu, Tambet Matiisen, Maksym Semikin, Dmytro Fishman, and Naveed Muhammad. A survey of end-to-end driving: Architectures and training methods. IEEE Transactions on Neural Networks and Learning Systems, 33(4):1364–1384, 2020

    2020

  26. [30]

    End-to-end autonomous driving using deep learning: A systematic review

    Apoorv Singh. End-to-end autonomous driving using deep learning: A systematic review. arXiv preprint arXiv:2311.18636 , 2023

    2023 arXiv

  27. [31]

    End-to-end autonomous driving: Challenges and frontiers

    Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, and Hongyang Li. End-to-end autonomous driving: Challenges and frontiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

    2024

  28. [32]

    End-to-End Autonomous Driving in CARLA: A Survey

    Youssef Al Ozaibi, Manolo Dulva Hina, and Amar Ramdane-Cherif. End-to-End Autonomous Driving in CARLA: A Survey. IEEE Access, 2024

    2024

  29. [33]

    Joint Perception and Prediction for Autonomous Driving: A Survey

    Lucas Dal’Col, Miguel Oliveira, and V ´ıtor Santos. Joint Perception and Prediction for Autonomous Driving: A Survey. arXiv preprint arXiv:2412.14088, 2024

    2024 arXiv

  30. [34]

    Memot: Multi-object tracking with memory

    Jiarui Cai, Mingze Xu, Wei Li, Yuanjun Xiong, Wei Xia, Zhuowen Tu, and Stefano Soatto. Memot: Multi-object tracking with memory. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8090–8100, 2022

    2022

  31. [35]

    Tracking objects as points

    Xingyi Zhou, Vladlen Koltun, and Philipp Kr ¨ahenb¨uhl. Tracking objects as points. In European conference on computer vision , pages 474–490. Springer, 2020

    2020

  32. [36]

    Objects as points

    Xingyi Zhou, Dequan Wang, and Philipp Kr ¨ahenb¨uhl. Objects as points. arXiv preprint arXiv:1904.07850 , 2019

    1904 arXiv

  33. [37]

    Tubetk: Adopting tubes to track multi-object in a one-step training model

    Bo Pang, Yizhuo Li, Yifan Zhang, Muchen Li, and Cewu Lu. Tubetk: Adopting tubes to track multi-object in a one-step training model. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6308–6318, 2020

    2020

  34. [38]

    Can spatiotempo- ral 3d cnns retrace the history of 2d cnns and imagenet? In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , pages 6546–6555, 2018

    Kensho Hara, Hirokatsu Kataoka, and Yutaka Satoh. Can spatiotempo- ral 3d cnns retrace the history of 2d cnns and imagenet? In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , pages 6546–6555, 2018

    2018

  35. [39]

    Learn- ing to track with object permanence

    Pavel Tokmakov, Jie Li, Wolfram Burgard, and Adrien Gaidon. Learn- ing to track with object permanence. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 10860–10869, 2021

    2021

  36. [40]

    Tracking objects as pixel-wise distributions

    Zelin Zhao, Ze Wu, Yueqing Zhuang, Boxun Li, and Jiaya Jia. Tracking objects as pixel-wise distributions. In European Conference on Computer Vision , pages 76–94. Springer, 2022

    2022

  37. [41]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016

    2016

  38. [42]

    Deformable detr: Deformable transformers for end-to-end object detection

    Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. Deformable detr: Deformable transformers for end-to-end object detection. arXiv preprint arXiv:2010.04159 , 2020

    2010 arXiv

  39. [43]

    Flow- guided feature aggregation for video object detection

    Xizhou Zhu, Yujie Wang, Jifeng Dai, Lu Yuan, and Yichen Wei. Flow- guided feature aggregation for video object detection. In Proceedings of the IEEE international conference on computer vision , pages 408– 417, 2017

    2017

  40. [44]

    Monocular quasi-dense 3d object tracking

    Hou-Ning Hu, Yung-Hsu Yang, Tobias Fischer, Trevor Darrell, Fisher Yu, and Min Sun. Monocular quasi-dense 3d object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence , 45(2):1992–2008, 2022

    1992

  41. [45]

    Faster r- cnn: Towards real-time object detection with region proposal networks

    Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r- cnn: Towards real-time object detection with region proposal networks. Advances in neural information processing systems , 28, 2015

    2015

  42. [46]

    Star-track: Latent motion models for end-to-end 3d object tracking with adaptive spatio-temporal appearance representations

    Simon Doll, Niklas Hanselmann, Lukas Schneider, Richard Schulz, Markus Enzweiler, and Hendrik PA Lensch. Star-track: Latent motion models for end-to-end 3d object tracking with adaptive spatio-temporal appearance representations. IEEE Robotics and Automation Letters , 9(2):132...

    2023

  43. [47]

    Detr3d: 3d object detection from 17 multi-view images via 3d-to-2d queries

    Yue Wang, Vitor Campagnolo Guizilini, Tianyuan Zhang, Yilun Wang, Hang Zhao, and Justin Solomon. Detr3d: 3d object detection from 17 multi-view images via 3d-to-2d queries. In Conference on Robot Learning, pages 180–191. PMLR, 2022

    2022

  44. [48]

    Center-based 3d object detection and tracking

    Tianwei Yin, Xingyi Zhou, and Philipp Krahenbuhl. Center-based 3d object detection and tracking. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 11784– 11793, 2021

    2021

  45. [49]

    V oxelnet: End-to-end learning for point cloud based 3d object detection

    Yin Zhou and Oncel Tuzel. V oxelnet: End-to-end learning for point cloud based 3d object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 4490–4499, 2018

    2018

  46. [50]

    Pointpillars: Fast encoders for object detection from point clouds

    Alex H Lang, Sourabh V ora, Holger Caesar, Lubing Zhou, Jiong Yang, and Oscar Beijbom. Pointpillars: Fast encoders for object detection from point clouds. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 12697–12705, 2019

    2019

  47. [51]

    Exploring simple 3d multi-object tracking for autonomous driving

    Chenxu Luo, Xiaodong Yang, and Alan Yuille. Exploring simple 3d multi-object tracking for autonomous driving. In Proceedings of the IEEE/CVF international conference on computer vision , pages 10488– 10497, 2021

    2021

  48. [52]

    CenterTube: Tracking multiple 3D objects with 4D tubelets in dynamic point clouds

    Hao Liu, Yanni Ma, Qingyong Hu, and Yulan Guo. CenterTube: Tracking multiple 3D objects with 4D tubelets in dynamic point clouds. IEEE Transactions on Multimedia , 25:8793–8804, 2023

    2023

  49. [53]

    V oxelnext: Fully sparse voxelnet for 3d object detection and tracking

    Yukang Chen, Jianhui Liu, Xiangyu Zhang, Xiaojuan Qi, and Jiaya Jia. V oxelnext: Fully sparse voxelnet for 3d object detection and tracking. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21674–21683, 2023

    2023

  50. [54]

    A Multi- Modal Fusion-Based 3D Multi-Object Tracking Framework with Joint Detection

    Xiyang Wang, Chunyun Fu, Jiawei He, Mingguang Huang, Ting Meng, Siyu Zhang, Hangning Zhou, Ziyao Xu, and Chi Zhang. A Multi- Modal Fusion-Based 3D Multi-Object Tracking Framework with Joint Detection. IEEE Robotics and Automation Letters , 2024

    2024

  51. [55]

    Towards real-time multi-object tracking

    Zhongdao Wang, Liang Zheng, Yixuan Liu, Yali Li, and Shengjin Wang. Towards real-time multi-object tracking. In European con- ference on computer vision , pages 107–122. Springer, 2020

    2020

  52. [56]

    Yolov3: An incremental improvement

    Joseph Redmon and Ali Farhadi. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767 , 2018

    2018 arXiv

  53. [57]

    Retina- track: Online single stage joint detection and tracking

    Zhichao Lu, Vivek Rathod, Ronny V otel, and Jonathan Huang. Retina- track: Online single stage joint detection and tracking. In Proceedings of the IEEE/CVF conference on computer vision and pattern recogni- tion, pages 14668–14678, 2020

    2020

  54. [58]

    Multi-object tracking with siamese track-rcnn

    Bing Shuai, Andrew G Berneshawi, Davide Modolo, and Joseph Tighe. Multi-object tracking with siamese track-rcnn. arXiv preprint arXiv:2004.07786, 2020

    2004 arXiv

  55. [59]

    Chained-tracker: Chaining paired attentive regression results for end-to- end joint multiple-object detection and tracking

    Jinlong Peng, Changan Wang, Fangbin Wan, Yang Wu, Yabiao Wang, Ying Tai, Chengjie Wang, Jilin Li, Feiyue Huang, and Yanwei Fu. Chained-tracker: Chaining paired attentive regression results for end-to- end joint multiple-object detection and tracking. In Computer Vision– ECCV 2...

    2020

  56. [60]

    Deft: Detection embeddings for tracking

    Mohamed Chaabane, Peter Zhang, J Ross Beveridge, and Stephen O’Hara. Deft: Detection embeddings for tracking. arxiv preprint arXiv:2102.02267, 2021

    2021 arXiv

  57. [61]

    Fairmot: On the fairness of detection and re-identification in multiple object tracking

    Yifu Zhang, Chunyu Wang, Xinggang Wang, Wenjun Zeng, and Wenyu Liu. Fairmot: On the fairness of detection and re-identification in multiple object tracking. International journal of computer vision , 129:3069–3087, 2021

    2021

  58. [62]

    Joint object detection and multi-object tracking with graph neural networks

    Yongxin Wang, Kris Kitani, and Xinshuo Weng. Joint object detection and multi-object tracking with graph neural networks. In 2021 IEEE international conference on robotics and automation (ICRA) , pages 13708–13715. IEEE, 2021

    2021

  59. [63]

    Multiple object tracking with correlation learning

    Qiang Wang, Yun Zheng, Pan Pan, and Yinghui Xu. Multiple object tracking with correlation learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 3876– 3886, 2021

    2021

  60. [64]

    Anchor-free person search

    Yichao Yan, Jinpeng Li, Jie Qin, Song Bai, Shengcai Liao, Li Liu, Fan Zhu, and Ling Shao. Anchor-free person search. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 7690–7699, 2021

    2021

  61. [65]

    Fcos: Fully convo- lutional one-stage object detection

    Zhi Tian, Chunhua Shen, Hao Chen, and Tong He. Fcos: Fully convo- lutional one-stage object detection. In Proceedings of the IEEE/CVF international conference on computer vision , pages 9627–9636, 2019

    2019

  62. [66]

    Time3d: End-to-end joint monocular 3d object detection and tracking for autonomous driving

    Peixuan Li and Jieyu Jin. Time3d: End-to-end joint monocular 3d object detection and tracking for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 3885–3894, 2022

    2022

  63. [67]

    Monocular 3d detection with geometric constraint embedding and semi-supervised training

    Peixuan Li and Huaici Zhao. Monocular 3d detection with geometric constraint embedding and semi-supervised training. IEEE Robotics and Automation Letters, 6(3):5565–5572, 2021

    2021

  64. [68]

    Track to detect and segment: An online multi-object tracker

    Jialian Wu, Jiale Cao, Liangchen Song, Yu Wang, Ming Yang, and Junsong Yuan. Track to detect and segment: An online multi-object tracker. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 12352–12361, 2021

    2021

  65. [69]

    Minkowski tracker: A sparse spatio-temporal r-cnn for joint object detection and tracking

    JunYoung Gwak, Silvio Savarese, and Jeannette Bohg. Minkowski tracker: A sparse spatio-temporal r-cnn for joint object detection and tracking. arXiv preprint arXiv:2208.10056 , 2022

    2022 arXiv

  66. [70]

    Second: Sparsely embedded convolutional detection

    Yan Yan, Yuxing Mao, and Bo Li. Second: Sparsely embedded convolutional detection. Sensors, 18(10):3337, 2018

    2018

  67. [71]

    Joint multi-object detection and tracking with camera-LiDAR fusion for autonomous driving

    Kemiao Huang and Qi Hao. Joint multi-object detection and tracking with camera-LiDAR fusion for autonomous driving. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 6983–6989. IEEE, 2021

    2021

  68. [72]

    Cross-modal 3d object detection and tracking for auto-driving

    Yihan Zeng, Chao Ma, Ming Zhu, Zhiming Fan, and Xiaokang Yang. Cross-modal 3d object detection and tracking for auto-driving. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 3850–3857. IEEE, 2021

    2021

  69. [73]

    Joint 3d object detection and tracking using spatio-temporal representation of camera image and lidar point clouds

    Junho Koh, Jaekyum Kim, Jin Hyeok Yoo, Yecheol Kim, Dongsuk Kum, and Jun Won Choi. Joint 3d object detection and tracking using spatio-temporal representation of camera image and lidar point clouds. In Proceedings of the AAAI Conference on Artificial Intelligence , volume 36, ...

    2022

  70. [74]

    3d- cvf: Generating joint camera and lidar features using cross-view spatial feature fusion for 3d object detection

    Jin Hyeok Yoo, Yecheol Kim, Jisong Kim, and Jun Won Choi. 3d- cvf: Generating joint camera and lidar features using cross-view spatial feature fusion for 3d object detection. In Computer vision–ECCV 2020: 16th European conference, Glasgow, UK, August 23–28, 2020, proceedings, ...

    2020

  71. [76]

    Trackformer: Multi-object tracking with transformers

    Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixe, and Christoph Feichtenhofer. Trackformer: Multi-object tracking with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8844–8854, 2022

    2022

  72. [77]

    TransCenter: Transformers with dense representations for multiple-object tracking

    Yihong Xu, Yutong Ban, Guillaume Delorme, Chuang Gan, Daniela Rus, and Xavier Alameda-Pineda. TransCenter: Transformers with dense representations for multiple-object tracking. IEEE transactions on pattern analysis and machine intelligence , 45(6):7820–7835, 2022

    2022

  73. [78]

    End-to-end object detection with transformers

    Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. End-to-end object detection with transformers. In European conference on computer vision , pages 213–229. Springer, 2020

    2020

  74. [79]

    Pvt v2: Improved baselines with pyramid vision transformer

    Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, and Ling Shao. Pvt v2: Improved baselines with pyramid vision transformer. Computational visual media, 8(3):415–424, 2022

    2022

  75. [80]

    Motr: End-to-end multiple-object tracking with transformer

    Fangao Zeng, Bin Dong, Yuang Zhang, Tiancai Wang, Xiangyu Zhang, and Yichen Wei. Motr: End-to-end multiple-object tracking with transformer. In European conference on computer vision , pages 659–

  76. [81]

    Motrv2: Bootstrap- ping end-to-end multi-object tracking by pretrained object detectors

    Yuang Zhang, Tiancai Wang, and Xiangyu Zhang. Motrv2: Bootstrap- ping end-to-end multi-object tracking by pretrained object detectors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 22056–22065, 2023

    2023

  77. [82]

    Yolox: Exceeding yolo series in 2021

    Zheng Ge, Songtao Liu, Feng Wang, Zeming Li, and Jian Sun. Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:2107.08430, 2021

    2021 arXiv

  78. [83]

    Motrv3: Release-fetch supervision for end-to-end multi-object tracking

    En Yu, Tiancai Wang, Zhuoling Li, Yuang Zhang, Xiangyu Zhang, and Wenbing Tao. Motrv3: Release-fetch supervision for end-to-end multi-object tracking. arXiv preprint arXiv:2305.14298 , 2023

    2023 arXiv

  79. [84]

    Bridging the gap between end-to-end and non-end-to-end multi-object tracking

    Feng Yan, Weixin Luo, Yujie Zhong, Yiyang Gan, and Lin Ma. Bridging the gap between end-to-end and non-end-to-end multi-object tracking. arXiv preprint arXiv:2305.12724 , 2023

    2023 arXiv

  80. [85]

    MeMOTR: Long-term memory- augmented transformer for multi-object tracking

    Ruopeng Gao and Limin Wang. MeMOTR: Long-term memory- augmented transformer for multi-object tracking. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 9901–9910, 2023

    2023

  81. [86]

    Multi- object Tracking by Detection and Query: an efficient end-to-end manner

    Shukun Jia, Yichao Cao, Feng Yang, Xin Lu, and Xiaobo Lu. Multi- object Tracking by Detection and Query: an efficient end-to-end manner. arXiv preprint arXiv:2411.06197 , 2024

    2024

  82. [87]

    Samba: Synchronized Set-of- Sequences Modeling for Multiple Object Tracking

    Mattia Segu, Luigi Piccinelli, Siyuan Li, Yung-Hsu Yang, Bernt Schiele, and Luc Van Gool. Samba: Synchronized Set-of- Sequences Modeling for Multiple Object Tracking. arXiv preprint arXiv:2410.01806, 2024

    2024 arXiv

  83. [88]

    Mutr3d: A multi-camera tracking framework via 3d-to-2d queries

    Tianyuan Zhang, Xuanyao Chen, Yue Wang, Yilun Wang, and Hang Zhao. Mutr3d: A multi-camera tracking framework via 3d-to-2d queries. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4537–4546, 2022

    2022

  84. [89]

    End-to-end 3d tracking with 18 decoupled queries

    Yanwei Li, Zhiding Yu, Jonah Philion, Anima Anandkumar, Sanja Fidler, Jiaya Jia, and Jose Alvarez. End-to-end 3d tracking with 18 decoupled queries. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 18302–18311, 2023

    2023

  85. [90]

    Ada-track: End-to-end multi-camera 3d multi-object tracking with alternating detection and association

    Shuxiao Ding, Lukas Schneider, Marius Cordts, and Juergen Gall. Ada-track: End-to-end multi-camera 3d multi-object tracking with alternating detection and association. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15184– 15194, 2024

    2024

  86. [91]

    OneTrack: Demystifying the Conflict Between Detection and Tracking in End-to- End 3D Trackers

    Qitai Wang, Jiawei He, Yuntao Chen, and Zhaoxiang Zhang. OneTrack: Demystifying the Conflict Between Detection and Tracking in End-to- End 3D Trackers. In European Conference on Computer Vision, pages 387–404. Springer, 2024

    2024

  87. [92]

    Exploring object-centric temporal modeling for efficient multi-view 3d object detection

    Shihao Wang, Yingfei Liu, Tiancai Wang, Ying Li, and Xiangyu Zhang. Exploring object-centric temporal modeling for efficient multi-view 3d object detection. In Proceedings of the IEEE/CVF international conference on computer vision , pages 3621–3631, 2023

    2023

  88. [93]

    MCTR: Multi Camera Tracking Transformer

    Alexandru Niculescu-Mizil, Deep Patel, and Iain Melvin. MCTR: Multi Camera Tracking Transformer. In Proceedings of the Winter Conference on Applications of Computer Vision, pages 874–884, 2025

    2025

  89. [94]

    JDT3D: Address- ing the Gaps in LiDAR-Based Tracking-by-Attention

    Brian Cheong, Jiachen Zhou, and Steven Waslander. JDT3D: Address- ing the Gaps in LiDAR-Based Tracking-by-Attention. In European Conference on Computer Vision , pages 161–177. Springer, 2024

    2024

  90. [95]

    Mask4former: Mask transformer for 4d panoptic segmentation

    Kadir Yilmaz, Jonas Schult, Alexey Nekrasov, and Bastian Leibe. Mask4former: Mask transformer for 4d panoptic segmentation. In 2024 IEEE International Conference on Robotics and Automation (ICRA) , pages 9418–9425. IEEE, 2024

    2024

  91. [96]

    Motiontrack: Learning robust short-term and long-term motions for multi-object tracking

    Zheng Qin, Sanping Zhou, Le Wang, Jinghai Duan, Gang Hua, and Wei Tang. Motiontrack: Learning robust short-term and long-term motions for multi-object tracking. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 17939–17948, 2023

    2023

  92. [97]

    Transfusion: Robust lidar-camera fusion for 3d object detection with transformers

    Xuyang Bai, Zeyu Hu, Xinge Zhu, Qingqiu Huang, Yilun Chen, Hongbo Fu, and Chiew-Lan Tai. Transfusion: Robust lidar-camera fusion for 3d object detection with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 1090–1099, 2022

    2022

  93. [98]

    Argoverse 2: Next Generation Datasets for Self-driving Perception and Forecasting

    Benjamin Wilson, William Qi, Tanmay Agarwal, John Lambert, Jagjeet Singh, Siddhesh Khandelwal, Bowen Pan, Ratnesh Kumar, Andrew Hartnett, Jhony Kaesemodel Pontes, Deva Ramanan, Peter Carr, and James Hays. Argoverse 2: Next Generation Datasets for Self-driving Perception and Fo...

    2021

  94. [99]

    Leal-Taix ´e, A

    L. Leal-Taix ´e, A. Milan, I. Reid, S. Roth, and K. Schindler. MOTChal- lenge 2015: Towards a Benchmark for Multi-Target Tracking. arxiv preprint arXiv:1504.01942, April 2015

    2015 arXiv

  95. [100]

    Milan, L

    A. Milan, L. Leal-Taix ´e, I. Reid, S. Roth, and K. Schindler. MOT16: A Benchmark for Multi-Object Tracking. arxiv preprint arXiv:1603.00831, March 2016

    2016 arXiv

  96. [101]

    Dendorfer, H

    P. Dendorfer, H. Rezatofighi, A. Milan, J. Shi, D. Cremers, I. Reid, S. Roth, K. Schindler, and L. Leal-Taix ´e. MOT20: A bench- mark for multi object tracking in crowded scenes. arxiv preprint arXiv:2003.09003, March 2020

    2003 arXiv

  97. [102]

    MOTS: Multi-Object Tracking and Segmentation

    Paul V oigtlaender, Michael Krause, Aljosa Osep, Jonathon Luiten, Berin Balachandar Gnana Sekar, Andreas Geiger, and Bastian Leibe. MOTS: Multi-Object Tracking and Segmentation. arxiv preprint arXiv:1902.03604, 2019

    1902 arXiv

  98. [103]

    Joint detection and identification feature learning for person search

    Tong Xiao, Shuang Li, Bochao Wang, Liang Lin, and Xiaogang Wang. Joint detection and identification feature learning for person search. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3415–3424, 2017

    2017

  99. [104]

    Person re-identification in the wild

    Liang Zheng, Hengheng Zhang, Shaoyan Sun, Manmohan Chandraker, Yi Yang, and Qi Tian. Person re-identification in the wild. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 1367–1376, 2017

    2017

  100. [105]

    Dancetrack: Multi-object tracking in uniform appearance and diverse motion

    Peize Sun, Jinkun Cao, Yi Jiang, Zehuan Yuan, Song Bai, Kris Kitani, and Ping Luo. Dancetrack: Multi-object tracking in uniform appearance and diverse motion. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 20993–21002, 2022

    2022

  101. [106]

    Learning to detect and track visible and occluded body joints in a virtual world

    Matteo Fabbri, Fabio Lanzi, Simone Calderara, Andrea Palazzi, Roberto Vezzani, and Rita Cucchiara. Learning to detect and track visible and occluded body joints in a virtual world. In Proceedings of the European conference on computer vision (ECCV) , pages 430–446, 2018

    2018

  102. [107]

    Bdd100k: A diverse driving dataset for heterogeneous multitask learning

    Fisher Yu, Haofeng Chen, Xin Wang, Wenqi Xian, Yingying Chen, Fangchen Liu, Vashisht Madhavan, and Trevor Darrell. Bdd100k: A diverse driving dataset for heterogeneous multitask learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pag...

    2020

  103. [108]

    Sportsmot: A large multi-object tracking dataset in multiple sports scenes

    Yutao Cui, Chenkai Zeng, Xiaoyu Zhao, Yichun Yang, Gangshan Wu, and Limin Wang. Sportsmot: A large multi-object tracking dataset in multiple sports scenes. In Proceedings of the IEEE/CVF international conference on computer vision , pages 9921–9931, 2023

    2023

  104. [109]

    Nettrack: Tracking highly dynamic objects with a net

    Guangze Zheng, Shijie Lin, Haobo Zuo, Changhong Fu, and Jia Pan. Nettrack: Tracking highly dynamic objects with a net. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19145–19155, 2024

    2024

  105. [110]

    Video instance segmentation

    Linjie Yang, Yuchen Fan, and Ning Xu. Video instance segmentation. In Proceedings of the IEEE/CVF international conference on computer vision, pages 5188–5197, 2019

    2019

  106. [111]

    Mmptrack: Large-scale densely annotated multi-camera multiple people tracking benchmark

    Xiaotian Han, Quanzeng You, Chunyu Wang, Zhizheng Zhang, Peng Chu, Houdong Hu, Jiang Wang, and Zicheng Liu. Mmptrack: Large-scale densely annotated multi-camera multiple people tracking benchmark. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vis...

    2023

  107. [112]

    Multi-task learning using uncertainty to weigh losses for scene geometry and semantics

    Alex Kendall, Yarin Gal, and Roberto Cipolla. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7482–7491, 2018

    2018

  108. [113]

    The Hungarian method for the assignment problem

    Harold W Kuhn. The Hungarian method for the assignment problem. Naval research logistics quarterly , 2(1-2):83–97, 1955

    1955

  109. [114]

    Whose track is it anyway? Improving robustness to tracking errors with affinity-based trajectory prediction

    Xinshuo Weng, Boris Ivanovic, Kris Kitani, and Marco Pavone. Whose track is it anyway? Improving robustness to tracking errors with affinity-based trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6573– 6582, 2022

    2022

  110. [115]

    Yihong Xu, Lo ¨ıck Chambon, ´Eloi Zablocki, Micka ¨el Chen, Alexandre Alahi, Matthieu Cord, and Patrick P ´erez. Towards motion forecasting with real-world perception inputs: Are end-to-end approaches com- petitive? In 2024 IEEE International Conference on Robotics and Automat...

    2024

  111. [116]

    PTP: Parallelized tracking and prediction with graph neural networks and diversity sampling

    Xinshuo Weng, Ye Yuan, and Kris Kitani. PTP: Parallelized tracking and prediction with graph neural networks and diversity sampling. IEEE Robotics and Automation Letters , 6(3):4640–4647, 2021

    2021

  112. [117]

    Desire: Distant future prediction in dynamic scenes with interacting agents

    Namhoon Lee, Wongun Choi, Paul Vernaza, Christopher B Choy, Philip HS Torr, and Manmohan Chandraker. Desire: Distant future prediction in dynamic scenes with interacting agents. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 336–345, 2017

    2017

  113. [119]

    Towards trajectory forecasting from detec- tion

    Pu Zhang, Lei Bai, Yuning Wang, Jianwu Fang, Jianru Xue, Nanning Zheng, and Wanli Ouyang. Towards trajectory forecasting from detec- tion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(10):12550–12561, 2023

    2023

  114. [120]

    Standing between past and future: Spatio-temporal modeling for multi-camera 3d multi-object tracking

    Ziqi Pang, Jie Li, Pavel Tokmakov, Dian Chen, Sergey Zagoruyko, and Yu-Xiong Wang. Standing between past and future: Spatio-temporal modeling for multi-camera 3d multi-object tracking. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages...

    2023

  115. [121]

    StreamMOTP: Streaming and unified framework for joint 3D multi-object tracking and trajectory prediction

    Jiaheng Zhuang, Guoan Wang, Siyu Zhang, Xiyang Wang, Hangning Zhou, Ziyao Xu, Chi Zhang, and Zhiheng Li. StreamMOTP: Streaming and unified framework for joint 3D multi-object tracking and trajectory prediction. In Proceedings of the Asian Conference on Computer Vision, pages 3...

    2024

  116. [122]

    Exploring Shared Gaussian Occupancies for Tracking-Free, Scene- Centric Pedestrian Motion Prediction in Autonomous Driving

    Uhlemann, Nico and W ¨ordehoff, Melina and Lienkamp, Markus. Exploring Shared Gaussian Occupancies for Tracking-Free, Scene- Centric Pedestrian Motion Prediction in Autonomous Driving. pages 100–112, 01 2025

    2025

  117. [123]

    Snapshot: Towards Application-centered Models for Pedes- trian Trajectory Prediction in Urban Traffic Environments

    Nico Uhlemann, Yipeng Zhou, Tobias Simeon Mohr, and Markus Lienkamp. Snapshot: Towards Application-centered Models for Pedes- trian Trajectory Prediction in Urban Traffic Environments. In Proceed- ings of the Winter Conference on Applications of Computer Vision , pages 1152–1162, 2025

    2025

  118. [124]

    Hivt: Hierarchical vector transformer for multi-agent motion prediction

    Zikang Zhou, Luyao Ye, Jianping Wang, Kui Wu, and Kejie Lu. Hivt: Hierarchical vector transformer for multi-agent motion prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8823–8833, 2022

    2022

  119. [125]

    Argoverse: 3d tracking and forecasting with rich maps

    Ming-Fang Chang, John Lambert, Patsorn Sangkloy, Jagjeet Singh, Slawomir Bak, Andrew Hartnett, De Wang, Peter Carr, Simon Lucey, Deva Ramanan, et al. Argoverse: 3d tracking and forecasting with rich maps. In Proceedings of the IEEE/CVF conference on computer vision and pattern...

    2019

  120. [126]

    An efficient implementation of Reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of virtual tracking

    IJ Cox. An efficient implementation of Reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of virtual tracking. TPAMI, 18, 1996

    1996

  121. [127]

    A density-based algorithm for discovering clusters in large spatial databases with noise

    Martin Ester, Hans-Peter Kriegel, J ¨org Sander, Xiaowei Xu, et al. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, volume 96, pages 226–231, 1996

    1996

  122. [128]

    Scene transformer: A unified architecture for predicting multiple agent trajectories

    Jiquan Ngiam, Benjamin Caine, Vijay Vasudevan, Zhengdong Zhang, Hao-Tien Lewis Chiang, Jeffrey Ling, Rebecca Roelofs, Alex Bewley, Chenxi Liu, Ashish Venugopal, et al. Scene transformer: A unified architecture for predicting multiple agent trajectories. arXiv preprint arXiv:21...

    2021 arXiv

  123. [129]

    Superglue: Learning feature matching with graph neural networks

    Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, and Andrew Rabinovich. Superglue: Learning feature matching with graph neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 4938–4947, 2020

    2020

  124. [130]

    Lookout: Diverse multi-future prediction and planning for self-driving

    Alexander Cui, Sergio Casas, Abbas Sadat, Renjie Liao, and Raquel Urtasun. Lookout: Diverse multi-future prediction and planning for self-driving. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 16107–16116, 2021

    2021

  125. [131]

    Differentiable raycasting for self-supervised occupancy forecasting

    Tarasha Khurana, Peiyun Hu, Achal Dave, Jason Ziglar, David Held, and Deva Ramanan. Differentiable raycasting for self-supervised occupancy forecasting. In European Conference on Computer Vision , pages 353–369. Springer, 2022

    2022

  126. [132]

    Perceive, predict, and plan: Safe motion planning through interpretable semantic representations

    Abbas Sadat, Sergio Casas, Mengye Ren, Xinyu Wu, Pranaab Dhawan, and Raquel Urtasun. Perceive, predict, and plan: Safe motion planning through interpretable semantic representations. In Computer Vision– ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proc...

    2020

  127. [133]

    End-to-end interpretable neural motion planner

    Wenyuan Zeng, Wenjie Luo, Simon Suo, Abbas Sadat, Bin Yang, Sergio Casas, and Raquel Urtasun. End-to-end interpretable neural motion planner. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 8660–8669, 2019

    2019

  128. [134]

    Mp3: A unified model to map, perceive, predict and plan

    Sergio Casas, Abbas Sadat, and Raquel Urtasun. Mp3: A unified model to map, perceive, predict and plan. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14403– 14412, 2021

    2021

  129. [135]

    St-p3: End-to-end vision-based autonomous driving via spatial-temporal feature learning

    Shengchao Hu, Li Chen, Penghao Wu, Hongyang Li, Junchi Yan, and Dacheng Tao. St-p3: End-to-end vision-based autonomous driving via spatial-temporal feature learning. In European Conference on Computer Vision, pages 533–549. Springer, 2022

    2022

  130. [136]

    Fusionad: Multi-modality fusion for prediction and planning tasks of autonomous driving

    Tengju Ye, Wei Jing, Chunyong Hu, Shikun Huang, Lingping Gao, Fangzhen Li, Jingke Wang, Ke Guo, Wencong Xiao, Weibo Mao, et al. Fusionad: Multi-modality fusion for prediction and planning tasks of autonomous driving. arXiv preprint arXiv:2308.01006 , 2023

    2023 arXiv

  131. [137]

    Vad: Vectorized scene representation for efficient autonomous driving

    Bo Jiang, Shaoyu Chen, Qing Xu, Bencheng Liao, Jiajie Chen, Helong Zhou, Qian Zhang, Wenyu Liu, Chang Huang, and Xinggang Wang. Vad: Vectorized scene representation for efficient autonomous driving. In Proceedings of the IEEE/CVF International Conference on Com- puter Vision, ...

    2023

  132. [138]

    Perceive, interact, predict: Learning dynamic and static clues for end-to-end motion prediction

    Bo Jiang, Shaoyu Chen, Xinggang Wang, Bencheng Liao, Tianheng Cheng, Jiajie Chen, Helong Zhou, Qian Zhang, Wenyu Liu, and Chang Huang. Perceive, interact, predict: Learning dynamic and static clues for end-to-end motion prediction. arXiv preprint arXiv:2212.02181 , 2022

    2022 arXiv

  133. [139]

    Multiple object tracking and forecasting: Jointly predicting current and future object locations

    Oluwafunmilola Kesa, Olly Styles, and Victor Sanchez. Multiple object tracking and forecasting: Jointly predicting current and future object locations. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages 560–569, 2022

    2022

  134. [140]

    S2F2: single-stage flow forecasting for future multiple trajectories prediction

    Yu-Wen Chen, Hsuan-Kung Yang, Chu-Chi Chiu, and Chun-Yi Lee. S2F2: single-stage flow forecasting for future multiple trajectories prediction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 2536–2539, 2022

    2022

  135. [141]

    Vip3d: End-to-end visual trajectory prediction via 3d agent queries

    Junru Gu, Chenxu Hu, Tianyuan Zhang, Xuanyao Chen, Yilun Wang, Yue Wang, and Hang Zhao. Vip3d: End-to-end visual trajectory prediction via 3d agent queries. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5496– 5506, 2023

    2023

  136. [142]

    An end-to-end frame- work of road user detection, tracking, and prediction from monocular images

    Hao Cheng, Mengmeng Liu, and Lin Chen. An end-to-end frame- work of road user detection, tracking, and prediction from monocular images. In 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC) , pages 2178–2185. IEEE, 2023

    2023

  137. [143]

    Exploring dynamic context for multi- path trajectory prediction

    Hao Cheng, Wentong Liao, Xuejiao Tang, Michael Ying Yang, Monika Sester, and Bodo Rosenhahn. Exploring dynamic context for multi- path trajectory prediction. In 2021 IEEE International Conference on Robotics and Automation (ICRA) , pages 12795–12801. IEEE, 2021

    2021

  138. [144]

    Fast and furious: Real time end-to-end 3d detection, tracking and motion forecasting with a single convolutional net

    Wenjie Luo, Bin Yang, and Raquel Urtasun. Fast and furious: Real time end-to-end 3d detection, tracking and motion forecasting with a single convolutional net. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , pages 3569–3577, 2018

    2018

  139. [145]

    Intentnet: Learning to predict intention from raw sensor data

    Sergio Casas, Wenjie Luo, and Raquel Urtasun. Intentnet: Learning to predict intention from raw sensor data. In Conference on Robot Learning, pages 947–956. PMLR, 2018

    2018

  140. [146]

    Inverting the pose forecasting pipeline with SPF2: Se- quential pointcloud forecasting for sequential pose forecasting

    Xinshuo Weng, Jianren Wang, Sergey Levine, Kris Kitani, and Nicholas Rhinehart. Inverting the pose forecasting pipeline with SPF2: Se- quential pointcloud forecasting for sequential pose forecasting. In Conference on robot learning , pages 11–20. PMLR, 2021

    2021

  141. [147]

    Laserflow: Efficient and probabilistic object detection and motion forecasting

    Gregory P Meyer, Jake Charland, Shreyash Pandey, Ankit Laddha, Shivam Gautam, Carlos Vallespi-Gonzalez, and Carl K Wellington. Laserflow: Efficient and probabilistic object detection and motion forecasting. IEEE Robotics and Automation Letters , 6(2):526–533, 2020

    2020

  142. [148]

    Spagnn: Spatially-aware graph neural networks for relational behavior forecast- ing from sensor data

    Sergio Casas, Cole Gulino, Renjie Liao, and Raquel Urtasun. Spagnn: Spatially-aware graph neural networks for relational behavior forecast- ing from sensor data. In 2020 IEEE International Conference on Robotics and Automation (ICRA) , pages 9491–9497. IEEE, 2020

    2020

  143. [149]

    Pixor: Real-time 3d object detection from point clouds

    Bin Yang, Wenjie Luo, and Raquel Urtasun. Pixor: Real-time 3d object detection from point clouds. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, pages 7652–7660, 2018

    2018

  144. [150]

    Pnpnet: End-to-end perception and prediction with tracking in the loop

    Ming Liang, Bin Yang, Wenyuan Zeng, Yun Chen, Rui Hu, Sergio Casas, and Raquel Urtasun. Pnpnet: End-to-end perception and prediction with tracking in the loop. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11553– 11562, 2020

    2020

  145. [151]

    Stinet: Spatio-temporal-interactive net- work for pedestrian detection and trajectory prediction

    Zhishuai Zhang, Jiyang Gao, Junhua Mao, Yukai Liu, Dragomir Anguelov, and Congcong Li. Stinet: Spatio-temporal-interactive net- work for pedestrian detection and trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recog- nition, page...

    2020

  146. [152]

    Implicit latent variable model for scene-consistent motion forecasting

    Sergio Casas, Cole Gulino, Simon Suo, Katie Luo, Renjie Liao, and Raquel Urtasun. Implicit latent variable model for scene-consistent motion forecasting. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXIII 16, pages ...

    2020

  147. [153]

    The importance of prior knowledge in precise multimodal prediction

    Sergio Casas, Cole Gulino, Simon Suo, and Raquel Urtasun. The importance of prior knowledge in precise multimodal prediction. In 2020 IEEE/RSJ international conference on intelligent robots and systems (IROS), pages 2295–2302. IEEE, 2020

    2020

  148. [154]

    Multimodal trajectory predictions for autonomous driving using deep convolutional networks

    Henggang Cui, Vladan Radosavljevic, Fang-Chieh Chou, Tsung-Han Lin, Thi Nguyen, Tzu-Kuo Huang, Jeff Schneider, and Nemanja Djuric. Multimodal trajectory predictions for autonomous driving using deep convolutional networks. In 2019 IEEE International Conference on Robotics and ...

    2019

  149. [155]

    Sdp-net: Scene flow based real-time object detection and prediction from sequential 3d point clouds

    Yi Zhang, Yuwen Ye, Zhiyu Xiang, and Jiaqi Gu. Sdp-net: Scene flow based real-time object detection and prediction from sequential 3d point clouds. In Proceedings of the Asian Conference on Computer Vision, 2020

    2020

  150. [156]

    Rv-fusenet: Range view based fusion of time-series lidar data for joint 3d object detection and motion forecasting

    Ankit Laddha, Shivam Gautam, Gregory P Meyer, Carlos Vallespi- Gonzalez, and Carl K Wellington. Rv-fusenet: Range view based fusion of time-series lidar data for joint 3d object detection and motion forecasting. In 2021 IEEE/RSJ International Conference on Intelligent Robots a...

    2021

  151. [157]

    Deep multi-task learning for joint localization, perception, and prediction

    John Phillips, Julieta Martinez, Ioan Andrei B ˆarsan, Sergio Casas, Abbas Sadat, and Raquel Urtasun. Deep multi-task learning for joint localization, perception, and prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4679–...

    2021

  152. [158]

    Multixnet: Multiclass multistage multimodal motion prediction

    Nemanja Djuric, Henggang Cui, Zhaoen Su, Shangxuan Wu, Huahua Wang, Fang-Chieh Chou, Luisa San Martin, Song Feng, Rui Hu, Yang Xu, et al. Multixnet: Multiclass multistage multimodal motion prediction. In 2021 IEEE Intelligent Vehicles Symposium (IV) , pages 435–442. IEEE, 2021

    2021

  153. [159]

    Sdapnet: End-to-end multi-task simultaneous detection and prediction network

    Shanding Ye, Han Yao, Wenfu Wang, Yongjian Fu, and Zhijie Pan. Sdapnet: End-to-end multi-task simultaneous detection and prediction network. In 2021 International Joint Conference on Neural Networks (IJCNN), pages 1–8. IEEE, 2021

    2021

  154. [160]

    Efficientnet: Rethinking model scaling for convolutional neural networks

    Mingxing Tan and Quoc Le. Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning, pages 6105–6114. PMLR, 2019

    2019

  155. [161]

    Forecasting from lidar via future object detection

    Neehar Peri, Jonathon Luiten, Mengtian Li, Aljo ˇsa O ˇsep, Laura Leal- Taix´e, and Deva Ramanan. Forecasting from lidar via future object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 17202–17211, 2022

    2022

  156. [162]

    Fs- gru: Continuous perception and prediction with inter frame feature 20 sharing

    Zhikai Chen, Yafei Wang, Xulei Liu, and Xinchang Wang. Fs- gru: Continuous perception and prediction with inter frame feature 20 sharing. In 2022 IEEE 25th International Conference on Intelligent Transportation Systems (ITSC) , pages 517–522. IEEE, 2022

    2022

  157. [163]

    Feature pyramid networks for object detection

    Tsung-Yi Lin, Piotr Doll ´ar, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. Feature pyramid networks for object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 2117–2125, 2017

    2017

  158. [164]

    Detra: A unified model for object detection and trajectory forecasting

    Sergio Casas, Ben Agro, Jiageng Mao, Thomas Gilles, Alexander Cui, Thomas Li, and Raquel Urtasun. Detra: A unified model for object detection and trajectory forecasting. In European Conference on Computer Vision , pages 326–342. Springer, 2024

    2024

  159. [165]

    Pointnet: Deep learning on point sets for 3d classification and segmentation

    Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. Pointnet: Deep learning on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 652–660, 2017

    2017

  160. [166]

    End-to-end contextual percep- tion and prediction with interaction transformer

    Lingyun Luke Li, Bin Yang, Ming Liang, Wenyuan Zeng, Mengye Ren, Sean Segal, and Raquel Urtasun. End-to-end contextual percep- tion and prediction with interaction transformer. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 5784–5791...

    2020

  161. [167]

    Liranet: End-to-end trajectory prediction using spatio-temporal radar fusion

    Meet Shah, Zhiling Huang, Ankit Laddha, Matthew Langford, Blake Barber, Sidney Zhang, Carlos Vallespi-Gonzalez, and Raquel Urtasun. Liranet: End-to-end trajectory prediction using spatio-temporal radar fusion. arXiv preprint arXiv:2010.00731 , 2020

    2010 arXiv

  162. [168]

    Mvfusenet: Improving end-to-end object detection and motion forecasting through multi-view fusion of lidar data

    Ankit Laddha, Shivam Gautam, Stefan Palombo, Shreyash Pandey, and Carlos Vallespi-Gonzalez. Mvfusenet: Improving end-to-end object detection and motion forecasting through multi-view fusion of lidar data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern...

    2021

  163. [169]

    U-net: Con- volutional networks for biomedical image segmentation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Con- volutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, par...

    2015

  164. [170]

    Multi- view fusion of sensor data for improved perception and prediction in autonomous driving

    Sudeep Fadadu, Shreyash Pandey, Darshan Hegde, Yi Shi, Fang- Chieh Chou, Nemanja Djuric, and Carlos Vallespi-Gonzalez. Multi- view fusion of sensor data for improved perception and prediction in autonomous driving. In Proceedings of the IEEE/CVF Winter Conference on Applicatio...

    2022

  165. [171]

    Fiery: Future instance prediction in bird’s-eye view from surround monocular cameras

    Anthony Hu, Zak Murez, Nikhil Mohan, Sof ´ıa Dudas, Jeffrey Hawke, Vijay Badrinarayanan, Roberto Cipolla, and Alex Kendall. Fiery: Future instance prediction in bird’s-eye view from surround monocular cameras. In Proceedings of the IEEE/CVF International Conference on Computer...

    2021

  166. [172]

    Lift, splat, shoot: Encoding images from arbitrary camera rigs by implicitly unprojecting to 3d

    Jonah Philion and Sanja Fidler. Lift, splat, shoot: Encoding images from arbitrary camera rigs by implicitly unprojecting to 3d. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XIV 16 , pages 194–210. Springer, 2020

    2020

  167. [173]

    Beverse: Unified perception and prediction in birds-eye-view for vision-centric autonomous driving

    Yunpeng Zhang, Zheng Zhu, Wenzhao Zheng, Junjie Huang, Guan Huang, Jie Zhou, and Jiwen Lu. Beverse: Unified perception and prediction in birds-eye-view for vision-centric autonomous driving. arXiv preprint arXiv:2205.09743 , 2022

    2022 arXiv

  168. [174]

    Stretchbev: Stretching future instance prediction spatially and temporally

    Adil Kaan Akan and Fatma G ¨uney. Stretchbev: Stretching future instance prediction spatially and temporally. In European Conference on Computer Vision , pages 444–460. Springer, 2022

    2022

  169. [175]

    Powerbev: A powerful yet lightweight framework for instance prediction in bird’s-eye view

    Peizheng Li, Shuxiao Ding, Xieyuanli Chen, Niklas Hanselmann, Marius Cordts, and Juergen Gall. Powerbev: A powerful yet lightweight framework for instance prediction in bird’s-eye view. arXiv preprint arXiv:2306.10761, 2023

    2023 arXiv

  170. [176]

    Tbp-former: Learning temporal bird’s-eye-view pyramid for joint perception and prediction in vision-centric autonomous driving

    Shaoheng Fang, Zi Wang, Yiqi Zhong, Junhao Ge, and Siheng Chen. Tbp-former: Learning temporal bird’s-eye-view pyramid for joint perception and prediction in vision-centric autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition,...

    2023

  171. [177]

    Safety-oriented pedestrian oc- cupancy forecasting

    Katie Luo, Sergio Casas, Renjie Liao, Xinchen Yan, Yuwen Xiong, Wenyuan Zeng, and Raquel Urtasun. Safety-oriented pedestrian oc- cupancy forecasting. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , pages 1015–1022. IEEE, 2021

    2021

  172. [178]

    Implicit occupancy flow fields for perception and prediction in self-driving

    Ben Agro, Quinlan Sykora, Sergio Casas, and Raquel Urtasun. Implicit occupancy flow fields for perception and prediction in self-driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1379–1388, 2023

    2023

  173. [181]

    Fishing net: Future inference of semantic heatmaps in grids

    Noureldin Hendy, Cooper Sloan, Feng Tian, Pengfei Duan, Nick Charchut, Yuesong Xie, Chuang Wang, and James Philbin. Fishing net: Future inference of semantic heatmaps in grids. arXiv preprint arXiv:2006.09917, 2020

    2006 arXiv

  174. [182]

    One thousand and one hours: Self-driving motion prediction dataset

    John Houston, Guido Zuidhof, Luca Bergamini, Yawei Ye, Long Chen, Ashesh Jain, Sammy Omari, Vladimir Iglovikov, and Peter Ondruska. One thousand and one hours: Self-driving motion prediction dataset. In Conference on Robot Learning , pages 409–418. PMLR, 2021

    2021

  175. [183]

    The apolloscape dataset for autonomous driving

    Xinyu Huang, Xinjing Cheng, Qichuan Geng, Binbin Cao, Dingfu Zhou, Peng Wang, Yuanqing Lin, and Ruigang Yang. The apolloscape dataset for autonomous driving. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 954–960, 2018

    2018

  176. [184]

    Sinkhorn distances: Lightspeed computation of optimal transport

    Marco Cuturi. Sinkhorn distances: Lightspeed computation of optimal transport. Advances in neural information processing systems, 26, 2013. Lo¨ıc Stratil received the B.Sc. degree from the University of Stuttgart, Stuttgart, Germany in 2020 and M.Sc. degree from the Technical ...

    2013

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.