REVIEW 10 cited by
CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers
read the original abstract
Bird's eye view (BEV) semantic segmentation plays a crucial role in spatial sensing for autonomous driving. Although recent literature has made significant progress on BEV map understanding, they are all based on single-agent camera-based systems. These solutions sometimes have difficulty handling occlusions or detecting distant objects in complex traffic scenes. Vehicle-to-Vehicle (V2V) communication technologies have enabled autonomous vehicles to share sensing information, dramatically improving the perception performance and range compared to single-agent systems. In this paper, we propose CoBEVT, the first generic multi-agent multi-camera perception framework that can cooperatively generate BEV map predictions. To efficiently fuse camera features from multi-view and multi-agent data in an underlying Transformer architecture, we design a fused axial attention module (FAX), which captures sparsely local and global spatial interactions across views and agents. The extensive experiments on the V2V perception dataset, OPV2V, demonstrate that CoBEVT achieves state-of-the-art performance for cooperative BEV semantic segmentation. Moreover, CoBEVT is shown to be generalizable to other tasks, including 1) BEV segmentation with single-agent multi-camera and 2) 3D object detection with multi-agent LiDAR systems, achieving state-of-the-art performance with real-time inference speed. The code is available at https://github.com/DerrickXuNu/CoBEVT.
Forward citations
Cited by 10 Pith papers
-
MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems
MDrive benchmark shows multi-agent cooperative driving systems generally outperform single-agent ones in closed-loop settings but perception sharing does not always improve planning and negotiation can harm performanc...
-
CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and Refinement
CoGoal3D, a broadcast two-stage collaborative 3D detector with 3D-aware fusion and point-reconstruction refinement, reports state-of-the-art 3D AP on three real-world V2X datasets.
-
Variational Inference for Bird's Eye View Segmentation in Autonomous Driving
TVB combines a conditional variational autoencoder, normalizing flows, and attention-based fusion to produce bird's-eye-view segmentation from multiple car cameras, reporting small but consistent IoU gains on nuScenes...
-
From Stealthy Data Fabrication to Unsafe Driving: Realistic Scenario Attacks on Collaborative Perception
A new online attack framework manipulates object poses in shared CAV perception data below detection thresholds, propagating errors to cause unsafe trajectory predictions and behaviors in up to 50% of tested scenarios...
-
HeteroPROPMT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework
A prompt-based, privacy-preserving heterogeneity-alignment framework that uses low-rank FiLM to adapt BEV features and an autoencoder-based classifier for metadata-free modality routing.
-
QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception
QuantV2X shows that a fully quantized multi-agent fusion system reduces end-to-end latency by 3.2x and improves system-level mAP30 by 9.5 over a full-precision system on the V2X-Real dataset.
-
SHLE: Devices Tracking and Depth Filtering for Stereo-based Height Limit Estimation
SHLE is a stereo pipeline with device tracking and temporal depth filtering that estimates height limits with under 10cm average error at 70m distance on the new Disparity Height dataset.
-
LLM-Assisted Coalition Formation for Cooperative Perception in Autonomous Driving
A DPP-based, communication-aware coalition selection step feeds an LLM with diverse vehicle summaries, evaluated on OPV2V and V2V4Real.
-
Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction
VQSOP applies sparsity-exploiting vector quantization and a dual-branch refinement module to cut communication volume by up to 82x while claiming state-of-the-art 3D occupancy prediction performance.
-
CooperDrive: Enhancing Driving Decisions Through Cooperative Perception
CooperDrive augments autonomous vehicle perception by sharing object-level data from BEV features, enabling earlier conflict anticipation and safer planning with 90 kbps bandwidth and 89 ms latency in real-world NLOS tests.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.