Pith. sign in

REVIEW 10 cited by

CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2207.02202 v2 pith:DFZN7UWA submitted 2022-07-05 cs.CV

CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers

classification cs.CV
keywords cobevtsegmentationmulti-agentperceptionperformancesemanticsingle-agentsystems
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Bird's eye view (BEV) semantic segmentation plays a crucial role in spatial sensing for autonomous driving. Although recent literature has made significant progress on BEV map understanding, they are all based on single-agent camera-based systems. These solutions sometimes have difficulty handling occlusions or detecting distant objects in complex traffic scenes. Vehicle-to-Vehicle (V2V) communication technologies have enabled autonomous vehicles to share sensing information, dramatically improving the perception performance and range compared to single-agent systems. In this paper, we propose CoBEVT, the first generic multi-agent multi-camera perception framework that can cooperatively generate BEV map predictions. To efficiently fuse camera features from multi-view and multi-agent data in an underlying Transformer architecture, we design a fused axial attention module (FAX), which captures sparsely local and global spatial interactions across views and agents. The extensive experiments on the V2V perception dataset, OPV2V, demonstrate that CoBEVT achieves state-of-the-art performance for cooperative BEV semantic segmentation. Moreover, CoBEVT is shown to be generalizable to other tasks, including 1) BEV segmentation with single-agent multi-camera and 2) 3D object detection with multi-agent LiDAR systems, achieving state-of-the-art performance with real-time inference speed. The code is available at https://github.com/DerrickXuNu/CoBEVT.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 10 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. MDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systems

    cs.RO 2026-05 unverdicted novelty 7.0

    MDrive benchmark shows multi-agent cooperative driving systems generally outperform single-agent ones in closed-loop settings but perception sharing does not always improve planning and negotiation can harm performanc...

  2. CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and Refinement

    cs.CV 2026-07 conditional novelty 6.0

    CoGoal3D, a broadcast two-stage collaborative 3D detector with 3D-aware fusion and point-reconstruction refinement, reports state-of-the-art 3D AP on three real-world V2X datasets.

  3. Variational Inference for Bird's Eye View Segmentation in Autonomous Driving

    cs.CV 2026-07 conditional novelty 6.0

    TVB combines a conditional variational autoencoder, normalizing flows, and attention-based fusion to produce bird's-eye-view segmentation from multiple car cameras, reporting small but consistent IoU gains on nuScenes...

  4. From Stealthy Data Fabrication to Unsafe Driving: Realistic Scenario Attacks on Collaborative Perception

    cs.CR 2026-05 unverdicted novelty 6.0

    A new online attack framework manipulates object poses in shared CAV perception data below detection thresholds, propagating errors to cause unsafe trajectory predictions and behaviors in up to 50% of tested scenarios...

  5. HeteroPROPMT: A Real-time and Privacy-Preserving Heterogeneous Collaborative Perception Framework

    cs.CV 2026-07 conditional novelty 5.0

    A prompt-based, privacy-preserving heterogeneity-alignment framework that uses low-rank FiLM to adapt BEV features and an autoencoder-based classifier for metadata-free modality routing.

  6. QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception

    cs.CV 2025-09 conditional novelty 5.0

    QuantV2X shows that a fully quantized multi-agent fusion system reduces end-to-end latency by 3.2x and improves system-level mAP30 by 9.5 over a full-precision system on the V2X-Real dataset.

  7. SHLE: Devices Tracking and Depth Filtering for Stereo-based Height Limit Estimation

    cs.CV 2022-12 unverdicted novelty 5.0

    SHLE is a stereo pipeline with device tracking and temporal depth filtering that estimates height limits with under 10cm average error at 70m distance on the new Disparity Height dataset.

  8. LLM-Assisted Coalition Formation for Cooperative Perception in Autonomous Driving

    cs.NI 2026-08 reject novelty 4.0

    A DPP-based, communication-aware coalition selection step feeds an LLM with diverse vehicle summaries, evaluated on OPV2V and V2V4Real.

  9. Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction

    cs.CV 2026-07 unverdicted novelty 4.0

    VQSOP applies sparsity-exploiting vector quantization and a dual-branch refinement module to cut communication volume by up to 82x while claiming state-of-the-art 3D occupancy prediction performance.

  10. CooperDrive: Enhancing Driving Decisions Through Cooperative Perception

    cs.RO 2026-04 unverdicted novelty 4.0

    CooperDrive augments autonomous vehicle perception by sharing object-level data from BEV features, enabling earlier conflict anticipation and safer planning with 90 kbps bandwidth and 89 ms latency in real-world NLOS tests.