Pith. sign in

REVIEW 1 cited by

The BRAVO Semantic Segmentation Challenge Results in UNCV2024

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2409.15107 v2 pith:SUX6XXQK submitted 2024-09-23 cs.CV cs.AIcs.LG

classification cs.CVcs.AIcs.LG
keywords reliabilitysemanticchallengesegmentationbravomodelmodelsperturbations
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We propose the unified BRAVO challenge to benchmark the reliability of semantic segmentation models under realistic perturbations and unknown out-of-distribution (OOD) scenarios. We define two categories of reliability: (1) semantic reliability, which reflects the model's accuracy and calibration when exposed to various perturbations; and (2) OOD reliability, which measures the model's ability to detect object classes that are unknown during training. The challenge attracted nearly 100 submissions from international teams representing notable research institutions. The results reveal interesting insights into the importance of large-scale pre-training and minimal architectural design in developing robust and reliable semantic segmentation models.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FindMeIfYouCan: Bringing Open Set metrics to $\textit{near} $, $ \textit{far} $ and $\textit{farther}$ Out-of-Distribution Object Detection

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A new OOD object detection benchmark with near, far, and farther splits and open-set metrics shows close unknown objects are found more often but are also more frequently mistaken for known objects.

Pith tools