Pith. sign in

REVIEW 8 cited by

SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.14812 v2 pith:YSUJJ5TC submitted 2021-04-30 cs.CV

Robin Chan , Krzysztof Lis , Svenja Uhlemeyer , Hermann Blum , Sina Honari , Roland Siegwart , Pascal Fua , Mathieu Salzmann
show 1 more author
Matthias Rottmann
This is my paper
classification cs.CV
keywords segmentationobjectdatasetsanomalybenchmarkobstacleroadanomalous
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

State-of-the-art semantic or instance segmentation deep neural networks (DNNs) are usually trained on a closed set of semantic classes. As such, they are ill-equipped to handle previously-unseen objects. However, detecting and localizing such objects is crucial for safety-critical applications such as perception for automated driving, especially if they appear on the road ahead. While some methods have tackled the tasks of anomalous or out-of-distribution object segmentation, progress remains slow, in large part due to the lack of solid benchmarks; existing datasets either consist of synthetic data, or suffer from label inconsistencies. In this paper, we bridge this gap by introducing the "SegmentMeIfYouCan" benchmark. Our benchmark addresses two tasks: Anomalous object segmentation, which considers any previously-unseen object category; and road obstacle segmentation, which focuses on any object on the road, may it be known or unknown. We provide two corresponding datasets together with a test suite performing an in-depth method analysis, considering both established pixel-wise performance metrics and recent component-wise ones, which are insensitive to object sizes. We empirically evaluate multiple state-of-the-art baseline methods, including several models specifically designed for anomaly / obstacle segmentation, on our datasets and on public ones, using our test suite. The anomaly and obstacle segmentation results show that our datasets contribute to the diversity and difficulty of both data landscapes.

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. The inattentional gap in task conditioned AI models that omit otherwise reportable safety critical signals

    cs.CL 2026-06 unverdicted novelty 7.0 of 10

    Task conditioning suppresses safety-critical signal reporting in language and vision models that unconstrained versions report at higher rates, creating an inattentional gap that decouples benchmark safety from real-w...

  2. ST-LoRA: Single Trajectory LoRA Ensemble for Uncertainty Aware Agricultural Segmentation

    cs.CV 2026-08 conditional novelty 6.0 of 10

    Combining LoRA with snapshot ensembling yields a parameter-efficient uncertainty-aware segmentation ensemble that matches snapshot full-rank baselines, with feed-forward layers identified as the critical LoRA target.

  3. Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detection

    cs.CV 2025-08 conditional novelty 6.0 of 10

    An evidential classifier trained on synthetic outliers reduces the average false-positive rate to 2.5% for pixel-wise out-of-distribution detection in road-scene segmentation.

  4. An aerial color image anomaly dataset for search missions in complex forested terrain

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A new benchmark dataset of 34,424 labels across 10,659 aerial forest images from a real manhunt where standard anomaly detectors perform poorly.

  5. Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving

    cs.CV 2026-07 conditional novelty 5.0 of 10

    Road-query polygons plus CLIP zero-shot filtering turn Mask2Former soft masks into stronger training-free road anomaly segmentations, topping Maskomaly AP on Fishyscapes LostAndFound.

  6. Towards Real-Time PixOOD: Efficient Anomaly Segmentation for Autonomous Vehicles

    cs.CV 2026-07 conditional novelty 4.0 of 10

    GPU reformulation of PixOOD’s Neyman–Pearson scoring plus TensorRT deployment yields 18–20× speedups (75 FPS on Jetson AGX Orin, 182 FPS on RTX 4060) with under 0.15% AP loss.

  7. From Pixel to Mask: A Survey of Out-of-Distribution Segmentation

    cs.CV 2025-08 conditional novelty 3.0 of 10

    A survey categorizing out-of-distribution segmentation methods for autonomous driving into test-time, outlier-exposure, reconstruction, and powerful-model families.

  8. MoViAD: A Modular Library for Visual Anomaly Detection

    cs.CV 2025-07 reject novelty 3.0 of 10

    A modular visual anomaly detection library is described, but without code, benchmarks, or experimental validation of its capabilities.

Pith tools