Pith. sign in

REVIEW 12 cited by

Noise or Signal: The Role of Image Backgrounds in Object Recognition

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2006.09994 v1 pith:EO2XZNOI submitted 2020-06-17 cs.CV cs.LG

Kai Xiao , Logan Engstrom , Andrew Ilyas , Aleksander Madry This is my paper · ORCID
classification cs.CVcs.LG
keywords modelsbackgroundsbackgrounddependimageimagesobjectrecognition
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

We assess the tendency of state-of-the-art object recognition models to depend on signals from image backgrounds. We create a toolkit for disentangling foreground and background signal on ImageNet images, and find that (a) models can achieve non-trivial accuracy by relying on the background alone, (b) models often misclassify images even in the presence of correctly classified foregrounds--up to 87.5% of the time with adversarially chosen backgrounds, and (c) more accurate models tend to depend on backgrounds less. Our analysis of backgrounds brings us closer to understanding which correlations machine learning models use, and how they determine models' out of distribution performance.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 12 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Detectors Learn the Wrong Thing: Shortcut-Resistant Adversarial Training Against Physically Realizable Attacks

    cs.CV 2026-07 conditional novelty 7.0 of 10

    InsCAT adds a contrastive loss that aligns adversarially clothed people with clean people and pushes away from texture-only images, reducing texture false positives from 46.9% to 7.3% while lifting average attack AP to 82.3%.

  2. R3G: A Reasoning-Retrieval-Reranking Framework for Vision-Centric Answer Generation

    cs.CV 2026-01 unverdicted novelty 6.0 of 10

    R3G improves vision-centric VQA by generating a reasoning plan before retrieval and reranking candidate images with an MLLM judge on relevance, target match, and answerability.

  3. AIM: Amending Inherent Interpretability via Self-Supervised Masking

    cs.CV 2025-08 unverdicted novelty 6.0 of 10

    AIM uses multi-stage feature guidance for self-supervised masking to improve both interpretability (EPG) and accuracy on vision benchmarks.

  4. Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentation

    cs.RO 2025-08 conditional novelty 6.0 of 10

    Low within-subdataset diversity and large between-subdataset differences cause shortcut learning in generalist robot policies, and targeted augmentation can mitigate it.

  5. Decouple before Align: Visual Disentanglement Enhances Prompt Tuning

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Decoupling images into foreground and background before aligning them with text improves CLIP prompt tuning on few-shot and generalization benchmarks.

  6. Language-Unlocked ViT (LUViT): Empowering Self-Supervised Vision Transformers with LLMs

    cs.CV 2025-07 conditional novelty 6.0 of 10

    LUViT jointly pretrains a ViT with masked auto-encoding and LoRA adapters in a frozen LLM block, reporting +0.4% ImageNet-1K accuracy and up to +2.2% on ImageNet-A over its own MAE baseline.

  7. Point Cloud Recombination: Systematic Real Data Augmentation Using Robotic Targets for LiDAR Perception Validation

    cs.RO 2025-05 conditional novelty 6.0 of 10

    A method to insert physically measured 3D point clouds of humanoid targets into real LiDAR scenes, using registered meshes to model occlusion, is shown to produce scenes geometrically close to real sensor scans.

  8. Low-Biased General Annotated Dataset Generation

    cs.CV 2024-12 conditional novelty 6.0 of 10

    A CLIP-aligned, diffusion-generated 'low-biased' ImageNet improves backbone pre-training transfer accuracy and reduces shape, context, and background biases relative to real ImageNet and earlier synthetic datasets.

  9. Bringing the Context Back into Object Recognition, Robustly

    cs.CV 2024-11 conditional novelty 6.0 of 10

    Localizing the foreground before classification and fusing its classifier output with the full-image prediction improves accuracy and robustness to background shifts in supervised and zero-shot VLM recognition.

  10. SPARSE Data, Rich Results: Few-Shot Semi-Supervised Learning via Class-Conditioned Image Translation

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    A GAN framework that translates unlabeled medical images between classes and fuses ensemble, time-averaged pseudo-labels outperforms six prior GAN semi-supervised methods on MedMNIST at 5-50 labels per class.

  11. Paint Outside the Box: Synthesizing and Selecting Training Data for Visual Grounding

    cs.CV 2024-12 conditional novelty 5.0 of 10

    POBF paints new backgrounds around preserved objects to synthesize visual-grounding training data and filters those samples with teacher-model scores, improving accuracy by 5.83% over real-only training.

  12. Explainability for Vision Foundation Models: A Survey

    cs.CV 2025-01 conditional novelty 4.0 of 10

    A structured review of 122 papers on explainability for vision foundation models, with a taxonomy and the finding that quantitative evaluation is rare (36%).

Pith tools