REVIEW 7 cited by
Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of vision-language models like CLIP. Existing methods build a text-based classifier with only closed-set labels. However, this largely restricts the inherent capability of CLIP to recognize samples from large and open label space. In this paper, we propose to tackle this constraint by leveraging the expert knowledge and reasoning capability of large language models (LLM) to Envision potential Outlier Exposure, termed EOE, without access to any actual OOD data. Owing to better adaptation to open-world scenarios, EOE can be generalized to different tasks, including far, near, and fine-grained OOD detection. Technically, we design (1) LLM prompts based on visual similarity to generate potential outlier class labels specialized for OOD detection, as well as (2) a new score function based on potential outlier penalty to distinguish hard OOD samples effectively. Empirically, EOE achieves state-of-the-art performance across different OOD tasks and can be effectively scaled to the ImageNet-1K dataset. The code is publicly available at: https://github.com/tmlr-group/EOE.
Forward citations
Cited by 7 Pith papers
-
NegAS: Negative Label Guided Attention and Scoring for Out-of-Distribution Object Detection with Vision-Language Models
NegAS uses negative labels for attention guidance and sigmoid scoring to improve OOD detection in VLM-based object detectors while preserving ID performance.
-
Representation Trajectories Matters: Complementary Evidence for OOD Detection and Image Classification
Recording how an image's representation evolves block-by-block, relative to learned class routes, improves OOD detection in 131/152 comparisons and clean classification in 71/72 model–dataset cases.
-
Benchmarking and Improving Monitors for Out-Of-Distribution Alignment Failure in LLMs
MOOD benchmark shows guard models fail to generalize to OOD alignment failures in LLMs, but combining them with Mahalanobis and perplexity OOD detectors improves recall from 39% to 45% with better scaling than larger ...
-
Benchmarking and Improving Monitors for Out-Of-Distribution Alignment Failure in LLMs
Introduces MOOD benchmark for OOD LLM alignment failures and shows guard models plus Mahalanobis and perplexity OOD detectors improve recall from 39% to 45% with positive scaling.
-
A Taxonomy of Cognitive Capability Gaps in Generative and Agentic AI
The paper organizes persistent AI limitations into a five-part taxonomy of cognitive capability gaps and proposes a conceptual ACIA architecture and cognition-centric metrics, none of which are validated.
-
Node-to-Neighborhood Semantic Consistency: Text-Topology Alignment for TAGs Anomaly Detection
N2NSC framework detects anomalies in text-attributed graphs by enforcing node-to-neighborhood semantic consistency via two complementary fusion paths that align textual semantics with topology.
-
Knowledge Regularized Negative Feature Tuning of Vision-Language Models for Out-of-Distribution Detection
KR-NFT tunes CLIP text features with image-conditioned scaling and shifting plus a knowledge regularization loss, improving OOD detection on base and unseen classes without forgetting pre-trained knowledge.
Discussion (0). Sign in to comment.