Pith. sign in

Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty

2 Pith papers cite this work, alongside 343 external citations. Polarity classification is still indexing.

2 Pith papers citing it
343 external citations · Pith
abstract

Self-supervision provides effective representations for downstream tasks without requiring labels. However, existing approaches lag behind fully supervised training and are often not thought beneficial beyond obviating or reducing the need for annotations. We find that self-supervision can benefit robustness in a variety of ways, including robustness to adversarial examples, label corruption, and common input corruptions. Additionally, self-supervision greatly benefits out-of-distribution detection on difficult, near-distribution outliers, so much so that it exceeds the performance of fully supervised methods. These results demonstrate the promise of self-supervision for improving robustness and uncertainty estimation and establish these tasks as new axes of evaluation for future self-supervised learning research.

fields

cs.LG 1 cs.MA 1

years

2026 2

representative citing papers

Agent Delivery Engineering Predictive Reliability Framework

cs.MA · 2026-07-08 · conditional · novelty 5.0

A five-layer, 20-signal Trust Margin metric and Exponential-smoothing prediction engine achieve 8-hour-ahead degradation forecasting for production LLM agent systems with MAE=1.228 and 76.8% direction accuracy.

citing papers explorer

Showing 2 of 2 citing papers.

  • Toward Calibrated, Fair, and accurate Deepfake Detection cs.LG · 2026-06-03 · unverdicted · none · ref 298

    Face-Feature Tuning is a label-free logit remapping method that reduces FPR/TPR gaps across groups in deepfake detection while preserving overall accuracy.

  • Agent Delivery Engineering Predictive Reliability Framework cs.MA · 2026-07-08 · conditional · none · ref 29 · internal anchor

    A five-layer, 20-signal Trust Margin metric and Exponential-smoothing prediction engine achieve 8-hour-ahead degradation forecasting for production LLM agent systems with MAE=1.228 and 76.8% direction accuracy.