Pith. sign in

REVIEW 25 cited by

Towards Stable Test-Time Adaptation in Dynamic Wild World

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2302.12400 v1 pith:NOBOVIT5 submitted 2023-02-24 cs.LG cs.CV

Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Zhiquan Wen , Yaofo Chen , Peilin Zhao , Mingkui Tan This is my paper
classification cs.LGcs.CV
keywords modelsamplestestdistributionlayernoisynormshifts
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Test-time adaptation (TTA) has shown to be effective at tackling distribution shifts between training and testing data by adapting a given model on test samples. However, the online model updating of TTA may be unstable and this is often a key obstacle preventing existing TTA methods from being deployed in the real world. Specifically, TTA may fail to improve or even harm the model performance when test data have: 1) mixed distribution shifts, 2) small batch sizes, and 3) online imbalanced label distribution shifts, which are quite common in practice. In this paper, we investigate the unstable reasons and find that the batch norm layer is a crucial factor hindering TTA stability. Conversely, TTA can perform more stably with batch-agnostic norm layers, \ie, group or layer norm. However, we observe that TTA with group and layer norms does not always succeed and still suffers many failure cases. By digging into the failure cases, we find that certain noisy test samples with large gradients may disturb the model adaption and result in collapsed trivial solutions, \ie, assigning the same class label for all samples. To address the above collapse issue, we propose a sharpness-aware and reliable entropy minimization method, called SAR, for further stabilizing TTA from two aspects: 1) remove partial noisy samples with large gradients, 2) encourage model weights to go to a flat minimum so that the model is robust to the remaining noisy samples. Promising results demonstrate that SAR performs more stably over prior methods and is computationally efficient under the above wild test scenarios.

Discussion (0). Sign in to comment.

Forward citations

Cited by 25 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Discriminator-Guided Adaptive Diffusion for Source-Free Test-Time Adaptation under Image Corruptions

    cs.CV 2026-04 unverdicted novelty 7.0 of 10

    Discriminator-guided adaptive diffusion enables source-free test-time adaptation to 15 image corruption types by dynamically denoising inputs to align with the source domain while preserving discriminative features.

  2. IMSE: Intrinsic Mixture of Spectral Experts Fine-tuning for Test-Time Adaptation

    cs.CV 2026-03 unverdicted novelty 7.0 of 10

    IMSE adapts Vision Transformers for test-time and continual test-time adaptation by tuning only singular values from SVD decompositions and using expert diversity plus domain retrieval, reaching SOTA with far fewer tr...

  3. Efficient Test-Time Optimization for Depth Completion via Low-Rank Decoder Adaptation

    cs.CV 2026-03 unverdicted novelty 7.0 of 10

    Low-rank decoder adaptation enables efficient test-time optimization for zero-shot depth completion by updating only the subspace containing depth-relevant information.

  4. Neural Collapse in Test-Time Adaptation

    cs.CV 2025-12 unverdicted novelty 7.0 of 10

    Sample-wise neural collapse reveals that feature-classifier misalignment drives TTA degradation under shifts, which NCTTA corrects via hybrid geometric-predictive targets.

  5. Test-Time Distillation for Continual Model Adaptation

    cs.CV 2025-06 conditional novelty 7.0 of 10

    CoDiRe blends VLM and target model predictions via MSP-based weighting and Optimal Transport rectification to enable stable continual test-time adaptation, outperforming CoTTA by 10.55% on ImageNet-C at 48% of the com...

  6. Contrastive Residual Energy Test-time Adaptation

    cs.LG 2025-05 unverdicted novelty 7.0 of 10

    CreTTA reformulates test-time adaptation of marginal distributions as residual energy learning, producing a contrastive objective that cancels the partition function and uses relative energy differences for adaptive g...

  7. EmbodiTTA: Resource-Efficient Test-Time Adaptation for Embodied Visual Systems

    cs.LG 2025-05 unverdicted novelty 7.0 of 10

    OD-TTA enables resource-efficient test-time adaptation on edge devices by triggering updates only on detected domain shifts, achieving comparable accuracy with lower energy and computation costs for embodied visual systems.

  8. Test-Time Curriculum for Open-Set AIGC Detection

    cs.CV 2026-08 conditional novelty 6.0 of 10

    A curriculum-based test-time adaptation method, using balanced confident pseudo-labels and multi-scale refinement, improves AIGC detector accuracy on unseen generators by 11 to 29 points over its starting detector.

  9. When Can Test-Time Adaptation Help Zero-Shot CT Vision-Language Models?

    cs.CV 2026-07 conditional novelty 6.0 of 10

    CARVE is a label-free, cardinality-aware test-time adaptation method that consistently improves multi-label CT diagnosis when the base model is already discriminative and input depth matches pretraining.

  10. No Time Like the Present: Agentic Test-Time Training for LLM Agents

    cs.LG 2026-07 conditional novelty 6.0 of 10

    Continuous test-time training that downweights tokens in repeated n-grams improves multi-turn LLM agent success by up to about 5 points by limiting self-reinforcing drift.

  11. Dual Distribution Estimation for Zero-shot Noisy Test-Time Adaptation with VLMs

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    DDE models class-wise positive feature Gaussians and negative label distributions to boost ID accuracy and OOD detection in zero-shot noisy TTA, reporting 3.70% harmonic mean gain and 6.20% FPR95 drop on ImageNet.

  12. MAMVI: 3D Test-Time Adaptation via Masked Multi-View Point Clouds

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    MAMVI performs unified single-step TTA on masked multi-view point clouds with hybrid masking and confidence-adaptive learning rates, reporting SOTA on ShapeNet-C and ScanObjectNN-C plus 4.9-8.9x speedup.

  13. DOME: Learning Transferable Domain Variables from Sparse Supervision for Test-Time Adaptation

    cs.CV 2026-06 unverdicted novelty 6.0 of 10

    DOME learns sample-specific domain variables from sparse supervision via vision-language models and a sparse domain bank to improve test-time adaptation performance.

  14. Sample-wise Targeted Adversarial Attacks on Test-time Adaptation

    cs.LG 2026-05 unverdicted novelty 6.0 of 10

    Proposes meta-learning attack with priority-aware gradient alignment for sample-wise targeted attacks on TTA that maintain label distribution consistency with no-attack baseline.

  15. GoTTA be Diverse: Rethinking Memory Policies for Test-Time Adaptation

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    Diversity-aware memory policies improve test-time adaptation performance most under constrained memory budgets and challenging non-i.i.d. streams.

  16. Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift

    cs.CV 2026-04 unverdicted novelty 6.0 of 10

    MG-MTTA improves VLM accuracy under modality-specific shifts by replacing pure entropy minimization with majorization-guided adaptation that incorporates a reliability-aware gate prior.

  17. Pretrain-then-Adapt: Uncertainty-Aware Test-Time Adaptation for Text-based Person Search

    cs.IR 2026-04 unverdicted novelty 6.0 of 10

    UATTA adapts pre-trained text-image models at test time without labels by using disagreement in bidirectional retrieval rankings to estimate and mitigate uncertainty for improved person search.

  18. AdaJEPA: An Adaptive Latent World Model

    cs.LG 2026-06 unverdicted novelty 5.0 of 10

    AdaJEPA performs closed-loop test-time adaptation of latent world models during MPC by executing an action chunk, observing the transition, and taking one gradient step on the model before replanning, yielding higher ...

  19. Distill Once, Adapt Life-Long: Exploring Dataset Distillation for Continual Test-Time Adaptation

    cs.CV 2026-06 unverdicted novelty 5.0 of 10

    DO-ALL applies dataset distillation to generate synthetic source anchors that stabilize continual test-time adaptation under evolving domains without storing original source data.

  20. Distill Once, Adapt Life-Long: Exploring Dataset Distillation for Continual Test-Time Adaptation

    cs.CV 2026-06 unverdicted novelty 5.0 of 10

    DO-ALL uses dataset distillation to create synthetic source anchors that enable stable long-term continual test-time adaptation without storing original source data.

  21. SkySeg: Collaborative Onboard Semantic Segmentation with Heterogeneous UAVs in the Wild

    cs.CV 2026-05 unverdicted novelty 5.0 of 10

    SkySeg is a heterogeneous multi-UAV framework that fuses low- and high-definition images and uses cross-device test-time adaptation to enable real-time onboard semantic segmentation, reporting 3.6x faster inference an...

  22. SloMo-Fast: Slow-Momentum and Fast-Adaptive Teachers for Source-Free Continual Test-Time Adaptation

    cs.LG 2025-11 reject novelty 5.0 of 10

    SloMo-Fast, a source-free dual-teacher CTTA method with test-time prototypes, reports SOTA error rates across 11 settings and a new cyclic domain-repetition benchmark, but the appendix data contain serious inconsistencies.

  23. Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    SfM-free 3D Gaussian Splatting jointly estimates camera poses and geometry from two views and reports a 2.75 dB PSNR improvement over existing 3DGS methods on extremely sparse inputs.

  24. FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation

    cs.CV 2026-06 unverdicted novelty 4.0 of 10

    FlowDec is a novel image restoration framework using hybrid temporal conditioning and action-centroid filtering that claims to outperform prior decorruption methods on navigation accuracy and latency in VLN-CE.

  25. Learning Inference Concurrency in DynamicGate MLP Structural and Mathematical Justification

    cs.LG 2026-04 unverdicted novelty 4.0 of 10

    DynamicGate MLP enables concurrent learning and inference by separating gating from representation parameters, so that even asynchronous updates produce outputs equivalent to a valid fixed model snapshot.

Pith tools