REVIEW 6 cited by
TTN: A Domain-Shift Aware Batch Normalization in Test-Time Adaptation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
This paper proposes a novel batch normalization strategy for test-time adaptation. Recent test-time adaptation methods heavily rely on the modified batch normalization, i.e., transductive batch normalization (TBN), which calculates the mean and the variance from the current test batch rather than using the running mean and variance obtained from the source data, i.e., conventional batch normalization (CBN). Adopting TBN that employs test batch statistics mitigates the performance degradation caused by the domain shift. However, re-estimating normalization statistics using test data depends on impractical assumptions that a test batch should be large enough and be drawn from i.i.d. stream, and we observed that the previous methods with TBN show critical performance drop without the assumptions. In this paper, we identify that CBN and TBN are in a trade-off relationship and present a new test-time normalization (TTN) method that interpolates the statistics by adjusting the importance between CBN and TBN according to the domain-shift sensitivity of each BN layer. Our proposed TTN improves model robustness to shifted domains across a wide range of batch sizes and in various realistic evaluation scenarios. TTN is widely applicable to other test-time adaptation methods that rely on updating model parameters via backpropagation. We demonstrate that adopting TTN further improves their performance and achieves state-of-the-art performance in various standard benchmarks.
Forward citations
Cited by 6 Pith papers
-
When Model Knowledge meets Diffusion Model: Diffusion-assisted Data-free Image Synthesis with Alignment of Domain and Class
DDIS generates training-like images from a frozen classifier by steering Stable Diffusion with batch-normalization statistics and an optimized per-class token, improving data-free distillation and pruning.
-
Test-Time Curriculum for Open-Set AIGC Detection
A curriculum-based test-time adaptation method, using balanced confident pseudo-labels and multi-scale refinement, improves AIGC detector accuracy on unseen generators by 11 to 29 points over its starting detector.
-
Purge-Gate: Backpropagation-Free Test-Time Adaptation for Point Clouds Classification via Token Purging
Removing tokens whose embeddings diverge most from a source or CLS-token prototype, selected by output entropy, improves 3D point cloud classification under distribution shift without backpropagation.
-
Learning Compositional Transferability of Time Series for Source-Free Domain Adaptation
A compositional U-net-plus-autoencoder reconstruction scheme with test-time stability rescaling reports state-of-the-art MF1 scores on three time series source-free domain adaptation benchmarks.
-
Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework
SfM-free 3D Gaussian Splatting jointly estimates camera poses and geometry from two views and reports a 2.75 dB PSNR improvement over existing 3DGS methods on extremely sparse inputs.
-
RESQUE: Quantifying Estimator to Task and Distribution Shift for Sustainable Model Reusability
RESQUE is a single index, computed from representation angles or cluster-label agreement, that correlates with measured retraining cost, energy, and carbon emissions across several vision models and datasets.
Discussion (0). Continue with ORCID to comment.