REVIEW 4 cited by
Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurts
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified. In this paper, we disclose that heavy fine-tuning may even lead to non-negligible performance deterioration on tail classes, and lightweight fine-tuning is more effective. The reason is attributed to inconsistent class conditions caused by heavy fine-tuning. With the observation above, we develop a low-complexity and accurate long-tail learning algorithms LIFT with the goal of facilitating fast prediction and compact models by adaptive lightweight fine-tuning. Experiments clearly verify that both the training time and the learned parameters are significantly reduced with more accurate predictive performance compared with state-of-the-art approaches. The implementation code is available at https://github.com/shijxcs/LIFT.
Forward citations
Cited by 4 Pith papers
-
Empowering Vision Transformers with Multi-Scale Causal Intervention for Long-Tailed Image Classification
A two-stage causal intervention method (TSCNet) improves tail-class accuracy in Vision Transformer long-tailed classification by combining patch and feature-level backdoor adjustment with adaptive counterfactual augmentation.
-
Rethinking the Bias of Foundation Model under Long-tailed Distribution
Pre-training label imbalance persists in foundation models after PEFT fine-tuning, cannot be fixed by logit adjustment, and averaging LA-adjusted logits from three CLIP variants improves long-tailed accuracy.
-
Learning from Limited and Imperfect Data
A doctoral thesis compiling nine peer-reviewed papers on long-tailed image generation, long-tailed recognition, semi-supervised learning, and domain adaptation.
-
A Comprehensive Survey on Imbalanced Data Learning
A structured survey and benchmark that groups imbalanced data learning methods into data re-balancing, feature representation, training strategy, and ensemble learning.
Discussion (0). Continue with ORCID to comment.