PaMA uses LLM-generated event patterns to align clusters with classes, improving H-score by up to 12.58% on event-centric GCD benchmarks while staying competitive on standard GCD datasets.
On the Importance of Effectively Adapting Pretrained Language Models for Active Learning
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Recent Active Learning (AL) approaches in Natural Language Processing (NLP) proposed using off-the-shelf pretrained language models (LMs). In this paper, we argue that these LMs are not adapted effectively to the downstream task during AL and we explore ways to address this issue. We suggest to first adapt the pretrained LM to the target task by continuing training with all the available unlabeled data and then use it for AL. We also propose a simple yet effective fine-tuning method to ensure that the adapted LM is properly trained in both low and high resource scenarios during AL. Our experiments demonstrate that our approach provides substantial data efficiency improvements compared to the standard fine-tuning approach, suggesting that a poor training strategy can be catastrophic for AL.
citation-role summary
other 1
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
other 1polarities
unclear 1representative citing papers
citing papers explorer
-
Generalized Category Discovery in Event-Centric Contexts: Latent Pattern Mining with LLMs
PaMA uses LLM-generated event patterns to align clusters with classes, improving H-score by up to 12.58% on event-centric GCD benchmarks while staying competitive on standard GCD datasets.