REVIEW 3 cited by
LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer valuable insights to improve these tasks. In this paper, we propose $LLM-DA$, a novel data augmentation technique based on LLMs for the few-shot NER task. To overcome the limitations of existing data augmentation methods that compromise semantic integrity and address the uncertainty inherent in LLM-generated text, we leverage the distinctive characteristics of the NER task by augmenting the original data at both the contextual and entity levels. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness. Extensive experiments demonstrate the effectiveness of our approach in enhancing NER model performance with limited data. Furthermore, additional analyses provide further evidence supporting the assertion that the quality of the data we generate surpasses that of other existing methods.
Forward citations
Cited by 3 Pith papers
-
Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM
GMM-guided LLM augmentation targets sparse text clusters to improve their representation in unsupervised clustering while mostly keeping clustering quality stable.
-
Prompt Candidates, then Distill: A Teacher-Student Framework for LLM-driven Data Annotation
Prompting LLMs for candidate labels and distilling them into a small model improves annotation accuracy and noise tolerance over single-label annotation.
-
Measuring Diversity in Synthetic Datasets
DCScore measures dataset diversity as the sum of self-classification probabilities under a softmax similarity matrix, and the paper shows it tracks generation temperature, human judgment, and LLM rankings.
Discussion (0). Continue with ORCID to comment.