A multi-agent simulated teaching pipeline creates BOOST-QA, and fine-tuning on it lifts reported LLM benchmark scores by up to 31 points over the original data.
PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Relation Extraction (RE) aims at recognizing the relation between pairs of entities mentioned in a text. Advances in LLMs have had a tremendous impact on NLP. In this work, we propose a textual data augmentation framework called PGA for improving the performance of models for RE in the scientific domain. The framework introduces two ways of data augmentation, utilizing a LLM to obtain pseudo-samples with the same sentence meaning but with different representations and forms by paraphrasing the original training set samples. As well as instructing LLM to generate sentences that implicitly contain information about the corresponding labels based on the relation and entity of the original training set samples. These two kinds of pseudo-samples participate in the training of the RE model together with the original dataset, respectively. The PGA framework in the experiment improves the F1 scores of the three mainstream models for RE within the scientific domain. Also, using a LLM to obtain samples can effectively reduce the cost of manually labeling data.
citation-role summary
citation-polarity summary
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
MASTER: Enhancing Large Language Model via Multi-Agent Simulated Teaching
A multi-agent simulated teaching pipeline creates BOOST-QA, and fine-tuning on it lifts reported LLM benchmark scores by up to 31 points over the original data.