A graph neural network with a bilinear decoder and contrastive loss is reported to beat six baselines on Freebase entity extraction and relation reasoning, but missing experimental details make the result unverifiable.
Contrastive Learning for Knowledge-Based Question Generation in Large Language Models
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
With the rapid development of artificial intelligence technology, especially the increasingly widespread application of question-and-answer systems, high-quality question generation has become a key component in supporting the development of these systems. This article focuses on knowledge-based question generation technology, which aims to enable computers to simulate the human questioning process based on understanding specific texts or knowledge bases. In light of the issues of hallucination and knowledge gaps present in large-scale language models when applied to knowledge-intensive tasks, this paper proposes an enhanced question generation method that incorporates contrastive learning. This method utilizes multiple models to jointly mine domain knowledge and uses contrastive learning to guide the model in reducing noise and hallucinations in generation. Experimental results show that by designing prompts containing contrasting examples, the model's performance in question generation improves considerably, particularly when contrasting instructions and examples are used simultaneously, leading to the highest quality of generated questions and improved accuracy. These results demonstrate that the method proposed in this study, which combines contrasting context and chain-of-thought prompts, can effectively improve both the quality and the practicality of question generation.
fields
cs.CL 1years
2024 1verdicts
REJECT 1representative citing papers
citing papers explorer
-
Graph Neural Network-Based Entity Extraction and Relationship Reasoning in Complex Knowledge Graphs
A graph neural network with a bilinear decoder and contrastive loss is reported to beat six baselines on Freebase entity extraction and relation reasoning, but missing experimental details make the result unverifiable.