A graph-based pipeline converts related Wikipedia documents into 730k long multi-turn dialogues, and continued pre-training on them improves a 7B LLM's context memory and understanding by up to 40% relative to baselines.
The final score for a given dialogue is calculated as follows: (total number of user utterances - number of erroneous/awkward user utterances)/total number of user utterances
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities
A graph-based pipeline converts related Wikipedia documents into 730k long multi-turn dialogues, and continued pre-training on them improves a 7B LLM's context memory and understanding by up to 40% relative to baselines.