A graph-based pipeline converts related Wikipedia documents into 730k long multi-turn dialogues, and continued pre-training on them improves a 7B LLM's context memory and understanding by up to 40% relative to baselines.
The final score for a given dialogue is calculated as follows: (total number of topic shifts - number of illogical/incoherent topic shifts)/total number of topic shifts
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
DocTalk: Scalable Graph-based Dialogue Synthesis for Enhancing LLM Conversational Capabilities
A graph-based pipeline converts related Wikipedia documents into 730k long multi-turn dialogues, and continued pre-training on them improves a 7B LLM's context memory and understanding by up to 40% relative to baselines.