AITP selects pre-training texts that are underrepresented relative to instruction-tuning data, rewrites them into instruction-response pairs, and improves average SFT performance on three open LLMs.
Claude 3 haiku: Our fastest model yet, 2024
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
background 1
citation-polarity summary
fields
cs.AI 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Aligning Instruction Tuning with Pre-training
AITP selects pre-training texts that are underrepresented relative to instruction-tuning data, rewrites them into instruction-response pairs, and improves average SFT performance on three open LLMs.