A 3.8B clinical SLM built with pre-instruction tuning, model merging, and 2.5M synthetic instructions beats GPT-4-0125 on ICD-10 coding and approaches Llama3-8B on the extended CLUE+ benchmark.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
A Modular Approach for Clinical SLMs Driven by Synthetic Data with Pre-Instruction Tuning, Model Merging, and Clinical-Tasks Alignment
A 3.8B clinical SLM built with pre-instruction tuning, model merging, and 2.5M synthetic instructions beats GPT-4-0125 on ICD-10 coding and approaches Llama3-8B on the extended CLUE+ benchmark.