A new Korean grammar benchmark shows that LLMs score lowest on phonological and pronunciation tasks, and feeding them pronunciation or morpheme annotations reduces that gap.
It is trained by utilizing instruction fine-tuning methods, including su- pervised fine-tuning (SFT) and direct pref- erence optimization (DPO) (Rafailov et al., 2023)
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Polishing Every Facet of the GEM: Testing Linguistic Competence of LLMs and Humans in Korean
A new Korean grammar benchmark shows that LLMs score lowest on phonological and pronunciation tasks, and feeding them pronunciation or morpheme annotations reduces that gap.