LLMs achieve near-human agreement (k=0.794 vs human-human k=0.872) on annotating Mandarin narrative macrostructure with the MAIN framework, reducing time by 65 percent but showing lower reliability on young adult narratives with greater lexical variation.
Gagarina, Natalia, Ute Bohnacker & Josefin Lindgren
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
LLMs for automatic annotation of Mandarin narrative transcripts
LLMs achieve near-human agreement (k=0.794 vs human-human k=0.872) on annotating Mandarin narrative macrostructure with the MAIN framework, reducing time by 65 percent but showing lower reliability on young adult narratives with greater lexical variation.