LLMs achieve near-human agreement (k=0.794 vs human-human k=0.872) on annotating Mandarin narrative macrostructure with the MAIN framework, reducing time by 65 percent but showing lower reliability on young adult narratives with greater lexical variation.
Human consensus served as the gold standard
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
LLMs for automatic annotation of Mandarin narrative transcripts
LLMs achieve near-human agreement (k=0.794 vs human-human k=0.872) on annotating Mandarin narrative macrostructure with the MAIN framework, reducing time by 65 percent but showing lower reliability on young adult narratives with greater lexical variation.