Pith. sign in

REVIEW 2 major objections 5 minor 13 references

Annotating Korean adnominal ending constructions in corpus data: Beyond relative-clause identification

T0 review · 2 major / 5 minor · reviewed 2026-07-12 · grok-4.5

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The Korean adnominal ending ETM marks several distinct noun-modifying constructions, not relative clauses alone.

desk verdict Solid, reproducible corpus engineering: ETM is shared morphology, RC-like uses are only 39.4% of KLUE, and the annotation layer is released. read the letter →

arxiv 2607.03681 v1 pith:ZBWAF6MS submitted 2026-07-04 cs.CL

Jungyeul Park , Chulwoo Park This is my paper · ORCID
classification cs.CL
keywords KoreancorpusannotationadnominalconstructionsrelativeclausestreebankETMKLUEconstructiontypology
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Korean uses one adnominal ending, ETM, across many ways of modifying nouns: relative-clause-like modifiers, adjectives, copulas, bound nouns, modals, temporal phrases, and fixed collocations. This paper shows that treating ETM as a relative-clause marker flattens real constructional differences and misleads corpus work. The authors build a typology based on predicate type, auxiliaries, argument structure, head-noun restrictions, and lexicalized patterns, then turn it into an ordered rule-based annotation layer on the KLUE dependency treebank. In the training data, productive relative-clause-like uses are only 39.4 percent of ETM instances; the rest are mainly adjectival, copular, bound-nominal, modal, temporal, and collocational. The practical point is clear: you cannot identify Korean relative-clause-like modification from morphology alone.

What carries the argument

A construction-sensitive typology of ETM uses, operationalized as an ordered rule-based decision procedure (Algorithm 1) that tests collocational, adjectival, copular, and restricted patterns before productive relative-clause-like classes, then releases the resulting annotation layer over KLUE.

What would settle it

Re-annotate a large independent sample (or another Korean treebank) with the same typology and check whether relative-clause-like uses still fall near 39 percent, or whether morphology-plus-local-context rules recover a clear majority of true relative clauses that the current labels miss.

Watch

Extended reading notes

Core claim

ETM is a shared morphological exponent of several adnominal constructions, not a direct marker of relative-clause structure. In 13,046 ETM instances from the KLUE training split, productive relative-clause-like uses total only 39.4 percent; the majority are non-relative or construction-specific patterns that coarse modifier labels would collapse.

Load-bearing premise

The ordered rules correctly encode linguistic precedence among construction types and do not systematically misclassify the borderline cases—especially bound-noun versus relative-clause and predicate-class ambiguities—that the small validation sample may have missed.

Editorial extensions

If this is right

  • Morphology-based searches for Korean relative clauses will overgenerate roughly 60 percent of ETM tokens if they treat every ETM as a relative-clause marker.
  • Sejong-style coarse labels such as vp_mod underdistinguish construction types that the new layer makes recoverable.
  • Korean UD-style mapping of ETM across relations still needs an explicit constructional layer before cross-linguistic comparison is reliable.
  • Released labels and code let other researchers rebuild the annotation layer from original KLUE data under the same license.
  • Future treebank work can test the same typology on additional Korean resources and refine the bound-noun versus relative-clause boundary.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Any automatic relative-clause extractor for Korean that keys only on ETM will need an equivalent construction filter before its precision numbers are trustworthy.
  • The same diagnostics (predicate type, head-noun restriction, lexicalization) could transfer to other agglutinative languages whose adnominal morphology is similarly multifunctional.
  • Annotation schemes that collapse constructional subtypes into one modifier label will systematically inflate relative-clause counts in Korean learner and psycholinguistic corpora.
  • Borderline cases noted in validation suggest a useful next experiment: measure inter-annotator disagreement specifically on light nouns such as geos, jeom, and yejeong.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper argues that the Korean adnominal ending ETM is not a direct marker of relative-clause structure but a morphological form shared by several noun-modifying constructions. It proposes a constructional typology based on predicate type, auxiliary structure, head-noun restriction, argument-structural compatibility, and lexicalized patterns, operationalized as an ordered rule-based annotation layer over the KLUE dependency treebank (13,046 ETM instances in the training split). Manual validation on 85 stratified instances yields 91.8% observed agreement (κ = 0.677) and 90.9% joint acceptance among definite judgments. Corpus analysis finds that productive relative-clause-like uses account for only 39.4% of instances; the remainder is mainly adjectival, copular, bound-nominal, modal, temporal, and collocational. The authors release the label schema, code, documentation, and derived labels.

Significance. If the result holds, the paper supplies a concrete, reproducible correction to a common practice in Korean corpus work and treebanking: treating ETM (or coarse labels such as vp_mod) as a proxy for relative clauses. The finding that non-RC constructions form the majority of ETM tokens is directly useful for annotation guidelines, UD mapping debates, and any downstream study that searches for Korean relative clauses by morphology. Strengths include a fully specified decision procedure (Algorithm 1), an explicit category inventory (Table 1), transparent residual handling (undefined = 0.6%), released reconstruction artifacts under the source license, and quantified manual validation with confidence intervals. This is solid corpus-engineering work with clear linguistic motivation rather than a fragile theoretical leap.

major comments (2)
  1. [§5 Manual validation; Table 3] §5 (manual validation) and Table 3: The central quantitative claim (39.4% RC-like) rests on the ordered rules being correct at scale, but validation covers only 85 stratified instances and checks accept/reject of automatic labels rather than independent double annotation of construction types. κ = 0.677 is moderate, and the authors themselves locate residual error at the bound-noun vs. RC boundary (modif+etm+nnb = 2,774 vs. rc+vv+etm = 4,816). A category-wise confusion summary or a larger gold sample focused on that boundary would make the reported percentage more robust; without it, the precise 39.4% figure carries residual uncertainty even though the majority non-RC conclusion is unlikely to reverse.
  2. [§4.3 Decision procedure; Algorithm 1] §4.3 and Algorithm 1: The linguistic precedence among construction types is well motivated, but the paper reports no sensitivity analysis on order or on the fixed collocation list (Appendix A.1 / Lim 2009). Because several large classes (especially modif+etm+nnb and colloc+etm) are resolved before productive RC categories, modest reordering or list incompleteness could shift counts between non-RC and RC buckets. A short ablation (e.g., bound-noun after RC; collocation list variants) would show how stable the 39.4% figure is under reasonable alternative precedence choices.
minor comments (5)
  1. [§3.1 Figure 1] §3.1 / Figure 1: The example tree is helpful, but the romanization and gloss lines are dense; a slightly larger font or a simplified dependency excerpt focused on the ETM token (높+은) would improve readability in print.
  2. [Table 1; §4.2] Table 1 and §4.2: The label names (e.g., modif+su-iss+etm, rc+va+vx+etm) are transparent once defined but heavy in running text; a short mnemonic key or consistent English glosses in the table would help non-Koreanist readers.
  3. [§6 Relative clause and non-relative uses] §6: The overgeneration calculation (7,911 / 13,046 = 60.6%) is clear; stating explicitly that this is under a naïve “all ETM = RC” baseline would prevent misreading it as a parser error rate.
  4. [References] References: Several Korean-language sources are appropriately cited; ensuring consistent romanization of author names and journal titles across the list would aid indexing.
  5. [Appendix A] Appendix A: The examples are excellent; numbering them continuously with the main text or cross-referencing category counts from Table 3 in each subsection would tighten the link between typology and distribution.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the 39.4% figure is an empirical count from independently motivated rules applied to an external treebank, not a result forced by definition or self-citation.

full rationale

The paper's central claim is a corpus frequency (productive relative-clause-like ETM uses = 5,135 / 13,046 = 39.4% in KLUE training) obtained by applying an ordered, linguistically motivated rule procedure (Algorithm 1, Table 1) whose categories rest on external diagnostics (predicate type, head-noun restriction, collocations from Lim 2009, Sejong lexical frames, prior literature such as Kim 2016, Takachi 2008, Yeom 2015). The rules are not defined in terms of the target percentage; the percentage is the output of running those rules on an external resource (KLUE). Manual validation (85 stratified instances, 91.8% agreement, κ=0.677) and residual undefined cases (0.6%) further treat the classification as falsifiable rather than tautological. Self-citations (e.g., Jo et al. 2023, Kim et al. 2024 on UD issues) appear only as background motivation for why existing treebank labels are insufficient; they do not supply the uniqueness of the typology or the frequency count. No fitted parameter is renamed a prediction, no uniqueness theorem is imported from the authors' prior work to force the result, and no known empirical pattern is merely renamed. The derivation chain is therefore self-contained empirical annotation, not circular.

Assumptions & free parameters 0 free parameters · 3 assumptions · 1 invented entities

The work rests on standard Korean morphological tags (Sejong/KLUE), previously published linguistic diagnostics for adnominal endings, and a fixed collocation list. No free parameters are fitted; the only “invented” objects are the twelve construction labels themselves, which are operational definitions rather than ontological posits.

assumptions (3)
  • domain assumption Sejong-style morphological tags (ETM, VA, VV, NNB, VCP, VX, etc.) correctly identify the relevant morphemes inside eojeols.
    All extraction and rule conditions operate on the KLUE morphological layer (§3.1).
  • domain assumption The collocation list of Lim (2009) exhaustively covers the semi-fixed ETM+noun expressions that should be excluded from productive relative clauses.
    Algorithm 1 tests the collocation condition first; the list is given in Appendix Figure 3.
  • domain assumption Predicate type (verbal vs. adjectival vs. copular) and head-noun restriction are reliable diagnostics for separating relative-clause-like from non-relative adnominal constructions.
    Drawn from the cited literature (Kim 2016, Takachi 2008, Park 2002) and used as the core of the typology (§2.1, §4).
invented entities (1)
  • Twelve ETM construction labels (colloc+etm, modif+adj+etm, …, rc+vv+etm, undefined)
    purpose: Provide a construction-sensitive annotation layer that existing Sejong and UD schemes lack.
    The labels are operational definitions introduced by the paper; they have no independent existence outside the annotation scheme.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Annotating Korean adnominal ending constructions in corpus data: Beyond relative-clause identification." pith.science (2026). https://pith.science/paper/ZBWAF6MS

@misc{pith2026260703681,
  author       = {Pith},
  title        = {Pith review of: Annotating Korean adnominal ending constructions in corpus data: Beyond relative-clause identification},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZBWAF6MS}},
  note         = {Machine review of arXiv:2607.03681}
}
read the original abstract

The Korean adnominal ending \texttt{ETM} occurs in diverse noun-modifying constructions, including relative-clause-like modifiers, adjectival and copular forms, bound-noun constructions, and lexicalized expressions. This paper argues that \texttt{ETM} is not a direct marker of relative-clause structure, but a morphological exponent shared by several adnominal constructions. We propose a corpus-based typology that distinguishes these constructions using predicate type, auxiliary structure, argument-structural compatibility, head-noun restriction, and lexicalized patterns. We operationalize the typology as a construction-sensitive annotation layer for the KLUE dependency treebank, implemented through an ordered rule-based procedure and evaluated by manual validation. Productive relative-clause-like uses account for 39.4\% of the analyzed instances; the remainder consists mainly of adjectival, copular, bound-nominal, modal, temporal, and collocational constructions. The findings show that Korean relative-clause-like modification cannot be identified from adnominal morphology alone.

Figures

Figures reproduced from arXiv: 2607.03681 by the authors.

Figure 1
Figure 1. An example from the KLUE dependency treebank (sentence meaning: ‘François Hollande, [PITH_FULL_IMAGE:figures/full_fig_p007_1.png] view at source ↗
Figure 2
Figure 2. Compact example from the lexical entry for [PITH_FULL_IMAGE:figures/full_fig_p009_2.png] view at source ↗
Figure 3
Figure 3. List of collocations with ETM based on Lim (2009). 25 [PITH_FULL_IMAGE:figures/full_fig_p025_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

13 extracted references · 8 canonical work pages

  1. [1]

    Hwang, and Jinho D

    Jayeol Chun, Na-Rae Han, Jena D. Hwang, and Jinho D. Choi. Building Universal Dependency Treebanks in Korean. InProceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan,

    2018

  2. [2]

    doi: 10.1075/ijcl.9.1.06gri

    ISSN 1384-6655. doi: 10.1075/ijcl.9.1.06gri. URLhttp://www.jbe-platform.com/content/journals/10.1075/ijcl.9.1.06gri. Ji Yoon Han, Tae Hwan Oh, Lee Jin, and Hansaem Kim. Annotation Issues in Universal De- pendencies for Korean and Japanese. In Marie-Catherine de Marneffe, Miryam de Lhoneux, Joakim Nivre, and Sebastian Schuster, editors,Proceedings of the F...

    work page doi:10.1075/ijcl.9.1.06gri 2020

  3. [3]

    URLhttps://aclanthology.org/2020.udw-1.12

    Association for Computational Linguistics. URLhttps://aclanthology.org/2020.udw-1.12. Eunkyul Jo, Kyuwon Kim, Xihan Wu, KyungTae Lim, Jungyeul Park, and Chulwoo Park. K- UniMorph: Korean Universal Morphology and its Feature Schema. InFindings of the Association for Computational Linguistics: ACL 2023, pages 6613–6623, Toronto, Canada, 7

    2020

  4. [4]

    URLhttps://aclanthology.org/2023.findings-acl

    Associ- ation for Computational Linguistics. URLhttps://aclanthology.org/2023.findings-acl

    2023

  5. [5]

    Su-tae Kim

    URLhttps: //arxiv.org/abs/2412.00856. Su-tae Kim. The Functional Meaning of Adnominal Ending and Fuzzy Edge.Journal of Language Sciences, 23(3):1–23,

    arXiv

  6. [6]

    doi: 10.14384/kals.2016.23.3.001

    ISSN 1225-2522. doi: 10.14384/kals.2016.23.3.001. Taein Kim. A study on classification and the terminology of adnominal clauses.Journal of Ko- rean Language and Literature, 79(3):31–67,

    work page doi:10.14384/kals.2016.23.3.001 2016

  7. [7]

    Xiaofei Lu

    doi: 10.18209/iakle.2009.20.3.161. Xiaofei Lu. Automatic analysis of syntactic complexity in second language writing.International Journal of Corpus Linguistics, 15(4):474–496,

    work page doi:10.18209/iakle.2009.20.3.161 2009

  8. [8]

    doi: 10.1075/ijcl.15.4.02lu. Ryan McDonald, Joakim Nivre, Yvonne Quirmbach-Brundage, Yoav Goldberg, Dipanjan Das, Kuzman Ganchev, Keith Hall, Slav Petrov, Hao Zhang, Oscar Täckström, Claudia Bedini, 23 Núria Bertomeu Castelló, and Jungmee Lee. Universal Dependency Annotation for Multilin- gual Parsing. In Hinrich Schuetze, Pascale Fung, and Massimo Poesio...

    work page doi:10.1075/ijcl.15.4.02lu

Show all 13 references
  1. [9]

    URL https://aclanthology.org/P13-2017

    Association for Computational Linguistics. URL https://aclanthology.org/P13-2017. Youngbin Noh, Jiyoon Han, Tae Hwan Oh, and Hansaem Kim. Enhancing Universal Dependencies for Korean. InProceedings of the Second Workshop on Universal Dependencies (UDW 2018), pages 108–116, Brus...

    2017

  2. [10]

    doi: 10.18653/v1/W18-6013

    Association for Computational Linguistics. doi: 10.18653/v1/W18-6013. URLhttps://aclanthology.org/W18-6013. Chulwoo Park. Criteria for Distinguishing Complements and Adjuncts in Korean.Korean Journal of Linguistics (EONEOHAG), 34(3):75–111,

    doi

  3. [11]

    Tomonari Takachi

    URL https://doi.org/10.29403/LI.23.1.5. Tomonari Takachi. An essay on functions of adnominal forms in modern Korean.Korean Journal of Linguistics, 33(4):629–664,

    doi

  4. [12]

    doi: 10.18855/lisoko.2008.33.4.004

    ISSN 1229-4039. doi: 10.18855/lisoko.2008.33.4.004. 24 Jae-Il Yeom. Gapless Adnominal Clauses in Korean and their Interpretations.Language Research, 51(3):597–627,

    2008 doi

  5. [13]

    A Full typology ofETMconstructions This appendix provides descriptive documentation for the constructional typology ofETM

    doi: 10.15811/jkl.2012..63.015. A Full typology ofETMconstructions This appendix provides descriptive documentation for the constructional typology ofETM. For each category, we give a fuller characterization together with representative corpus examples. The pur- pose is not on...

    2012 doi

Pith tools

Reviewed July 12, 2026 · model on record in the stance chip above.