REVIEW 2 major objections 11 references
AthDGC: An Open Diachronic Greek Treebank with Indo-European Parallels
T0 review · 2 major / 0 minor · reviewed 2026-07-03 · grok-4.3
Pith's one-line read AthDGC supplies the first openly licensed dependency treebank of Greek across eight diachronic periods under one PROIEL schema with parallel alignments to four other ancient languages.
desk verdict AthDGC is a first-of-its-kind open multi-period Greek treebank with alignments, but the uniform parser lacks any accuracy validation across periods. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The PROIEL XML 2.0 schema, which supplies a uniform dependency annotation format across all periods and languages, together with the Stanford Stanza PROIEL-trained parser and the LaBSE/AwesomeAlign alignment pipeline.
What would settle it
A manual audit of several hundred randomly sampled sentences from each of the eight periods that finds dependency-label error rates above 15 percent would show the workflow does not meet the consistency requirement.
Extended reading notes
Core claim
AthDGC is an open, end-to-end workflow and dataset that constitutes the first openly licensed dependency-parsed treebank of Greek spanning eight diachronic periods (Archaic, Classical, Koine, Late Antique, Byzantine, Late Byzantine, Early Modern, and Modern Greek) under a single PROIEL XML 2.0 schema, with verse-level cross-alignment of the New Testament to Latin (Vulgate), Gothic (Wulfila), Old Church Slavonic (Marianus), and Classical Armenian.
Load-bearing premise
The automated parsing and alignment procedures produce sufficiently accurate and consistent annotations across all eight periods without major period-specific errors.
Editorial extensions
If this is right
- Researchers can now run uniform syntactic queries on Greek texts from the eighth century BCE to the present day.
- Verse alignments enable direct comparison of syntactic structures in the New Testament across five Indo-European languages.
- The single schema removes the need to reconcile incompatible annotation formats when studying language change.
- Open licensing permits reuse for training historical language models or for further manual correction.
Reading between the lines
- The same workflow could be applied to additional witnesses or languages if the underlying models generalize beyond the current training data.
- Quantitative studies of syntactic drift in Greek could now be performed on a scale that isolated-period treebanks did not allow.
- The resource supplies a test bed for checking whether cross-lingual embedding methods remain reliable when applied to historical language stages.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents AthDGC (Athens-PROIEL), an open workflow and dataset that produces the first openly licensed dependency-parsed Greek treebank spanning eight diachronic periods (Archaic, Classical, Koine, Late Antique, Byzantine, Late Byzantine, Early Modern, Modern) under a single PROIEL XML 2.0 schema, together with verse-level cross-alignments of the New Testament to Latin, Gothic, Old Church Slavonic, and Classical Armenian. Annotation is performed with a single Stanford Stanza model trained on the PROIEL Koine reference; sentence alignment uses LaBSE and word alignment uses AwesomeAlign on multilingual BERT. The v0.4 release supplies curated samples and the toolkit; the full corpus is under v0.5 audit, with scale statistics to appear in the release notes.
Significance. If the produced annotations and alignments are shown to be sufficiently accurate and consistent, the resource would constitute a valuable addition to diachronic and comparative Indo-European syntax research by providing the first openly licensed multi-period Greek treebank with parallel alignments. The open-source workflow and adherence to the established PROIEL schema are clear strengths.
major comments (2)
- [Abstract / annotation workflow] Abstract and annotation-workflow description: no UAS/LAS figures, error analysis, or per-period validation results are reported for the single PROIEL-trained Stanza model applied uniformly across all eight periods. Archaic freer word order and Modern analytic constructions are known to differ from the Koine training data, so the absence of any accuracy metric leaves the claim of a usable high-quality resource without empirical support.
- [Abstract / alignment description] Alignment procedures (LaBSE sentence-level and AwesomeAlign word-level): no quantitative evaluation, manual audit samples, or period-specific reliability checks are provided, despite the claim that these alignments are suitable for downstream research.
Simulated Author's Rebuttal
We thank the referee for the constructive comments highlighting the need for empirical validation. We address each major comment below and commit to revisions that strengthen the manuscript without misrepresenting the current v0.4 release status.
read point-by-point responses
-
Referee: [Abstract / annotation workflow] Abstract and annotation-workflow description: no UAS/LAS figures, error analysis, or per-period validation results are reported for the single PROIEL-trained Stanza model applied uniformly across all eight periods. Archaic freer word order and Modern analytic constructions are known to differ from the Koine training data, so the absence of any accuracy metric leaves the claim of a usable high-quality resource without empirical support.
Authors: We agree that the manuscript lacks the requested quantitative metrics and error analysis. The current version focuses on the open workflow and v0.4 curated samples, with full annotation under v0.5 audit. In revision we will add a dedicated validation subsection reporting UAS/LAS on the PROIEL Koine held-out set, plus manual spot-check error analysis on samples from Archaic and Modern periods, while explicitly noting the limitations arising from diachronic syntactic differences and that comprehensive per-period figures will appear in the v0.5 release notes. revision: yes
-
Referee: [Abstract / alignment description] Alignment procedures (LaBSE sentence-level and AwesomeAlign word-level): no quantitative evaluation, manual audit samples, or period-specific reliability checks are provided, despite the claim that these alignments are suitable for downstream research.
Authors: We acknowledge that no quantitative alignment evaluation or period-specific checks are currently reported. The alignments rely on established models (LaBSE for sentences, AwesomeAlign on mBERT for words), but the manuscript does not include supporting metrics. In the revised version we will insert a short evaluation subsection with alignment precision/recall estimates derived from manual inspection of a random sample of New Testament verses, together with a clear statement that the alignments are offered as an initial resource and that downstream users should perform their own validation. revision: yes
Circularity Check
No significant circularity; workflow relies on external tools and prior schema
full rationale
The paper presents a data-creation workflow and dataset release that applies the existing Stanford Stanza PROIEL-trained parser, LaBSE sentence embeddings, and AwesomeAlign word alignment to Greek texts across periods, extending the independently established PROIEL XML schema from Haug and Johndal 2008 and Eckhoff et al. 2018. No equations, fitted parameters, predictions, or derivations appear; the central claims concern scale, schema compliance, and open licensing rather than any result that reduces by construction to its own inputs. Self-citations to the PROIEL family are load-bearing only for schema reuse, not for any uniqueness theorem or ansatz that would create circularity. The v0.5 audit mention and lack of per-period UAS/LAS figures raise questions of empirical validation but do not constitute circular reasoning.
Assumptions & free parameters
assumptions (1)
- domain assumption The PROIEL XML 2.0 schema remains suitable for consistent dependency annotation of Greek across all eight listed periods.
Cite this review
Pith. "Pith review of AthDGC: An Open Diachronic Greek Treebank with Indo-European Parallels." pith.science (2026). https://pith.science/paper/3AJG7RW3
@misc{pith2026260615510,
author = {Pith},
title = {Pith review of: AthDGC: An Open Diachronic Greek Treebank with Indo-European Parallels},
year = {2026},
howpublished = {\url{https://pith.science/paper/3AJG7RW3}},
note = {Machine review of arXiv:2606.15510}
}
read the original abstract
AthDGC ("Athens-PROIEL") is an open, end-to-end workflow and dataset. It is, to the best of our knowledge, the first openly licensed dependency-parsed treebank of Greek that spans eight diachronic periods, namely Archaic, Classical, Koine, Late Antique, Byzantine, Late Byzantine, Early Modern, and Modern Greek, under a single PROIEL XML 2.0 schema, with verse-level cross-alignment of the New Testament to Latin (Vulgate), Gothic (Wulfila), Old Church Slavonic (Marianus), and Classical Armenian. AthDGC builds on the PROIEL Treebank Family (Haug and Johndal 2008; Eckhoff et al. 2018), which established the schema and the Koine-Greek reference set for the project. Annotation uses the Stanford Stanza PROIEL-trained workflow; sentence-level alignment uses LaBSE, a multilingual sentence-embedding model; word-level alignment uses multilingual-BERT attention through the AwesomeAlign procedure. The v0.4 release provides curated samples and the open-source toolkit; the full annotated corpus partitions remain under v0.5 audit on the Greek national HPC. Quantitative scale, per-witness verse counts, and per-period annotated-row counts are reported in the v0.5 release notes, after the audit pass completes. Concept DOI: 10.5281/zenodo.20439182.
Figures
Reference graph
Works this paper leans on
-
[1]
Bary, C., & Haug, D. T. T. (2011). Temporal anaphora across and inside sentences: The function of participles. Semantics and Pragmatics, 4(8), 1–56. https://doi.org/10.3765/sp.4.8
-
[2]
Dou, Z.-Y., & Neubig, G. (2021). Word alignment by fine-tuning embeddings on parallel cor- pora. In Proceedings of the 16th Conference of the European Chapter of the Association for Com- putational Linguistics: Main Volume (pp. 2112–2128). Association for Computational Linguistics. https://doi.org/10.18653/v1/2021.eacl-main.181
-
[3]
M., Bech, K., Bouma, G., Eide, K., Haug, D
Eckhoff, H. M., Bech, K., Bouma, G., Eide, K., Haug, D. T. T., Haugen, O. E., & Jøhndal, M. (2018). The PROIEL treebank family: A standard for early attestations of Indo-European languages. Language Resources and Evaluation, 52(1), 29–65. https://doi.org/10.1007/s10579-017-9388-5
-
[4]
Feng, F., Yang, Y., Cer, D., Arivazhagan, N., & Wang, W. (2022). Language-agnostic BERT sen- tence embedding. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (pp. 878–891). Association for Computational Linguistics. https://doi.org/10.18653/v1/2022.acl-long.62
-
[5]
Haug, D. T. T., & Jøhndal, M. (2008). Creating a parallel treebank of the Old Indo-European Bible transla- tions. In Proceedings of the Second Workshop on Language Technology for Cultural Heritage Data (pp. 27– 34)
work page 2008
-
[6]
Haug, D. T. T., Jøhndal, M., Eckhoff, H. M., Welo, E., Hertzenberg, M., & Müth, A. (2009). Computa- tional and linguistic issues in designing a syntactically annotated parallel corpus of Indo-European languages. Traitement Automatique des Langues , 50(2), 17–45
work page 2009
-
[7]
Lavidas, N. (2021). The diachrony of written language contact: A contrastive approach (Brill’s Studies in Historical Linguistics, Vol. 15). Brill
work page 2021
-
[8]
List, J.-M. (2014). Sequence comparison in historical linguistics (Dissertations in Language and Cognition, Vol. 1). Düsseldorf University Press. 21
work page 2014
Show all 11 references
-
[9]
Qi, P., Zhang, Y., Zhang, Y., Bolton, J., & Manning, C. D. (2020). Stanza: A Python natural language processing toolkit for many human languages. In Proceedings of the 58th Annual Meeting of the Associa- tion for Computational Linguistics: System Demonstrations (pp. 101–108). ...
2020 doi
-
[10]
M., Sander, P., Sköldberg, E., Theuer Linke, L., Zhang, T., Tahmasebi, N., Kuhn, J., & Schulte im Walde, S
Schlechtweg, D., Virk, S. M., Sander, P., Sköldberg, E., Theuer Linke, L., Zhang, T., Tahmasebi, N., Kuhn, J., & Schulte im Walde, S. (2024). The DURel annotation tool: Human and computational measurement of semantic proximity, sense clusters and semantic change. In Proceeding...
2024 doi
-
[11]
Sphrantzes, G. (1966). Memorii 1401–1477 (V. Grecu, Ed.; with Pseudo-Phrantzes: Macarie Melissenos, Cronica 1258–1481; Scriptores Byzantini, Vol. 5). Editura Academiei Republicii Socialiste România. 22
1966
Reviewed July 3, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.