Pith. sign in

REVIEW 1 cited by

The SIGMORPHON 2022 Shared Task on Morpheme Segmentation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2206.07615 v1 pith:4ILNP7ZK submitted 2022-06-15 cs.CL

classification cs.CL
keywords morphemesegmentationsystemcoveredenglishlanguagesbestczech
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The SIGMORPHON 2022 shared task on morpheme segmentation challenged systems to decompose a word into a sequence of morphemes and covered most types of morphology: compounds, derivations, and inflections. Subtask 1, word-level morpheme segmentation, covered 5 million words in 9 languages (Czech, English, Spanish, Hungarian, French, Italian, Russian, Latin, Mongolian) and received 13 system submissions from 7 teams and the best system averaged 97.29% F1 score across all languages, ranging English (93.84%) to Latin (99.38%). Subtask 2, sentence-level morpheme segmentation, covered 18,735 sentences in 3 languages (Czech, English, Mongolian), received 10 system submissions from 3 teams, and the best systems outperformed all three state-of-the-art subword tokenization methods (BPE, ULM, Morfessor2) by 30.71% absolute. To facilitate error analysis and support any type of future studies, we released all system predictions, the evaluation script, and all gold standard datasets.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Incorporating Domain Knowledge into Materials Tokenization

    cs.CL 2025-06 conditional novelty 6.0 of 10

    A domain-knowledge-weighted tokenizer, MATTER, preserves material concepts and improves materials NLP performance by 4% on generation and 2% on classification tasks.

Pith tools