Pith. sign in

REVIEW 1 cited by

Better Character Language Modeling Through Morphology

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1906.01037 v2 pith:PM5UI6ZO submitted 2019-06-03 cs.CL

classification cs.CL
keywords languagemodelingdatamorphologicalmorphologyperformancesupervisionacross
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We incorporate morphological supervision into character language models (CLMs) via multitasking and show that this addition improves bits-per-character (BPC) performance across 24 languages, even when the morphology data and language modeling data are disjoint. Analyzing the CLMs shows that inflected words benefit more from explicitly modeling morphology than uninflected words, and that morphological supervision improves performance even as the amount of language modeling data grows. We then transfer morphological supervision across languages to improve language modeling performance in the low-resource setting.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Discrete Diffusion Models for Language Generation

    cs.CL 2025-07 reject novelty 3.0 of 10

    This thesis reports an empirical D3PM versus autoregressive comparison on WikiText-103, but the claimed speed advantage is unsupported because the speed numbers duplicate NLL values.

Pith tools