Simple knowledge distillation from mBERT produces smaller, faster Tagalog-only transformers that match the teacher on some tasks and lag on NER.
Developing a Named Entity Recognition Dataset for Tagalog
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
We present the development of a Named Entity Recognition (NER) dataset for Tagalog. This corpus helps fill the resource gap present in Philippine languages today, where NER resources are scarce. The texts were obtained from a pretraining corpora containing news reports, and were labeled by native speakers in an iterative fashion. The resulting dataset contains ~7.8k documents across three entity types: Person, Organization, and Location. The inter-annotator agreement, as measured by Cohen's $\kappa$, is 0.81. We also conducted extensive empirical evaluation of state-of-the-art methods across supervised and transfer learning settings. Finally, we released the data and processing code publicly to inspire future work on Tagalog NLP.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Extracting General-use Transformers for Low-resource Languages via Knowledge Distillation
Simple knowledge distillation from mBERT produces smaller, faster Tagalog-only transformers that match the teacher on some tasks and lag on NER.