Pith. sign in

REVIEW 1 cited by

Arabic Text Diacritization In The Age Of Transfer Learning: Token Classification Is All You Need

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2401.04848 v1 pith:V742BU7G submitted 2024-01-09 cs.CL

classification cs.CL
keywords arabicdiacritizationtextclassificationptcadtasktokenphase
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Automatic diacritization of Arabic text involves adding diacritical marks (diacritics) to the text. This task poses a significant challenge with noteworthy implications for computational processing and comprehension. In this paper, we introduce PTCAD (Pre-FineTuned Token Classification for Arabic Diacritization, a novel two-phase approach for the Arabic Text Diacritization task. PTCAD comprises a pre-finetuning phase and a finetuning phase, treating Arabic Text Diacritization as a token classification task for pre-trained models. The effectiveness of PTCAD is demonstrated through evaluations on two benchmark datasets derived from the Tashkeela dataset, where it achieves state-of-the-art results, including a 20\% reduction in Word Error Rate (WER) compared to existing benchmarks and superior performance over GPT-4 in ATD tasks.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Sadeed: Advancing Arabic Diacritization Through Small Language Model

    cs.CL 2025-04 reject novelty 5.0 of 10

    The authors claim that Sadeed, a fine-tuned 1.5B Arabic SLM, reaches state-of-the-art word error rates on the Fadel benchmark and is competitive with proprietary models, while releasing a new benchmark and dataset.

Pith tools