indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages

Anirudh Gupta; Ankur Dhuriya; Harveen Singh Chadha; Neeraj Chhimwal; Priyanshi Shah; Rishabh Gaur; Vivek Raghavan

indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2203.16825 v1 pith:K2FJF4NU submitted 2022-03-31 cs.CL

indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages

Anirudh Gupta , Neeraj Chhimwal , Ankur Dhuriya , Rishabh Gaur , Priyanshi Shah , Harveen Singh Chadha , Vivek Raghavan This is my paper

classification cs.CL

keywords punctuationtextautomaticindicinverselanguagesnormalizationabsence

verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

0 comments

read the original abstract

Automatic Speech Recognition (ASR) generates text which is most of the times devoid of any punctuation. Absence of punctuation is text can affect readability. Also, down stream NLP tasks such as sentiment analysis, machine translation, greatly benefit by having punctuation and sentence boundary information. We present an approach for automatic punctuation of text using a pretrained IndicBERT model. Inverse text normalization is done by hand writing weighted finite state transducer (WFST) grammars. We have developed this tool for 11 Indic languages namely Hindi, Tamil, Telugu, Kannada, Gujarati, Marathi, Odia, Bengali, Assamese, Malayalam and Punjabi. All code and data is publicly. available

discussion (0)

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

BhashaSutra: A Task-Centric Unified Survey of Indian NLP Datasets, Corpora, and Resources
cs.CL 2026-04 unverdicted novelty 7.0

A unified survey that consolidates Indian NLP resources by task, language, domain, and modality while identifying gaps in coverage and generalization.