Pith. sign in

REVIEW

On Modeling ASR Word Confidence

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1907.09636 v4 pith:5STPKXVH submitted 2019-07-22 cs.CL cs.SDeess.ASstat.ML

classification cs.CLcs.SDeess.ASstat.ML
keywords wordconfidencemethodbestscorescalibrationcomparisonconfusion
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We present a new method for computing ASR word confidences that effectively mitigates the effect of ASR errors for diverse downstream applications, improves the word error rate of the 1-best result, and allows better comparison of scores across different models. We propose 1) a new method for modeling word confidence using a Heterogeneous Word Confusion Network (HWCN) that addresses some key flaws in conventional Word Confusion Networks, and 2) a new score calibration method for facilitating direct comparison of scores from different models. Using a bidirectional lattice recurrent neural network to compute the confidence scores of each word in the HWCN, we show that the word sequence with the best overall confidence is more accurate than the default 1-best result of the recognizer, and that the calibration method can substantially improve the reliability of recognizer combination.

Discussion (0). Continue with ORCID to comment.

Pith tools