Fast Likelihood Computation in Speech Recognition using Matrices


Autoria(s): Gajjar, Mrugesh R; Sreenivas, TV; Govindarajan, R
Data(s)

2013

Resumo

Acoustic modeling using mixtures of multivariate Gaussians is the prevalent approach for many speech processing problems. Computing likelihoods against a large set of Gaussians is required as a part of many speech processing systems and it is the computationally dominant phase for Large Vocabulary Continuous Speech Recognition (LVCSR) systems. We express the likelihood computation as a multiplication of matrices representing augmented feature vectors and Gaussian parameters. The computational gain of this approach over traditional methods is by exploiting the structure of these matrices and efficient implementation of their multiplication. In particular, we explore direct low-rank approximation of the Gaussian parameter matrix and indirect derivation of low-rank factors of the Gaussian parameter matrix by optimum approximation of the likelihood matrix. We show that both the methods lead to similar speedups but the latter leads to far lesser impact on the recognition accuracy. Experiments on 1,138 work vocabulary RM1 task and 6,224 word vocabulary TIMIT task using Sphinx 3.7 system show that, for a typical case the matrix multiplication based approach leads to overall speedup of 46 % on RM1 task and 115 % for TIMIT task. Our low-rank approximation methods provide a way for trading off recognition accuracy for a further increase in computational performance extending overall speedups up to 61 % for RM1 and 119 % for TIMIT for an increase of word error rate (WER) from 3.2 to 3.5 % for RM1 and for no increase in WER for TIMIT. We also express pairwise Euclidean distance computation phase in Dynamic Time Warping (DTW) in terms of matrix multiplication leading to saving of approximately of computational operations. In our experiments using efficient implementation of matrix multiplication, this leads to a speedup of 5.6 in computing the pairwise Euclidean distances and overall speedup up to 3.25 for DTW.

Formato

application/pdf

Identificador

http://eprints.iisc.ernet.in/45842/1/jol_sig_pro_sys_sig_ima_vid_tec_70-2_219_2013.pdf

Gajjar, Mrugesh R and Sreenivas, TV and Govindarajan, R (2013) Fast Likelihood Computation in Speech Recognition using Matrices. In: JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 70 (2). pp. 219-234.

Publicador

SPRINGER

Relação

http://dx.doi.org/10.1007/s11265-012-0704-4

http://eprints.iisc.ernet.in/45842/

Palavras-Chave #Electrical Communication Engineering #Supercomputer Education & Research Centre
Tipo

Journal Article

PeerReviewed