The use of speech and lip modalities for robust speaker verification under adverse conditions


Autoria(s): Wark, T. J.; Sridharan, S.; Chandran, V.
Data(s)

1999

Resumo

Investigates the use of lip information, in conjunction with speech information, for robust speaker verification in the presence of background noise. We have previously shown (Int. Conf. on Acoustics, Speech and Signal Proc., vol. 6, pp. 3693-3696, May 1998) that features extracted from a speaker's moving lips hold speaker dependencies which are complementary with speech features. We demonstrate that the fusion of lip and speech information allows for a highly robust speaker verification system which outperforms either subsystem individually. We present a new technique for determining the weighting to be applied to each modality so as to optimize the performance of the fused system. Given a correct weighting, lip information is shown to be highly effective for reducing the false acceptance and false rejection error rates in the presence of background noise

Formato

application/pdf

Identificador

http://eprints.qut.edu.au/45593/

Relação

http://eprints.qut.edu.au/45593/1/45593a.pdf

DOI:10.1109/MMCS.1999.779305

Wark, T. J., Sridharan, S., & Chandran, V. (1999) The use of speech and lip modalities for robust speaker verification under adverse conditions. In IEEE International Conference on Multimedia Computing and Systems, 1999, Florence, Italy, pp. 812-816.

Direitos

Copyright 1999 IEEE

c) 1999 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works

Fonte

Faculty of Built Environment and Engineering; School of Engineering Systems

Palavras-Chave #feature extraction #image recognition #multimedia computing #noise #speaker recognition #adverse conditions #background noise #error rates #false acceptance rate #false rejection rate #lip modalities #lip movement #lip reading #performance optimization #robust speaker verification #speaker dependencies #speech features #speech modalities #weighting
Tipo

Conference Paper