Title :
Classification of clean and noisy bilingual movie audio for speech-to-speech translation corpora design
Author :
Tsiartas, Andreas ; Ghosh, P.K. ; Georgiou, Pantelis ; Narayanan, Shrikanth
Author_Institution :
Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
Abstract :
Identifying suitable sources of bilingual audio and text data is a crucial part of statistical Speech to Speech (S2S) research and development. Movies, often dubbed in other languages, offer a good source for this purpose; but not all data are directly usable because of noise and other audio condition differences. Hence, automatically selecting the bilingual audio data that are suitable for analysis, and training S2S systems for specific environments becomes crucial. In this work, we extract bilingual speech segments from movies and aim at classifying segments as clean speech or speech with background noise (i.e. music, babble noise etc.). We examine various features in solving this problem and our best performing method delivers accuracy up to 87% in discriminating clean and noisy speech in bilingual data.
Keywords :
audio signal processing; feature extraction; signal classification; speech processing; S2S research and development; audio condition difference; bilingual audio data selection; bilingual movie audio classification; bilingual speech segment extraction; clean speech; noisy speech; segment classification; speech-to-speech translation corpora design; statistical speech-to-speech; Correlation; Least squares approximations; Motion pictures; Noise measurement; Signal to noise ratio; Speech; audio segmentation; bilingual movie audio clean speech detection;
Conference_Titel :
Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on
Conference_Location :
Florence
DOI :
10.1109/ICASSP.2014.6853570