DocumentCode
177432
Title
Classification of clean and noisy bilingual movie audio for speech-to-speech translation corpora design
Author
Tsiartas, Andreas ; Ghosh, P.K. ; Georgiou, Pantelis ; Narayanan, Shrikanth
Author_Institution
Dept. of Electr. Eng., Univ. of Southern California, Los Angeles, CA, USA
fYear
2014
fDate
4-9 May 2014
Firstpage
121
Lastpage
125
Abstract
Identifying suitable sources of bilingual audio and text data is a crucial part of statistical Speech to Speech (S2S) research and development. Movies, often dubbed in other languages, offer a good source for this purpose; but not all data are directly usable because of noise and other audio condition differences. Hence, automatically selecting the bilingual audio data that are suitable for analysis, and training S2S systems for specific environments becomes crucial. In this work, we extract bilingual speech segments from movies and aim at classifying segments as clean speech or speech with background noise (i.e. music, babble noise etc.). We examine various features in solving this problem and our best performing method delivers accuracy up to 87% in discriminating clean and noisy speech in bilingual data.
Keywords
audio signal processing; feature extraction; signal classification; speech processing; S2S research and development; audio condition difference; bilingual audio data selection; bilingual movie audio classification; bilingual speech segment extraction; clean speech; noisy speech; segment classification; speech-to-speech translation corpora design; statistical speech-to-speech; Correlation; Least squares approximations; Motion pictures; Noise measurement; Signal to noise ratio; Speech; audio segmentation; bilingual movie audio clean speech detection;
fLanguage
English
Publisher
ieee
Conference_Titel
Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on
Conference_Location
Florence
Type
conf
DOI
10.1109/ICASSP.2014.6853570
Filename
6853570
Link To Document