Title :
Visual synthesis of source acoustic speech through Kohonen neural networks
Author :
Lagana, A. ; Lavagetto, F. ; Storace, A.
Author_Institution :
DIST, Genova Univ., Italy
Abstract :
The objective of bimodal (audio-video) synthesis of acoustic speech has been addressed through the use of Kohonen neural architectures which associate acoustic input parameters (cepstrum coefficients) to articulatory estimates. This association is done in real-time allowing the synchronized presentation of source acoustic speech together with coherent articulatory visualization. Different architectural solutions have been investigated and compared in terms of objective measures (estimation distortion) as well as of subjective evaluation (perception experiments)
Keywords :
cepstral analysis; neural net architecture; real-time systems; self-organising feature maps; speech synthesis; Kohonen neural architectures; Kohonen neural networks; acoustic input parameters; articulatory estimates; audio-video synthesis; bimodal acoustic speech synthesis; cepstrum coefficients; coherent articulatory visualization; estimation distortion; objective measures; perception experiments; real-time system; source acoustic speech; subjective evaluation; synchronized presentation; visual synthesis; Auditory system; Cepstral analysis; Cepstrum; Deafness; Distortion measurement; Mouth; Network synthesis; Neural networks; Speech analysis; Speech synthesis;
Conference_Titel :
Spoken Language, 1996. ICSLP 96. Proceedings., Fourth International Conference on
Conference_Location :
Philadelphia, PA
Print_ISBN :
0-7803-3555-4
DOI :
10.1109/ICSLP.1996.607237
