Title :
Lipreadable frame animation driven by speech parameters
Author :
Lavagetto, F. ; Arzerello, D. ; Caranzano, M.
Author_Institution :
Dept. of Commun., Genoa Univ., Italy
Abstract :
Two different approaches are here presented for converting speech into graphic animation, suitable to lipreading. Coarticulation modeling has been taken into account by means of an original algorithm for multistep statistical processing of digital speech in the cepstrum space. Two different visualization methods have been used, the first based on key reference pictures and the second based on a parametric flexible structure. Speech is converted, in real-time, into lipreadable visual animation by associating incoming acoustic frames with correspondent consistent graphic primitives, pictures or parameters, suitably visualized. Multiple fields of application are foreseen, mainly in rehabilitation, training, education and communication among hard of hearing people
Keywords :
computer animation; computer based training; education; handicapped aids; speech analysis and processing; acoustic frames; cepstrum space; coarticulation modeling; communication; digital speech; education; graphic animation; graphic primitives; hard of hearing people; lipreadable frame animation; lipreadable visual animation; multistep statistical processing; parametric flexible structure; reference pictures; rehabilitation; speech parameters; training; visualization methods; Acoustic noise; Acoustical engineering; Animation; Auditory system; Graphics; Humans; Lips; Mouth; Speech processing; Visualization;
Conference_Titel :
Speech, Image Processing and Neural Networks, 1994. Proceedings, ISSIPNN '94., 1994 International Symposium on
Print_ISBN :
0-7803-1865-X
DOI :
10.1109/SIPNN.1994.344833