Visual speech and coarticulation effects

Author

Bothe, Hans H. ; Rieger, Frauke

Author_Institution

Dept. of Electron. Tech. Univ. of Berlin, Germany

Volume

5

fYear

1993

fDate

27-30 April 1993

Firstpage

634

Abstract

The state of the art of a computer animation program showing realistic movements of an abstracted speaker´s face is presented. For this purpose, video tapes with prototypic speakers have been recorded and analyzed in order to investigate the fundamental correlation between phonetic sequences of given German texts and the corresponding visual movements of articulation. Considering coarticulation effects, a 2-D-motion model was set up on a commercial PC using a set of 38 key pictures and calculating interim frames. The coordinated movements of the visible speech synthesis cover the lips, the teeth, and the tip of the tongue. The possible text input is based on an open vocabulary. The program is designed to be a training aid for lip reading for hearing-impaired people.<>

Keywords

computer aided instruction; computer animation; correlation methods; hearing aids; speech analysis and processing; speech synthesis; video recording; vocabulary; 2-D-motion model; German texts; coarticulation effects; computer animation program; coordinated movements; correlation; lip reading; open vocabulary; phonetic sequences; training aid; video tapes; visible speech synthesis;

fLanguage

English

Publisher

ieee

Conference_Titel

Acoustics, Speech, and Signal Processing, 1993. ICASSP-93., 1993 IEEE International Conference on

Conference_Location

Minneapolis, MN, USA

ISSN

1520-6149

Print_ISBN

0-7803-7402-9

Type

conf

DOI

10.1109/ICASSP.1993.319892

Filename

319892