Real-time voice driven facial animation system

Author

Morishima, Shigeo

Author_Institution

Fac. of Eng., Seikei Univ., Tokyo, Japan

Volume

6

fYear

1999

fDate

1999

Firstpage

59

Abstract

Recently computers have enabled users to walk through cyberspace using interactive virtual reality techniques. An avatar in cyberspace can allow a virtual face-to-face communication environment. The article realizes an avatar which has a real face in cyberspace to construct a multi-user communication system by voice transmission through a network. A voice from a microphone is transmitted and analyzed, then mouth shape and facial expression of the avatar are synchronously estimated and synthesized in real time. The author also introduces an entertainment application of a real time voice driven synthetic face. This project is named “Fifteen Seconds of Fame” which is an example of an interactive movie

Keywords

computer animation; entertainment; graphical user interfaces; multi-access systems; natural language interfaces; real-time systems; virtual reality; Fifteen Seconds of Fame; avatar; cyberspace; entertainment application; facial expression; interactive movie; interactive virtual reality techniques; mouth shape; multi-user communication system; real face; real time voice driven facial animation system; real time voice driven synthetic face; virtual face-to-face communication environment; voice transmission; Avatars; Facial animation; Microphones; Motion pictures; Mouth; Network synthesis; Real time systems; Shape; Speech analysis; Virtual reality;

fLanguage

English

Publisher

ieee

Conference_Titel

Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings. 1999 IEEE International Conference on

Conference_Location

Tokyo

ISSN

1062-922X

Print_ISBN

0-7803-5731-0

Type

conf

DOI

10.1109/ICSMC.1999.816449

Filename

816449