Nonverbal communication with a multimodal agent via facial expression recognition

Author

Marcos, Samuel ; Gómez-García-Bermejo, Jaime ; Zalama, Eduardo ; López, Joaquín

Author_Institution

Robot. & Comput. Vision Div., CARTIF Centro Tecnol., Valladolid, Spain

fYear

2011

fDate

9-13 May 2011

Firstpage

1199

Lastpage

1204

Abstract

Based on our previous work in the development of a multimodal animated avatar oriented to human-machine interaction and social robotics, a facial expression recognition system is presented in this paper. Both the avatar´s architecture and facial recognition system have been oriented to FACS Action Units recognition and generation, so they can be easily integrated. The resulting animated system is able to maintain nonverbal and verbal bidirectional communication, enhancing the interaction with the avatar and making it more natural for the users.

Keywords

avatars; computer animation; face recognition; robot vision; FACS action unit recognition; avatar oriented animation; facial expression recognition; human-machine interaction; multimodal agent; nonverbal communication; social robotics; verbal bidirectional communication; Eyebrows; Face; Face recognition; Feature extraction; Gabor filters; Mouth; Shape; AU recognition; Active Shape Models; Gabor filters; hierarchical skeletons facial animation; multimodal human - robot interfaces;

fLanguage

English

Publisher

ieee

Conference_Titel

Robotics and Automation (ICRA), 2011 IEEE International Conference on

Conference_Location

Shanghai

ISSN

1050-4729

Print_ISBN

978-1-61284-386-5

Type

conf

DOI

10.1109/ICRA.2011.5979953

Filename

5979953