Multimodal human-robot interaction

Author

Budkov, V. Yu ; Prischepa, M.V. ; Ronzhin, A.L. ; Karpov, A.A.

Author_Institution

Speech & Multimodal Interfaces Lab., Russian Acad. of Sci., St. Petersburg, Russia

fYear

2010

fDate

18-20 Oct. 2010

Firstpage

485

Lastpage

488

Abstract

Multimodal human-computer interface provides a connection between a user and a computer in a natural manner. In order to determine position of the user and his speech queries, the robot uses a set of web-cameras, microphone array and technologies for distant speech recognition and face tracking. There are some methods for interaction between users and computers, such as manual entry, verbal dialog, visual and emotional communications. Interaction model of the proposed mobile informational robot has 3 main parts: beginning of the dialogue, task execution and completion of the dialogue. Further development of the model is aimed to implement a technology for gesture recognition for supporting a special group of disabled people.

Keywords

gesture recognition; human-robot interaction; mobile robots; speech recognition; distant speech recognition; emotional communications; face tracking; gesture recognition; manual entry; microphone array; multimodal human-robot interaction; task completion; task execution; verbal dialog; visual communications; web-cameras; Computers; Humans; Mobile communication; Robot sensing systems; Speech; Speech recognition; human-computer interaction; mobile informational robot; multimodal interface; speech recognition;

fLanguage

English

Publisher

ieee

Conference_Titel

Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), 2010 International Congress on

Conference_Location

Moscow

ISSN

2157-0221

Print_ISBN

978-1-4244-7285-7

Type

conf

DOI

10.1109/ICUMT.2010.5676593

Filename

5676593