ICanDo: Intellectual Computer AssistaNt for Disabled Operators

Author

Karpov, Alexey ; Ronzhin, Andrey

Author_Institution

Speech Inf. Group, St. Petersburg Inst. for Inf. & Autom., St. Petersburg, Russia

fYear

2006

fDate

4-8 Sept. 2006

Firstpage

1

Lastpage

5

Abstract

The paper describes a prospective multimodal system ICanDo (Intellectual Computer AssistaNt for Disabled Operators) developed in SPIIRAS and intended for assistance to persons without hands or with disabilities of their hands or arms in human-computer interaction. This system combines the modules for automatic speech recognition and head tracking in one multimodal system. The architecture of the system, methods for recognition and tracking, multimodal information fusion and synchronization, experimental conditions and obtained results are described in the paper. The developed system was applied for hands-free work with Graphical User Interface in such tasks as Internet communication and work with documents.

Keywords

graphical user interfaces; handicapped aids; human computer interaction; object recognition; object tracking; speech recognition; ICanDo system; Internet communication; automatic speech recognition; disabled operators; graphical user interface; head tracking; human-computer interaction; intellectual computer assistant for disabled operators; multimodal information fusion; multimodal information synchronization; recognition method; tracking method; Computers; Head; Keyboards; Mice; Speech; Speech recognition; Tracking;

fLanguage

English

Publisher

ieee

Conference_Titel

Signal Processing Conference, 2006 14th European

Conference_Location

Florence

ISSN

2219-5491

Type

conf

Filename

7071306