Multimodal interaction with a wearable augmented reality system

Author

Kölsch, Mathias ; Bane, Ryan ; Höllerer, Tobias ; Turk, Matthew

Author_Institution

Dept. of Comput. Sci., Naval Postgraduate Sch., Monterey, CA

Volume

26

Issue

3

fYear

2006

Firstpage

62

Lastpage

71

Abstract

An augmented reality system enhances a mobile user´s situational awareness and provides new visualization functionality. The custom-built multimodal interface provides access to information encountered in urban environments. In this article, we detail our experiences with various input devices and modalities and discuss their advantages and drawbacks in the context of interaction tasks in mobile computing. We show how we integrated the input channels to use the modalities beneficially and how this enhances the interface´s overall usability

Keywords

augmented reality; data visualisation; mobile computing; user interfaces; custom-built multimodal interface; mobile computing; multimodal interaction; situational awareness; urban environment; visualization functionality; wearable augmented reality system; Augmented reality; Buildings; Cities and towns; Clouds; Computer displays; Filters; Fingers; Information filtering; Temperature; Visualization; augmented reality; hand-gesture recognition; information visualization; multimodal interface; wearable computing;

fLanguage

English

Journal_Title

Computer Graphics and Applications, IEEE

Publisher

ieee

ISSN

0272-1716

Type

jour

DOI

10.1109/MCG.2006.66

Filename

1626187