Multimodal interaction for 2D and 3D environments [virtual reality]

Author

Cohen, Philip ; McGee, David ; Oviatt, Sharon ; Wu, Lizhong ; Clow, Joshua ; King, Robert ; Julier, Simon ; Rosenblum, Lawrence

Author_Institution

Graduate Inst. of Sci. & Technol., Beaverton, OR, USA

Volume

19

Issue

4

fYear

1999

Firstpage

10

Lastpage

13

Abstract

The allure of immersive technologies is undeniable. Unfortunately, the user´s ability to interact with these environments lags behind the impressive visuals. In particular, it´s difficult to navigate in unknown visual landscapes, find entities, access information and select entities using six-degrees-of-freedom (6-DOF) devices. We believe multimodal interaction-specifically speech and gesture-will make a major difference in the usability of such environments

Keywords

gesture recognition; human factors; speech recognition; speech-based user interfaces; technological forecasting; virtual reality; 2D environments; 3D environments; 6-degrees-of-freedom devices; entity finding; entity selection; gestural interaction; immersive technologies; information access; interactability; multimodal interaction; speech interaction; unknown visual landscape navigation; usability; virtual reality; Aerospace simulation; Computer displays; Layout; Navigation; Robustness; Speech analysis; Speech recognition; Virtual environment; Virtual reality; Visualization;

fLanguage

English

Journal_Title

Computer Graphics and Applications, IEEE

Publisher

ieee

ISSN

0272-1716

Type

jour

DOI

10.1109/38.773958

Filename

773958