Gesture-enhanced information retrieval and presentation in a distributed learning environment

Author

Chang, Shi-Kuo ; Chen, Tsuhan ; Li, C.-S.

Author_Institution

Pittsburgh Univ., PA, USA

Volume

1

fYear

2000

fDate

6/22/1905 12:00:00 AM

Firstpage

285

Abstract

We describe a novel multimodal gesture-enhanced interface to provide immersive as well as non-immersive, non-intrusive and natural interaction between the user and the information system in a distributed learning environment. Different types of gestures are dynamically transformed into clues for spatial/temporal queries for multimedia information sources and databases. The transformation can depend upon the location, the time, the task, and the user profile. Using various transcoding schemes, the retrieved information can be presented to the user in a multi-resolution, multi-dimensional, and multimodal manner

Keywords

computer aided instruction; distance learning; gesture recognition; image retrieval; multimedia databases; distributed learning environment; gesture-enhanced information presentation; gesture-enhanced information retrieval; immersive interaction; information system; multimedia databases; multimedia information sources; multimodal gesture-enhanced interface; natural interaction; nonimmersive interaction; nonintrusive interaction; spatial queries; temporal queries; transcoding schemes; user profile; Content based retrieval; Information retrieval; Information systems; Keyboards; Mice; Multimedia databases; Signal resolution; Spatial resolution; Transcoding; Web pages;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2000. ICME 2000. 2000 IEEE International Conference on

Print_ISBN

0-7803-6536-4

Type

conf

DOI

10.1109/ICME.2000.869597

Filename

869597