Title :
Masterpiece: physical interaction and 3D content-based search in VR applications
Author :
Moustakas, Konstantinos ; Strintzis, Michael G. ; Tzovaras, Dimitrios ; Carbini, Sebastien ; Bernier, Olivier ; Viallet, Jean Emmanuel ; Raidt, Stephan ; Mancas, Matei ; Dimiccoli, Mariella ; Yagci, Enver ; Balci, Serdar ; Leon, Eloisa Ibanez
Author_Institution :
Thessaloniki Aristotle Univ.
Abstract :
Virtual reality interfaces can immerse users into virtual environments from an impressive array of application fields, including entertainment, education, design, and navigation. However, history teaches us that no matter how rich the content is from these applications, it remains out of reach for users without a physical way to interact with it. Multimodal interfaces give users a way to interact with the virtual environment (VE) using more than one complementary modality. Masterpiece (which is short for multimodal authoring tool with similar technologies from European research utilizing a physical interface in an enhanced collaborative environment) is a platform for a multimodal natural interface. We integrated Masterpiece into a new authoring tool for designers and engineers that uses 3D search capabilities to access original database content, supporting natural human-computer interaction
Keywords :
authoring systems; human computer interaction; multimedia systems; natural language interfaces; virtual reality; 3D content-based search; human-computer interaction; multimodal authoring tool; multimodal natural interface; physical interface; virtual reality interfaces; Computer graphics; Content based retrieval; Control systems; Hidden Markov models; Humans; Information retrieval; Magnetic sensors; Speech recognition; User interfaces; Virtual reality; 3D content-based search; 3D search; HCI; VR; human–computer interaction; multimodal authoring tool; multimodal natural interface; physical interface;
Journal_Title :
MultiMedia, IEEE
DOI :
10.1109/MMUL.2006.65
