Multimodal interaction in a haptic environment

Author

Nijholt, Anton ; Kole, Sander ; Zwiers, Job

Author_Institution

CTIT, Twente Univ., Enschede, Netherlands

fYear

2005

fDate

18-20 March 2005

Firstpage

467

Lastpage

470

Abstract

In this paper we investigate the introduction of haptics in a multimodal tutoring environment. In this environment a haptic device is used to control a virtual piece of sterile cotton and a virtual injection needle. Speech input and output is provided to interact with a virtual tutor, available as a talking head, and a virtual patient. We introduce the haptic tasks and how different agents in the multi-agent system are made responsible for them. Notes are provided about the way we introduce an affective model in the tutor agent.

Keywords

biomedical education; graphical user interfaces; haptic interfaces; human computer interaction; intelligent tutoring systems; multi-agent systems; virtual reality; biomedical education; graphical user interfaces; haptic device; haptic interface; human computer interaction; multiagent system; multimodal interaction; multimodal tutoring environment; virtual patient; virtual tutor; Cotton; Graphics; Haptic interfaces; Instruments; Keyboards; Medical services; Multiagent systems; Needles; Speech; Virtual reality;

fLanguage

English

Publisher

ieee

Conference_Titel

Eurohaptics Conference, 2005 and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2005. World Haptics 2005. First Joint

Print_ISBN

0-7695-2310-2

Type

conf

DOI

10.1109/WHC.2005.98

Filename

1406971