Principles and guidelines for the design of eye/voice interaction dialogs

Pilots and operators of advanced military systems need better ways of interacting with their systems, including more efficient human-machine dialog and better physical interface devices and interaction techniques. The goal of the Eye/Voice Mission Planning Interface (EVMPI) research is to integrate voice recognition and eye-tracking technology with aviation displays in order to reduce the pilot´s cognitive and manual workload. In its current state of development, the EVMPI technology allows an operator to gaze on user interface items of interest and issue verbal commands/queries that can be interpreted by the system, thus permitting hands-free operation of cockpit displays. This paper describes the concept for the EVMPI, presents general principles for integrating eye gaze and voice input in the form of human-computer interaction dialogs, and describes the architecture and current implementation of the system