A primitive-based architecture of multimodal interface(PBA-MMI)

Multimodal interface (MMI) uses more than one input modality to interact with the user to promote the intuition and efficiency of human-computer interaction. First, this paper describes the concepts and research issues of multimodal interface. Second, based on the concept of increasing the communication bandwidth from user to interactive system, a primitive-based architecture of MMI (PBA-MMI) is given in this paper. In PBA-MMI, the MM. is divided into five layers and four level primitives are used to communicate among different layers. Then the details about each level primitive and how to integrate different primitives from multiple modalities to obtain user intention are presented