Multimodal IMS Services: The Adaptive Keyword Spotting Interaction Paradigm

The adaptive keyword spotting interaction (AKSI) paradigm presented in this paper is an algorithm for speech command selection in multimodal applications. An architecture implementing AKSI algorithm within IP multimedia subsystem (IMS) services design framework is proposed. This architecture uses a SIP/speech proxy (called multimodal enabler) to extract keywords from client applications downloaded to the mobile station, based on a set of interaction rules. Keywords are emphasized in the presentation, thus providing an indication on the words to use in speech commands. Synchronization of client application and speech interaction manager is achieved by invoking a callback method which triggers presentation´s update according to current application context. For unrecognized speech commands, the multimodal enabler uses a TTS module to synthesize speech dialogues/prompts which either ask the user to select a command from a given set, and/or to repeat his command