Testing a framework for multimodal control in the home environment

This paper describes the results of a series of usability trials in a test-home environment involving twenty eight participants who were provided with the means to control a number of household devices through a simple multi-modal control framework. The multi-modal control framework provided spoken and visual prompts to the user using a touch screen interface or a speech recognition system. A speaker independent speech recognition system was employed because it removed the tedious requirement for training by the user. Results from the usability trials show a higher acceptance for voice based control in the home than was expected at the start of the trials. The trials also demonstrated the potential for greater efficiencies for navigating menu based systems using voice control and show how, with good functional design, new users can quickly learn enough about the system to improve their interactions in terms of speed and efficiency.