Title :
Distributed-computing-based multimodal fusion interface using voiceXML and KSSL for wearable PC
Author :
Kim, J.-H. ; Hong, K.-S.
Author_Institution :
Sungkyunkwan Univ., Suwon
Abstract :
A WPS (wearable personal station) and a VoiceXML-based robust multimodal fusion interface have been implemented, fusing speech and gesture-sign language for improved multimodal language processing, and improved fusion and fission rules are suggested depending on signal plus noise to noise ratio (SNNR) and fuzzy value for simultaneous multimodality.
Keywords :
XML; microcomputers; speech recognition equipment; Korean standard sign language; multimodal fusion interface; multimodal language processing; signal plus noise to noise ratio; voiceXML; wearable PC;
Journal_Title :
Electronics Letters
DOI :
10.1049/el:20081806