Multi-Modal Recognition System Integrating Fuzzy Logic-based Embedded KSSL Recognizer and Voice-XML

In this paper, we propose and implement Multi-Modal Recognition System (MMRS) integrating Voice-XML based on WWW and fuzzy logic-based KSSL Recognizer that recognizes and represents the Korean Standard Sign Language (KSSL). The MMRS improves efficiency of the KSSL input module according to the technology of wireless communication and shows higher recognition performance than uni-modal recognition system Also, it recognizes and represents continuous sign language of users with flexibility in real time and offer to user a wider range of personalized information more effectively. Experimental results, the MMRS deduces an average recognition rate of 96.1% for continuous the KSSL and speech of various users.