Speech and Auditory Interfaces for Ubiquitous, Immersive and Personalized Applications

In this demonstration, we introduce our recent progress on speech and auditory technologies for potential ubiquitous, immersive and personalized applications. The first demo shows an intelligent spoken question answering system, which enables users to interact with a talking avatar via natural speech dialogues. The prototype system demonstrates our latest development on automatic speech recognition, keyword spotting, personalized text-to-speech synthesis and visual speech synthesis. The second demo exhibits a virtual concert with immersive audio effects. Through our virtual auditory technology, wearing simple earphones, listeners are able to experience immersive concert audio effects from an ordinary music file. We believe the technologies shown in the two demos can be easily deployed in many significant applications.