Lipreading aid via the tongue

This research proposal is based on prior clinical data. Lipreading is the primary mode of linguistic communication for thousands of hard of hearing individuals. There are ambiguities in lipreading that make it problematic. Currently available tactile aids to lipreading have the following problems: 1. they do not provide enough information to resolve ambiguities and 2. they are not flexible or convenient to use. We propose to develop an information-rich and flexible lipreading assistive technology and a training program for improving the speed and accuracy of lip reading well beyond 15%. It will be based on tongue-interface technology that has been successfully applied to prototype systems for blind persons and for persons with loss of vestibular function. It will present simple but sophisticated timing and amplitude lipreading cues. Since the presented information will not be word recognition, it will be independent of the speaker and easy for the subjects to learn, and will significantly reduce the ambiguity in lipreading. We intend to develop a miniature version of the present back-pack size system and will optimize the presentation of speech via a tongue display. This research may lead to the development of a hearing substitution system for deaf persons.