The Research of Associational lip-reading Recognition Based on Bayesian Theory

The key of lip-reading recognition is to analyze rules of lip shapes, and build up the corresponding relationships between lip shapes and Chinese speeches, but the difficulty of the research lies in the "one-to-many" relationship between lip shape and speeches. For this problem, the associational lip-reading recognition based on Bayesian theory was put forward by this paper. The method applied Bayesian theory to recognize Chinese speeches, simultaneously, dynamically and self-adaptively adjusted the probabilities of all speeches corresponded by the same lip shape based on an award and penalty strategy, consequently tried to reflect speaker\´s real intention to the greatest extent. The results verified that this method could recognize effectively Chinese characters having the same lip shape, and enhanced the lip-reading system\´s practicability and validity.