DocumentCode :
1665592
Title :
Analysis of visual speech signatures
Author :
Sadaghiani, Mohammad Hossein ; Annaz, Fawaz Yahya
fYear :
2012
Firstpage :
21
Lastpage :
26
Abstract :
The visual components of speech are the subject of research in resent years. The motivation of this paper is to suggest the concept of signature for visualized speech. These visual signatures are defined for basic components of mouth movement corresponding to sound units. Therefore, an accurate and unified database for perception and generation of visual speech could be organized. Toward this aim, mathematical tools and processes are suggested for concluding the speech related visual units. The lip geometry is parameterized with feature points. The main interpolation tool has been chosen as the Barycentric Lagrange interpolation (BLI). It can include the mouth geometry´s structure dynamically during articulation in mathematical form. The outcomes (experimental models) of proposed approach associate mathematical expressions. Such method could be successor of lip tracking and identification algorithm in both lip reading and visual speech animation systems.
Keywords :
computational geometry; computer animation; interpolation; object tracking; speech processing; visual perception; articulation; associate mathematical expressions; barycentric Lagrange interpolation tool; feature points; lip geometry; lip identification algorithm; lip tracking algorithm; mathematical tools; mouth geometry structure; mouth movement; reading speech animation systems; sound units; speech related visual units; speech visual components; visual speech animation systems; visual speech generation; visual speech perception; visual speech signature analysis; Animation; Feature extraction; Interpolation; Mouth; Polynomials; Speech; Visualization; The Lagrange interpolation; Viseme; the Barycentric Lagrange Interpolation;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Engineering Education (ICEED), 2012 4th International Congress on
Conference_Location :
Georgetown
Print_ISBN :
978-1-4673-4867-6
Type :
conf
DOI :
10.1109/ICEED.2012.6779263
Filename :
6779263
Link To Document :
بازگشت