Lip parameters extraction based on projection of raw images onto reference shapes

Author

Revéret, L. ; Benoît, C.

Author_Institution

Inst. de la Commun. Parlee, Univ. Stendahl, Grenoble, France

fYear

1997

fDate

23-25 Jun 1997

Firstpage

1

Lastpage

6

Abstract

This paper presents a method for the extraction of articulatory parameters from direct processing of raw images of the lips. After an overview of speechreading and the existing lipreading systems, a set of 23 reference lip shapes phonetically labelled, called visemes, are presented. Our system architecture can be seen as made of three independent parts. First, a new greyscale mouth image is centred and down sampled. Second, this image is projected onto a basis of images computed from the visemes. Then, a multivariate interpolation based on the visemes is applied to predict articulatory parameters from the projection coefficients

Keywords

feature extraction; image recognition; interpolation; speech processing; articulatory parameters; direct processing; greyscale mouth image; lip parameters extraction; lipreading systems; multivariate interpolation; projection coefficients; raw images; reference shapes; speechreading; system architecture; visemes; Active shape model; Data mining; Deformable models; Humans; Image analysis; Lips; Mouth; Parameter extraction; Shape measurement; Stochastic processes;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia Signal Processing, 1997., IEEE First Workshop on

Conference_Location

Princeton, NJ

Print_ISBN

0-7803-3780-8

Type

conf

DOI

10.1109/MMSP.1997.602604

Filename

602604