A lip localization method based on HSV transformation in smart phone environment

Lip detection is the major and important step in the lip-reading system. In this paper, a novel method is proposed. Firstly, since the combination of YCbCr and HSV color model has a good segmentation power on skin color, we used this scheme to avoid the interference of background in the original images. Then, we use Hough transform to locate the eyeballs which are close to the circular after the face is detected. In the third step, a new approach is proposed to extract the lips based on the transformation of HSV color model. More specifically, the width of lip area is obtained by the distribution relationship between eyes and mouth. For the height of lip, threshold processing and gray-level integration projection are analyzed to extract the whole lip area, whether the mouth is open or closed. Extensive experiments show that the proposed method can rapidly and accurately extract the lip area, without the influence of lip shapes, light conditions and backgrounds. Therefore, this procedure can be effectively integrated into the lip-reading system.