Photorealistic 3D face modeling on a smartphone

In this paper, we propose an efficient method for creating a photorealistic 3D face model on a smartphone. Major features of human face such as eyes, nose, lip, cheek, chin, and profile boundary are extracted automatically from the front and profile images, in which ACM (active contour model) and deformable ICP (iterative closest point) methods are employed. A 3D face model is generated by deforming a generic model so that the 3D face model is correctly corresponded to the extracted facial features. Skin texture map is created from the input image, which is mapped on the deformed 3D face model. All procedures are implemented and optimized efficiently on a smartphone with limited processing power and memory capability. Experimental results show that photorealistic 3D face models are created successfully on a variety of test samples. It takes about 6 seconds on an off-the-shelf smartphone.