Depth image based analysis of facial expressions and head orientation

In this paper, we propose a method of spatial and time-series analysis of facial expressions using a real-time depth image, particularly for the measurement of head orientation and for the dynamic analysis of facial expression. The method is based on an evaluation of the 3-dimensional shape of the face and is able to assess facial expressions, independent of the orientation of the head. It aims to extract psychological and physiological features from the physical features of the face´s shape. This research focuses on the characteristics of transitions detected during changes of facial expression, particularly using dynamical spatial and time-series analysis. This paper describes the development of the sensing system, the experimental results of head orientation measurements, and the results of facial expression analysis.