Face track in H.264 compressed domain using the Face Observation-MRF model

In this paper, we propose a face track algorithm to determine the presence and location of faces of sizes more than 15 × 15 pixels in all frames of QCIF video sequences encoded by H.264/AVC. The proposed system composes of detection and tracking algorithms that all perform in H.264/AVC JM15.0 Encoder. The location of multiple frontal and non-frontal faces in compressed video sequences could be detected using information derived from YCbCr and AC coefficients that are taken from I-frame encoding mode. The face detection algorithm is combined with face track algorithm that performs face tracking in P-frames of compressed video sequences by using the Face Observation-based Markovian Random Field model. The proposed algorithm is not only affected less from noise MVs and it´s motion changes, but also offers low computational cost solution to problem of tracking faces. Experiments show that our algorithm provides the remarkable performance and can extract the location of faces on H.264/AVC compressed domain efficiently and robustly.