[Demo] Real-time illumination estimation from faces for coherent rendering

We showcase a method for estimating the real-world lighting conditions within a scene based on the visual appearance of the user´s face captured in a single image of a monocular user-facing RGB camera. The implementation is based on our ISMAR 2014 paper [8]. The light reflected from the face towards the camera is measured and the most plausible real-world lighting condition explaining the measurement is estimated in real-time based on knowledge acquired in a one-time pre-processing of a set of images of different faces under known illumination. The estimated illumination is instantly used for the rendering of the virtual objects.