Face and eye rectification in video conference using affine transform

The lack of eye contact in video conference degrades the user´s experience. This problem has been known and studied for many years. There are hardware-based solutions to the eye gazing problem. However, these specialized systems are not generally accessible. This paper suggests a software approach that rectifies the face and the eyes in video conference, only utilizing one camera. In the setup phase, the view point and the affine transform matrix are calculated, using five frames each from the front view and the above view, with the aids of face detection and eye detection algorithm. Once the setup is done, we rectify the face with affine transformation, and rectify the eyes using image warping, based on an eye model. This is done in near real time (18 frames per second, for the resolution of 320×240). The result is not genuine but is significantly better.