A vision-based three-dimensional capture system for maxillofacial assessment and surgical planning

We describe a vision-based three-dimensional facial data capture system designed for the planning of maxillofacial operations. We describe the system requirements and outline the methods used to develop a complete three-dimensional facial capture system. Our approach is based upon imaging the face using two stereo-pair sets of cameras. Scale-space-based stereo-matching is then used to recover correspondences between each of the captured stereo-pairs. Photogrammetric routines based on adjustment of bundles are used off-line to calibrate the system by imaging a single object that references all cameras to the same co-ordinate frame. This calibration scheme allows us to convert stereo correspondences to world points for each pair of cameras without the need for any subsequent fusion of data. Initial results show that we are able to capture key facial landmarks to within 0.5 mm.