Image segmentation through graph-based clustering from surface normals estimated by photometric stereo

A method for segmenting 2D images based on 3D shape information is proposed. First, a robust photometric stereo technique estimates the 3D normals of the objects present in the scene for every image pixel. Then, the image is segmented by grouping its pixels according to their estimated normals through graph-based clustering. Differently from other image segmentation algorithms based on intensity, colour or texture, the regions of which are determined by the visual appearance of the depicted objects, the regions obtained with the proposed technique only depend on the 3D shapes of those objects. This can be advantageous for higher level scene understanding algorithms. This technique is especially suited to poorly illuminated scenarios and utilises a conventional camera and six inexpensive strobe lights.