Object Category Recognition with Projected Texture

Recognition of object categories from their images is extremely challenging due to the large intra-class variations, and variations in pose, illumination and scale, in addition to lack of depth information of the object. Recovering the depth information from multiple images or from image cues such as variations in illumination or focus, is both computationally intensive and error prone. In contrast, the appearance based approaches are more robust and computationally efficient. However, they lack the potential accuracy of 3D feature based approaches due to the lack of shape information. We propose the use of structured lighting patterns projected on the object, which gets deformed according to the shape of the object for recognition. Since our goal is object classification and not shape recovery, we characterize the deformations using simple texture measures, thus avoiding depth recovery step. Moreover, the shape information present in the deformations is implicitly used for classification. We show that the information thus derived can significantly improve the accuracy of object category recognition from arbitrary-pose images.