Multiple class segmentation using a scene-based framework

In this paper, we propose a new scene-based conditional model and investigate its performance on multiple class segmentation of images. By including the scene of an image, we also propose a new texture-environment potential to represent texture environment of a pixel. We compare our results to related work on the Olive & Torralba database and show that our model obtains greatly improved accuracy of the whole database. More significantly, a large perceptual improvement is gained, i.e. details of different objects are correctly labeled.