Author_Institution :
Sch. of Autom., Huazhong Univ. of Sci. & Technol., Wuhan, China
Abstract :
Visual saliency is attracting more and more research attention since it is beneficial to many computer vision applications. In this paper, we propose a novel bottom-up saliency model for detecting salient objects in natural images. First, inspired by the recent advance in the realm of statistical thermodynamics, we adopt a novel mathematical model, namely, the maximal entropy random walk (MERW) to measure saliency. We analyze the rationality and superiority of MERW for modeling visual saliency. Then, based on the MERW model, we establish a generic framework for saliency detection. Different from the vast majority of existing saliency models, our method is built on a purely region-based strategy, which is able to yield high-resolution saliency maps with well preserved object shapes and uniformly highlighted salient regions. In the proposed framework, the input image is first over-segmented into superpixels, which are taken as the primary units for subsequent procedures, and regional features are extracted. Then, saliency is measured according to two principles, i.e., uniqueness and visual organization, both implemented in a unified approach, i.e., the MERW model based on graph representation. Intensive experimental results on publicly available datasets demonstrate that our method outperforms the state-of-the-art saliency models.
Keywords :
computer vision; feature extraction; graph theory; image resolution; image segmentation; maximum entropy methods; random processes; MERW model; MERW rationality analysis; MERW superiority analysis; bottom-up saliency model; computer vision applications; generic framework; graph representation; high-resolution saliency maps; image superpixels; mathematical model; maximal entropy random walk; natural images; object shape preservation; over-segmented input image; publicly available datasets; region-based strategy; region-based visual saliency measurement; regional feature extraction; saliency detection; salient object detection; uniformly-highlighted salient regions; uniqueness principle; visual organization principle; visual saliency modeling; Computational modeling; Entropy; Image color analysis; Image segmentation; Mathematical model; Thermodynamics; Visualization; Bottom-up; maximal entropy random walks (MERW); superpixel; visual saliency;