• DocumentCode
    1334417
  • Title

    Bottom-Up Saliency Detection Model Based on Human Visual Sensitivity and Amplitude Spectrum

  • Author

    Fang, Yuming ; Lin, Weisi ; Lee, Bu-Sung ; Lau, Chiew-Tong ; Chen, Zhenzhong ; Lin, Chia-Wen

  • Author_Institution
    Sch. of Comput. Eng., Nanyang Technol. Univ., Singapore, Singapore
  • Volume
    14
  • Issue
    1
  • fYear
    2012
  • Firstpage
    187
  • Lastpage
    198
  • Abstract
    With the wide applications of saliency information in visual signal processing, many saliency detection methods have been proposed. However, some key characteristics of the human visual system (HVS) are still neglected in building these saliency detection models. In this paper, we propose a new saliency detection model based on the human visual sensitivity and the amplitude spectrum of quaternion Fourier transform (QFT). We use the amplitude spectrum of QFT to represent the color, intensity, and orientation distributions for image patches. The saliency value for each image patch is calculated by not only the differences between the QFT amplitude spectrum of this patch and other patches in the whole image, but also the visual impacts for these differences determined by the human visual sensitivity. The experiment results show that the proposed saliency detection model outperforms the state-of-the-art detection models. In addition, we apply our proposed model in the application of image retargeting and achieve better performance over the conventional algorithms.
  • Keywords
    Fourier transforms; image colour analysis; amplitude spectrum; bottom-up saliency detection model; human visual sensitivity; human visual system; image patch color; image patch intensity; image patch orientation distribution; image retargeting; quaternion Fourier transform; saliency information; visual signal processing; Algorithm design and analysis; Fourier transforms; Humans; Image color analysis; Sensitivity; Streaming media; Visualization; Amplitude spectrum; Fourier transform; human visual sensitivity; saliency detection; visual attention;
  • fLanguage
    English
  • Journal_Title
    Multimedia, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1520-9210
  • Type

    jour

  • DOI
    10.1109/TMM.2011.2169775
  • Filename
    6029456