• DocumentCode
    1284456
  • Title

    Image Signature: Highlighting Sparse Salient Regions

  • Author

    Hou, Xiaodi ; Harel, Jonathan ; Koch, Christof

  • Author_Institution
    Dept. of Comput. & Neural Syst., California Inst. of Technol., Pasadena, CA, USA
  • Volume
    34
  • Issue
    1
  • fYear
    2012
  • Firstpage
    194
  • Lastpage
    201
  • Abstract
    We introduce a simple image descriptor referred to as the image signature. We show, within the theoretical framework of sparse signal mixing, that this quantity spatially approximates the foreground of an image. We experimentally investigate whether this approximate foreground overlaps with visually conspicuous image locations by developing a saliency algorithm based on the image signature. This saliency algorithm predicts human fixation points best among competitors on the Bruce and Tsotsos [1] benchmark data set and does so in much shorter running time. In a related experiment, we demonstrate with a change blindness data set that the distance between images induced by the image signature is closer to human perceptual distance than can be achieved using other saliency algorithms, pixel-wise, or GIST [2] descriptor methods.
  • Keywords
    digital signatures; image processing; image descriptor; image foreground; image signature; sparse salient regions; sparse signal mixing; Discrete cosine transforms; Gaussian distribution; Image color analysis; Image reconstruction; Prediction algorithms; Saliency; change blindness; sign function; sparse signal analysis.; visual attention;
  • fLanguage
    English
  • Journal_Title
    Pattern Analysis and Machine Intelligence, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0162-8828
  • Type

    jour

  • DOI
    10.1109/TPAMI.2011.146
  • Filename
    5963689