• DocumentCode
    870401
  • Title

    A coherent computational approach to model bottom-up visual attention

  • Author

    Le Meur, Olivier ; Le Callet, Patrick ; Barba, Dominique ; Thoreau, Dominique

  • Author_Institution
    Video Compression Lab., Thomson, Cesson Sevigne, France
  • Volume
    28
  • Issue
    5
  • fYear
    2006
  • fDate
    5/1/2006 12:00:00 AM
  • Firstpage
    802
  • Lastpage
    817
  • Abstract
    Visual attention is a mechanism which filters out redundant visual information and detects the most relevant parts of our visual field. Automatic determination of the most visually relevant areas would be useful in many applications such as image and video coding, watermarking, video browsing, and quality assessment. Many research groups are currently investigating computational modeling of the visual attention system. The first published computational models have been based on some basic and well-understood human visual system (HVS) properties. These models feature a single perceptual layer that simulates only one aspect of the visual system. More recent models integrate complex features of the HVS and simulate hierarchical perceptual representation of the visual input. The bottom-up mechanism is the most occurring feature found in modern models. This mechanism refers to involuntary attention (i.e., salient spatial visual features that effortlessly or involuntary attract our attention). This paper presents a coherent computational approach to the modeling of the bottom-up visual attention. This model is mainly based on the current understanding of the HVS behavior. Contrast sensitivity functions, perceptual decomposition, visual masking, and center-surround interactions are some of the features implemented in this model. The performances of this algorithm are assessed by using natural images and experimental measurements from an eye-tracking system. Two adequate well-known metrics (correlation coefficient and Kullbacl-Leibler divergence) are used to validate this model. A further metric is also defined. The results from this model are finally compared to those from a reference bottom-up model.
  • Keywords
    image colour analysis; image resolution; sensitivity; center-surround interactions; coherent computational approach; contrast sensitivity functions; human visual system; model bottom-up visual attention; natural images; perceptual decomposition; visual information; visual masking; Computational modeling; Feature extraction; Humans; Information filtering; Information filters; Layout; Quality assessment; Video coding; Visual system; Watermarking; Computationally modeled human vision; bottom-up visual attention; coherent modeling; eye tracking experiments.; Artificial Intelligence; Attention; Color Perception; Computer Simulation; Fixation, Ocular; Humans; Models, Neurological; Pattern Recognition, Visual; Visual Fields;
  • fLanguage
    English
  • Journal_Title
    Pattern Analysis and Machine Intelligence, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0162-8828
  • Type

    jour

  • DOI
    10.1109/TPAMI.2006.86
  • Filename
    1608042