• DocumentCode
    2584814
  • Title

    Multimodal saliency-based attention: A lazy robot´s approach

  • Author

    Kühn, Benjamin ; Schauerte, Boris ; Kroschel, Kristian ; Stiefelhagen, Rainer

  • Author_Institution
    Inst. for Anthropomatics, Karlsruhe Inst. of Technol. (KIT), Karlsruhe, Germany
  • fYear
    2012
  • fDate
    7-12 Oct. 2012
  • Firstpage
    807
  • Lastpage
    814
  • Abstract
    We extend our work on an integrated object-based system for saliency-driven overt attention and knowledge-driven object analysis. We present how we can reduce the amount of necessary head movement during scene analysis while still focusing all salient proto-objects in an order that strongly favors proto-objects with a higher saliency. Furthermore, we integrated motion saliency and as a consequence adaptive predictive gaze control to allow for efficient gazing behavior on the ARMAR-III robot head. To evaluate our approach, we first collected a new data set that incorporates two robotic platforms, three scenarios, and different scene complexities. Second, we introduce measures for the effectiveness of active overt attention mechanisms in terms of saliency cumulation and required head motion. This way, we are able to objectively demonstrate the effectiveness of the proposed multicriterial focus of attention selection.
  • Keywords
    audio-visual systems; humanoid robots; mobile robots; motion control; natural scenes; predictive control; robot vision; ARMAR-III robot head; attention selection; consequence adaptive predictive gaze control; gazing behavior; integrated object-based system; knowledge-driven object analysis; lazy robot approach; motion saliency; multicriterial focus; multimodal saliency-based attention; necessary head movement; robotic platforms; saliency cumulation; saliency-driven overt attention; salient proto-objects; scene analysis; Measurement; active perception; saliency-based overt attention; scene exploration;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on
  • Conference_Location
    Vilamoura
  • ISSN
    2153-0858
  • Print_ISBN
    978-1-4673-1737-5
  • Type

    conf

  • DOI
    10.1109/IROS.2012.6385515
  • Filename
    6385515