• DocumentCode
    2608803
  • Title

    Real-time Sound Source Localization Based on Audiovisual Frequency Integration

  • Author

    Tsuji, Tokuo ; Yamamoto, Kenkichi ; Ishii, Idaku

  • Author_Institution
    Dept. of Artificial Complex Syst., Hiroshima Univ.
  • Volume
    4
  • fYear
    0
  • fDate
    0-0 0
  • Firstpage
    322
  • Lastpage
    325
  • Abstract
    We propose a pixelwise sound source localization algorithm based on audiovisual frequency integration. The localization is realized by detecting the common vibration dynamics of sound sources in the audio and the brightness signal. In order to detect the common vibration dynamics, temporal correlation values between the two signals are calculated in the algorithm. Several experimental results are shown for vibrated objects, and the pixelwise sound source localization images are obtained
  • Keywords
    acoustic signal detection; acoustic signal processing; audio signal processing; audiovisual frequency integration; pixelwise sound source localization images; real-time sound source localization; sound source detection; temporal correlation values; vibration dynamics detection; Acoustic sensors; Brightness; Change detection algorithms; Frequency; Humans; Image coding; Image sensors; Low-frequency noise; Microphones; Pixel;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Pattern Recognition, 2006. ICPR 2006. 18th International Conference on
  • Conference_Location
    Hong Kong
  • ISSN
    1051-4651
  • Print_ISBN
    0-7695-2521-0
  • Type

    conf

  • DOI
    10.1109/ICPR.2006.967
  • Filename
    1699845