• DocumentCode
    1460274
  • Title

    Visual Rhythm Detection and Its Applications in Interactive Multimedia

  • Author

    Chen, Trista P. ; Chen, Ching-Wei ; Popp, Phillip ; Coover, Bob

  • Volume
    18
  • Issue
    1
  • fYear
    2011
  • Firstpage
    88
  • Lastpage
    95
  • Abstract
    True multimedia experience involves multimodal media and their intrinsic interactions. This article identifies rhythm as the link between physical movement, other visual stimuli, and the musical art form. It describes two example interactive multimedia applications in which visual rhythm is extracted for synchronization of music and video to allow more intuitive interaction between a user and both audio and video content, leaving the door open for many potential innovative applications.
  • Keywords
    interactive systems; multimedia systems; music; video signal processing; interactive multimedia; multimodal media; music synchronization; musical art form; video synchronization; visual rhythm detection; visual stimuli; Computer vision; Feature extraction; Image motion analysis; Interactive systems; Multimedia communication; Rhythm; Videos; Visualization; beat detection; novelty detection; time stretching; visual rhythm; visual tempo;
  • fLanguage
    English
  • Journal_Title
    MultiMedia, IEEE
  • Publisher
    ieee
  • ISSN
    1070-986X
  • Type

    jour

  • DOI
    10.1109/MMUL.2011.19
  • Filename
    5720679