• DocumentCode
    548825
  • Title

    AR-based virtual musical instruments using SMC tracking

  • Author

    Olivieri, David ; Conde, Iván Gómez ; Vila-Sobrino, Xosé Antón

  • Author_Institution
    Dept. of Comput. Sci., Univ. de Vigo, Ourense, Spain
  • fYear
    2011
  • fDate
    15-18 June 2011
  • Firstpage
    1
  • Lastpage
    7
  • Abstract
    We describe a real-time computer vision application that creates sound from virtual musical instruments by tracking hand and finger movements with a color-based Sequential Monte Carlo algorithm. We show how the combination of real-time hand tracking, virtual MIDI SoundFont technology, and computer graphics, can be used for producing powerful yet inexpensive augmented reality environments.
  • Keywords
    Monte Carlo methods; augmented reality; computer graphics; computer vision; monolayers; object tracking; AR-based virtual musical instruments; SMC tracking; augmented reality environments; color-based sequential Monte Carlo algorithm; computer graphics; finger movement tracking; hand movement tracking; real-time computer vision; real-time hand tracking; virtual MIDI SoundFont technology; Computer vision; Histograms; Instruments; Monte Carlo methods; Particle filters; Real time systems; Tracking; Tracking; augmented reality; particle filters; virtual musical instruments;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Information Systems and Technologies (CISTI), 2011 6th Iberian Conference on
  • Conference_Location
    Chaves
  • Print_ISBN
    978-1-4577-1487-0
  • Type

    conf

  • Filename
    5974268