Title :
AR-based virtual musical instruments using SMC tracking
Author :
Olivieri, David ; Conde, Iván Gómez ; Vila-Sobrino, Xosé Antón
Author_Institution :
Dept. of Comput. Sci., Univ. de Vigo, Ourense, Spain
Abstract :
We describe a real-time computer vision application that creates sound from virtual musical instruments by tracking hand and finger movements with a color-based Sequential Monte Carlo algorithm. We show how the combination of real-time hand tracking, virtual MIDI SoundFont technology, and computer graphics, can be used for producing powerful yet inexpensive augmented reality environments.
Keywords :
Monte Carlo methods; augmented reality; computer graphics; computer vision; monolayers; object tracking; AR-based virtual musical instruments; SMC tracking; augmented reality environments; color-based sequential Monte Carlo algorithm; computer graphics; finger movement tracking; hand movement tracking; real-time computer vision; real-time hand tracking; virtual MIDI SoundFont technology; Computer vision; Histograms; Instruments; Monte Carlo methods; Particle filters; Real time systems; Tracking; Tracking; augmented reality; particle filters; virtual musical instruments;
Conference_Titel :
Information Systems and Technologies (CISTI), 2011 6th Iberian Conference on
Conference_Location :
Chaves
Print_ISBN :
978-1-4577-1487-0
