Sensor fusion: Towards a fully expressive 3D music control interface

Author

Odowichuk, Gabrielle ; Trail, Shawn ; Driessen, Peter ; Nie, Wendy ; Page, Wyatt

Author_Institution

Dept. of Electr. & Comput. Eng., Univ. of Victoria, Victoria, BC, Canada

fYear

2011

fDate

23-26 Aug. 2011

Firstpage

836

Lastpage

841

Abstract

This paper describes a study into the realisation of a new method for capturing 3D sound control data. It expands on our established practice with the radiodrum 3D input device by incorporating a computer vision platform that we have developed using the Xbox Kinect motion sensing input device. It also extends our previous work in systemizing a low-cost, open-source 3D gesture sensor system, as a novel method for musically oriented human computer interaction. We discuss in detail the development process and the system performance in different scenarios and outline the future directions of this development.

Keywords

computer vision; gesture recognition; human computer interaction; music; musical instruments; sensor fusion; 3D music control interface; Xbox Kinect motion sensing input device; computer vision platform; musically oriented human computer interaction; open-source 3D gesture sensor system; radiodrum 3D input device; sensor fusion; Biological system modeling; Computers; Data models; Instruments; Music; Three dimensional displays;

fLanguage

English

Publisher

ieee

Conference_Titel

Communications, Computers and Signal Processing (PacRim), 2011 IEEE Pacific Rim Conference on

Conference_Location

Victoria, BC

ISSN

1555-5798

Print_ISBN

978-1-4577-0252-5

Electronic_ISBN

1555-5798

Type

conf

DOI

10.1109/PACRIM.2011.6033003

Filename

6033003