A computer music system that follows a human conductor

Author

Morita, Hideyuki ; Hashimoto, Shuji ; Ohteru, Sadamu

Author_Institution

Dept. of Appl. Phys., Waseda Univ., Tokyo, Japan

Volume

24

Issue

7

fYear

1991

fDate

7/1/1991 12:00:00 AM

Firstpage

44

Lastpage

53

Abstract

An electronic orchestra with a complex performance database and MIDI (Musical Instrument Digital Interface) controllers is presented. This system responds to the gestures of a conductor through a CCD camera and a sensor glove. The processing of musical information is examined, and the system and its operation are described. It consists of a gesticulation system and the MIDI controllers. The human interface is also discussed. The first professional conductor who tried the system could direct it without special skills or knowledge of either MIDI or a computer. Tests revealed feedback effects on the behavior of the users through their auditory sense, which in turn suggested some ways to determine the parameters of tempo prediction and compensation. The system can play in concert with human performers and even as a part of a symphony orchestra.<>

Keywords

CCD image sensors; computerised pattern recognition; electronic music; user interfaces; CCD camera; MIDI; Musical Instrument Digital Interface; auditory sense; charge coupled device camera; complex performance database; computer music system; electronic orchestra; gesticulation system; human interface; sensor glove; symphony orchestra; tempo prediction; Charge coupled devices; Charge-coupled image sensors; Conductors; Control systems; Databases; Digital control; Humans; Instruments; Music; Sensor systems;

fLanguage

English

Journal_Title

Computer

Publisher

ieee

ISSN

0018-9162

Type

jour

DOI

10.1109/2.84835

Filename

84835