An audiovisual virtual interface

State-of-the-art synthesizers provide numerous controllers through which the user may create a great variety of sounds. The real-time control of so many parameters though, is often problematic for the user. The goal of our work has been to study the physical and remote control of such audial parameters. For this purpose, a system was developed that processes video input and recognizes movements of the user´s body parts (movement of hands, head etc.) and translates them as change in some audial parameters of an electronic music instrument (tone, cutoff, etc.). Also, basic techniques of digital audio synthesis were studied and a prototype synthesizer was developed that is controlled physically and remotely. The study didn´t limit itself in technical details, but contained study of the human psyche and cognition, as much for the audial, as also for the video part of the implementation of the system.