A remix instrument based on fragment feature-analysis

We present an innovative remix-instrument that allows to create music from a collection of audio-visual media fragments. A three-dimensional scatter plot derived from feature-analysis becomes a Theremin-inspired instrument that enables exploration, intuitive navigation and embodied performance of the media fragments on a granular level. As example, we are using the audiovisual recording of an instrumental performance as source for interactive remix. Our system provides an alternative interface to the musical instrument´s audiovisual corpus: as the instrument´s sound and behavior can be accessed in ways which are not possible on the original instrument, the resulting non-linear playback of the grains generates an instant remix in a cut-up aesthetic. The presented system is a novel strategy to access and re-use media fragments in the domain of musical interfaces.