Real-time prototype for multiple source tracking through generalized state coherence transform and particle filtering

This real-time demo implements a novel method for tracking bidimensional TDOAs of several concurrent acoustic sources using a small number of microphones. A batch on-line frequency-domain ICA is applied to the mixture recorded by an array consisting of three or four microphones. The estimated mixing matrices are used to compute an approximated instantaneous kernel density of the time-delay propagation through the Generalized State Coherence Transform (GSCT). Tracking of the propagation parameters of each source is performed through multiple disjoint particle filters which estimate the posterior kernel density of the bidimensional time-delays based on the instantaneous GSCT function. The tracked 2D TDOAs are then used to drive a Blind Source Separation (BSS) algorithm that extracts the sound source selected by the user. The demo will be run in presence of up to five competitive sources.