Title :
Scalable multimodal fusion for continuous affect sensing
Author :
Hupont, Isabelle ; Ballano, Sergio ; Baldassarri, Sandra ; Cerezo, Eva
Author_Institution :
Dept. of R&D & Technol. Services, Aragon Inst. of Technol., Zaragoza, Spain
Abstract :
The success of affective interfaces lies in the fusion of emotional information coming from different modalities. This paper proposes a scalable methodology for fusing multiple affect sensing modules, allowing the subsequent addition of new modules without having to retrain the existing ones. It relies on a 2-dimensional affective model and is able to output a continuous emotional path characterizing the user´s affective progress over time.
Keywords :
emotion recognition; face recognition; human computer interaction; sensor fusion; 2D affective model; affective computing; affective interfaces; continuous affect sensing; facial expression analysis; multimodal recognition; scalable multimodal fusion; sentiment analysis; Covariance matrix; Databases; Emotion recognition; Humans; Instant messaging; Kalman filters; Mathematical model; Affective Computing; facial expression analysis; multimodal recognition; sentiment analysis;
Conference_Titel :
Affective Computational Intelligence (WACI), 2011 IEEE Workshop on
Conference_Location :
Paris
Print_ISBN :
978-1-61284-083-3
DOI :
10.1109/WACI.2011.5953150
