DocumentCode :
2628228
Title :
PAD-based multimodal affective fusion
Author :
Gilroy, Stephen W. ; Cavazza, Marc ; Niiranen, Marcus ; André, Elisabeth ; Vogt, Thurid ; Urbain, Jérôm ; Benayoun, Maurice ; Seichter, Hartmut ; Billinghurst, Mark
Author_Institution :
Univ. of Teesside, Middlesbrough, UK
fYear :
2009
fDate :
10-12 Sept. 2009
Firstpage :
1
Lastpage :
8
Abstract :
The study of multimodality is comparatively less developed for affective interfaces than for their traditional counterparts. However, one condition for the successful development of affective interface technologies is the development of frameworks for the real-time multimodal fusion. In this paper, we describe an approach to multimodal affective fusion, which relies on a dimensional model, Pleasure-Arousal-Dominance (PAD) to support the fusion of affective modalities, each input modality being represented as a PAD vector. We describe how this model supports both affective content fusion and temporal fusion within a unified approach. We report results from early user studies which confirm the existence of a correlation between measured affective input and user temperament scores.
Keywords :
emotion recognition; image fusion; affective content fusion; affective interface technology; affective modalities; dimensional model; multimodal affective fusion; multimodality; pleasure-arousal-dominance; real-time multimodal fusion; temporal fusion; user temperament scores; Appraisal; Atherosclerosis; Digital art; Displays; Emotion recognition; Humans; Merging; Robustness; Speech; User interfaces;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Affective Computing and Intelligent Interaction and Workshops, 2009. ACII 2009. 3rd International Conference on
Conference_Location :
Amsterdam
Print_ISBN :
978-1-4244-4800-5
Electronic_ISBN :
978-1-4244-4799-2
Type :
conf
DOI :
10.1109/ACII.2009.5349552
Filename :
5349552
Link To Document :
بازگشت