Title :
Audiovisual Affect Recognition in Spontaneous Filipino Laughter
Author :
Galvan, Christopher ; Manangan, David ; Sanchez, Michael ; Wong, Jason ; Cu, Jocelynn
Author_Institution :
Center for Empathic Human-Comput. Interactions, De La Salle Univ., Manila, Philippines
Abstract :
Laughter has been determined as an important social signal that can predict emotional information of users. This paper presents an extension of a previous study that discovers underlying affect in Filipino laughter using audio features, a posed laughter database and categorical labels. For this study, analysis of visual (facial points) and audio (voice) information from a spontaneous laughter corpus with dimensional labels was explored. Laughter instances from a three test subject made up the corpus. Audio features extracted from the instances included prosodic features such as pitch, energy, intensity, formants (F1, F2 and F3), pitch contours, and thirteen Mel Frequency Cepstral Coefficients. Visual features included 170 facial distances taken from 68 facial points. Machine learning experiments were then performed in which Support Vector Machines -- Regression yielded the lowest mean absolute error rate of 0.0506 for the facial dataset. Other classifiers used were Linear Regression and Multilayer Perceptron.
Keywords :
audio signal processing; cepstral analysis; emotion recognition; error statistics; face recognition; feature extraction; learning (artificial intelligence); multilayer perceptrons; regression analysis; support vector machines; audio feature extraction; audiovisual affect recognition; emotional information; facial points; laughter database; linear regression; machine learning; mean absolute error rate; mel frequency cepstral coefficient; multilayer perceptron; pitch contour; prosodic feature; social signal; spontaneous Filipino laughter; support vector machine; visual analysis; visual feature; Databases; Educational institutions; Feature extraction; Human computer interaction; Humans; Linear regression; Support vector machines; Affect/Emotion Recognition; Audio Signals; Emphatic Computing; Laughter; Video Signal;
Conference_Titel :
Knowledge and Systems Engineering (KSE), 2011 Third International Conference on
Conference_Location :
Hanoi
Print_ISBN :
978-1-4577-1848-9
DOI :
10.1109/KSE.2011.49