• DocumentCode
    3602242
  • Title

    Recognizing Emotions Induced by Affective Sounds through Heart Rate Variability

  • Author

    Nardelli, Mimma ; Valenza, Gaetano ; Greco, Alberto ; Lanata, Antonio ; Scilingo, Enzo Pasquale

  • Author_Institution
    Dept. Dept. of Inf. Eng. & Res. Centre E. Piaggio, Sch. of Eng., Univ. of Pisa, Pisa, Italy
  • Volume
    6
  • Issue
    4
  • fYear
    2015
  • Firstpage
    385
  • Lastpage
    394
  • Abstract
    This paper reports on how emotional states elicited by affective sounds can be effectively recognized by means of estimates of Autonomic Nervous System (ANS) dynamics. Specifically, emotional states are modeled as a combination of arousal and valence dimensions according to the well-known circumplex model of affect, whereas the ANS dynamics is estimated through standard and nonlinear analysis of Heart rate variability (HRV) exclusively, which is derived from the electrocardiogram (ECG). In addition, Lagged Poincaré Plots of the HRV series were also taken into account. The affective sounds were gathered from the International Affective Digitized Sound System and grouped into four different levels of arousal (intensity) and two levels of valence (unpleasant and pleasant). A group of 27 healthy volunteers were administered with these standardized stimuli while ECG signals were continuously recorded. Then, those HRV features showing significant changes (p $<;$ 0.05 from statistical tests) between the arousal and valence dimensions were used as input of an automatic classification system for the recognition of the four classes of arousal and two classes of valence. Experimental results demonstrated that a quadratic discriminant classifier, tested through Leave-One-Subject-Out procedure, was able to achieve a recognition accuracy of 84.72 percent on the valence dimension, and 84.26 percent on the arousal dimension.
  • Keywords
    acoustic signal processing; electrocardiography; emotion recognition; signal classification; ANS dynamics; ECG signals; International Affective Digitized Sound System; affective sounds; arousal dimension; autonomic nervous system; electrocardiogram; emotion recognition; heart rate variability; lagged Poincare plots; leave-one-subject-out procedure; quadratic discriminant classifier; valence dimension; Acoustics; Emotion recognition; Feature extraction; Heart rate measurement; Heart rate variability; Standards; Statistical analysis; Affective Digitized Sound System (IADS); Autonomic Nervous System; Emotion Recognition; Emotion recognition; Heart rate variability; Nonlinear Analysis; Poincare plot; Quadratic Discriminant Classifier; affective digitized sound system (IADS); autonomic nervous system; heart rate variability; nonlinear analysis; poincar?? plot; quadratic discriminant classifier;
  • fLanguage
    English
  • Journal_Title
    Affective Computing, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1949-3045
  • Type

    jour

  • DOI
    10.1109/TAFFC.2015.2432810
  • Filename
    7106477