Title :
Mining Group Nonverbal Conversational Patterns Using Probabilistic Topic Models
Author :
Jayagopi, Dinesh Babu ; Gatica-Perez, Daniel
Author_Institution :
Idiap Res. Inst., Martigny, Switzerland
Abstract :
The automatic discovery of group conversational behavior is a relevant problem in social computing. In this paper, we present an approach to address this problem by defining a novel group descriptor called bag of group-nonverbal-patterns (NVPs) defined on brief observations of group interaction, and by using principled probabilistic topic models to discover topics. The proposed bag of group NVPs allows fusion of individual cues and facilitates the eventual comparison of groups of varying sizes. The use of topic models helps to cluster group interactions and to quantify how different they are from each other in a formal probabilistic sense. Results of behavioral topics discovered on the Augmented Multi-Party Interaction (AMI) meeting corpus are shown to be meaningful using human annotation with multiple observers. Our method facilitates “group behavior-based” retrieval of group conversational segments without the need of any previous labeling.
Keywords :
behavioural sciences computing; data mining; information retrieval; probability; social sciences computing; augmented multi-party interaction; formal probabilistic sense; group behavior-based retrieval; group conversational behavior automatic discovery; group conversational segment retrieval; group descriptor; group nonverbal conversational pattern mining; human annotation; multiple observers; principled probabilistic topic models; social computing; Ambient intelligence; Computational modeling; Hidden Markov models; Humans; Intelligent sensors; Labeling; Permission; Predictive models; Probabilistic logic; Psychology; Sensor phenomena and characterization; Social network services; Visualization; Discovery; group behavior descriptor; meetings; nonverbal cues;
Journal_Title :
Multimedia, IEEE Transactions on
DOI :
10.1109/TMM.2010.2065218