Smart posterboard: Multi-modal sensing and analysis of poster conversations

Conversations in poster sessions in academic events, referred to as poster conversations, pose interesting and challenging topics on multi-modal signal and information processing. This paper gives an overview of our project on the smart posterboard for multi-modal conversation analysis. The smart posterboard has multiple sensing devices to record poster conversations, so we can review who came to the poster and what kind of questions or comments he/she made. The conversation analysis combines speech and image processing such as head tracking, speech enhancement and speaker diarization. Moreover, we are also investigating high-level indexing of interest and comprehension level of the audience, based on their multi-modal behaviors during the conversation.