Multimodal Processing of Discourse Information; The Effect of Synchrony

Author

Campbell, Nick

Author_Institution

Spoken Language Commun. Group, MASTAR Project, Keihanna Science City, Japan

fYear

2008

fDate

15-16 Dec. 2008

Firstpage

12

Lastpage

15

Abstract

This paper describes progress in the design of unobtrusive technology for the tracking of participant status and engagement in spoken conversations. The apparatus and algorithms have applications in human-computer interface design and will enable a better level of communication between an information providing system, or robot, and a human user by mimicking the nonverbal processes that are an essential part of human-human face-to-face spoken interactions.

Keywords

human computer interaction; user interface management systems; discourse information multimodal processing; human-computer interface design; human-human face-to-face spoken interactions; information providing system; nonverbal processes; synchrony effect; Algorithm design and analysis; Cities and towns; Cultural differences; Face detection; Human robot interaction; Loudspeakers; Magnetic heads; Natural languages; Speech processing; Streaming media; Discourse Information; Multimodal Processing; Synchrony;

fLanguage

English

Publisher

ieee

Conference_Titel

Universal Communication, 2008. ISUC '08. Second International Symposium on

Conference_Location

Osaka

Print_ISBN

978-0-7695-3433-6

Type

conf

DOI

10.1109/ISUC.2008.36

Filename

4724435