DocumentCode :
3585090
Title :
Eye gaze for understanding conversational speech
Author :
Prokofieva, Anna ; Hakkani-Tur, Dilek ; Slaney, Malcolm
Author_Institution :
Microsoft Res., Redmond, WA, USA
fYear :
2014
Firstpage :
572
Lastpage :
577
Abstract :
Eye gaze is a useful indication of attention and, as such, can be a valuable feature to improve spoken-language understanding in human-computer interaction. Based on the hypothesis that users look at a link before selecting it, we investigate the use of novel eye-gaze features to improve link click event prediction. Our data comprises users performing a variety of online tasks such as form filling and web browsing, and we show significant performance improvement by incorporating the use of gaze features. In addition, our analysis shows that there is much user-specific variation in gaze, so we are also looking to improve the modeling of gaze by user- and task-specific adaptation.
Keywords :
gaze tracking; human computer interaction; natural language processing; speech processing; conversational speech understanding; eye gaze feature; human computer interaction; link click event prediction; spoken language understanding; Boats; Conferences; Face; Fasteners; Filling; Human computer interaction; Speech; SLU; eye gaze;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Spoken Language Technology Workshop (SLT), 2014 IEEE
Type :
conf
DOI :
10.1109/SLT.2014.7078637
Filename :
7078637
Link To Document :
بازگشت