Title :
Simulating human saccadic scanpaths on natural images
Author :
Wang, Wei ; Chen, Cheng ; Wang, Yizhou ; Jiang, Tingting ; Fang, Fang ; Yao, Yuan
Author_Institution :
Natl Eng. Lab. for Video Technol., Beijing, China
Abstract :
Human saccade is a dynamic process of information pursuit. Based on the principle of information maximization, we propose a computational model to simulate human saccadic scanpaths on natural images. The model integrates three related factors as driven forces to guide eye movements sequentially - reference sensory responses, fovea-periphery resolution discrepancy, and visual working memory. For each eye movement, we compute three multi-band filter response maps as a coherent representation for the three factors. The three filter response maps are combined into multi-band residual filter response maps, on which we compute residual perceptual information (RPI) at each location. The RPI map is a dynamic saliency map varying along with eye movements. The next fixation is selected as the location with the maximal RPI value. On a natural image dataset, we compare the saccadic scanpaths generated by the proposed model and several other visual saliency-based models against human eye movement data. Experimental results demonstrate that the proposed model achieves the best prediction accuracy on both static fixation locations and dynamic scanpaths.
Keywords :
computer vision; eye; natural scenes; optimisation; vision defects; visual perception; dynamic saliency map; eye movements; human saccadic scanpaths; information maximization; multiband filter response maps; natural images; reference sensory responses; residual perceptual information; visual working memory; Computational modeling; Data models; Humans; Neurons; Spatial resolution; Visualization;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on
Conference_Location :
Providence, RI
Print_ISBN :
978-1-4577-0394-2
DOI :
10.1109/CVPR.2011.5995423