Title :
A robust framework for aligning lecture slides with video
Author :
Xiangyu, Wang ; Ramanathan, Subramanian ; Kankanhalli, Mohan
Author_Institution :
Sch. of Comput., Nat. Univ. of Singapore, Singapore, Singapore
Abstract :
We propose a robust approach for aligning lecture slides with lecture videos using a combination of Hough transform, optical flow and Gabor analysis. A Markov decision process model is used to incorporate prior knowledge for enhanced recognition. We demonstrate synchronization of slides with videos containing de-focused slide content, speaker occlusion as well as camera pan, tilt and zoom sequences. Experimental results confirm the effectiveness of our approach for multimedia indexing applications.
Keywords :
Gabor filters; Hough transforms; Markov processes; decision theory; digital libraries; image recognition; image sequences; indexing; interactive video; synchronisation; Gabor analysis; Hough transform; Markov decision process model; camera pan; defocused slide content; digital libraries; enhanced image recognition; lecture slide alignment; lecture videos; optical flow; slide synchronization; speaker occlusion; zoom sequences; Animation; Cameras; Computer aided instruction; Content based retrieval; Content management; Hidden Markov models; Image motion analysis; Indexing; Robustness; Software libraries; Gabor analysis; Hough transform; Markov Decision Process; Multimedia Indexing; Optical-flow; Robust synchronization;
Conference_Titel :
Image Processing (ICIP), 2009 16th IEEE International Conference on
Conference_Location :
Cairo
Print_ISBN :
978-1-4244-5653-6
Electronic_ISBN :
1522-4880
DOI :
10.1109/ICIP.2009.5413480