A robust framework for aligning lecture slides with video

Author

Xiangyu, Wang ; Ramanathan, Subramanian ; Kankanhalli, Mohan

Author_Institution

Sch. of Comput., Nat. Univ. of Singapore, Singapore, Singapore

fYear

2009

fDate

7-10 Nov. 2009

Firstpage

249

Lastpage

252

Abstract

We propose a robust approach for aligning lecture slides with lecture videos using a combination of Hough transform, optical flow and Gabor analysis. A Markov decision process model is used to incorporate prior knowledge for enhanced recognition. We demonstrate synchronization of slides with videos containing de-focused slide content, speaker occlusion as well as camera pan, tilt and zoom sequences. Experimental results confirm the effectiveness of our approach for multimedia indexing applications.

Keywords

Gabor filters; Hough transforms; Markov processes; decision theory; digital libraries; image recognition; image sequences; indexing; interactive video; synchronisation; Gabor analysis; Hough transform; Markov decision process model; camera pan; defocused slide content; digital libraries; enhanced image recognition; lecture slide alignment; lecture videos; optical flow; slide synchronization; speaker occlusion; zoom sequences; Animation; Cameras; Computer aided instruction; Content based retrieval; Content management; Hidden Markov models; Image motion analysis; Indexing; Robustness; Software libraries; Gabor analysis; Hough transform; Markov Decision Process; Multimedia Indexing; Optical-flow; Robust synchronization;

fLanguage

English

Publisher

ieee

Conference_Titel

Image Processing (ICIP), 2009 16th IEEE International Conference on

Conference_Location

Cairo

ISSN

1522-4880

Print_ISBN

978-1-4244-5653-6

Electronic_ISBN

1522-4880

Type

conf

DOI

10.1109/ICIP.2009.5413480

Filename

5413480