Author_Institution :
Sch. of Inf. Technol. & Eng., VIT Univ., Vellore, India
Abstract :
Video shot boundary detection (SBD) is the first step of video analysis, summarization, indexing, and retrieval. In SBD process, videos are segmented into basic units called shots. In this paper, a new SBD method is proposed using color, edge, texture, and motion strength as vector of features (feature vector). Features are extracted by projecting the frames on selected basis vectors of Walsh-Hadamard transform (WHT) kernel and WHT matrix. After extracting the features, based on the significance of the features, weights are calculated. The weighted features are combined to form a single continuity signal, used as input for Procedure Based shot transition Identification process (PBI). Using the procedure, shot transitions are classified into abrupt and gradual transitions. Experimental results are examined using large-scale test sets provided by the TRECVID 2007, which has evaluated hard cut and gradual transition detection. To evaluate the robustness of the proposed method, the system evaluation is performed. The proposed method yields F1-Score of 97.4% for cut, 78% for gradual, and 96.1% for overall transitions. We have also evaluated the proposed feature vector with support vector machine classifier. The results show that WHT-based features can perform well than the other existing methods. In addition to this, few more video sequences are taken from the Openvideo project and the performance of the proposed method is compared with the recent existing SBD method.
Keywords :
Fourier transforms; edge detection; feature extraction; image classification; image colour analysis; image motion analysis; image segmentation; image sequences; image texture; matrix algebra; support vector machines; video retrieval; video signal processing; Openvideo project; SBD process; TRECVID 2007; WHT kernel; WHT matrix; Walsh-Hadamard transform kernel-based feature vector; abrupt transitions; feature extraction; feature vector; gradual transition detection; motion strength; procedure based shot transition identification process; shot transition classification; support vector machine classifier; video analysis; video indexing; video retrieval; video sequences; video shot boundary detection; video summarization; Cameras; Feature extraction; Image color analysis; Image edge detection; Kernel; Transforms; Vectors; Procedure Based Identification; Shot Boundary Detection; Shot boundary detection; Walsh Hadamard Transform Kernel; Walsh Hadamard transform kernel; basis vectors; feature vector; probabilistic classifier with feature weights; procedure based identification;