Video Shot Segmentation Using Spatio-temporal Fuzzy Hostility Index and Automatic Threshold

Shot segmentation is an important preprocessing step towards content based video analysis. In this paper, we propose a Spatio-Temporal Fuzzy Hostility Index (STFHI) for determining the edges of objects present in the frames, composing the video. The edges present in the frames are treated as features of the frame. The correlation between the features is computed for successive frames of the video. An automatic threshold is set using the three-sigma rule, on the gradient of correlation values thus computed to detect hard cuts (abrupt transitions) in the video. The proposed method is able to accurately detect the hard cuts in a video. In an experimental evaluation on a heterogeneous test set, consisting of videos from sports, movie songs, music albums and documentaries, the proposed method achieves substantial improvement over the state of the art methods.