Video annotation of TV content using audiovisual information

Content provider companies and televisions have large video archives but usually do not take full advantage of them. In order to assist the exploration of video archives, we developed ViewProcFlow, a tool to automatically extract metadata from video. This metadata is obtained by applying several state of the art video processing methods applied to a real world challenge: cut detection, face detection and object identification. In addition, we also developed a method to annotate videos with concepts from audio and visual information. The main novelty of this technique is the use of environmental sound recognition to annotate video. The goal is to supply the system with more information such that it has a better understanding of the content and also to enable better browse and search functionalities. This tool has been included in the workflow of a video production company, which confirms its success.