Semantics Interpretation of Superimposed Captions in Sports Videos

This paper proposes a semantics understanding system to interpret the superimposed caption box (SCB) in sports videos of which the template of SCB is presumably not a priori. The embedded captions in sports video programs represent digested key information of the video content. Most of the previous studies assume that the SCB template and the character bitmaps are known. Nevertheless, the representative character bitmaps are required for recognizing the captions. This paper has the following novelty: (1) SCB extraction and identification, (2) symbol extraction, and (3) semantic interpretation of the identified captions and symbols. Experimental results show that the algorithm performs the SCB contents understanding of several commercial sports video programs.