Title :
StoryGraphs: Visualizing Character Interactions as a Timeline
Author :
Tapaswi, Makarand ; Bauml, Martin ; Stiefelhagen, Rainer
Author_Institution :
Karlsruhe Inst. of Technol., Karlsruhe, Germany
Abstract :
We present a novel way to automatically summarize and represent the storyline of a TV episode by visualizing character interactions as a chart. We also propose a scene detection method that lends itself well to generate over-segmented scenes which is used to partition the video. The positioning of character lines in the chart is formulated as an optimization problem which trades between the aesthetics and functionality of the chart. Using automatic person identification, we present StoryGraphs for 3 diverse TV series encompassing a total of 22 episodes. We define quantitative criteria to evaluate StoryGraphs and also compare them against episode summaries to evaluate their ability to provide an overview of the episode.
Keywords :
data visualisation; entertainment; image segmentation; object recognition; optimisation; video signal processing; StoryGraphs; TV episode; TV series; automatic person identification; character interaction visualization; character line positioning; episode overview; episode summaries; optimization problem; over-segmented scene generation; scene detection method; storyline representation; storyline summarization; timeline; video partitioning; Dynamic programming; Image color analysis; Motion pictures; Optimization; Silicon; TV; Visualization;
Conference_Titel :
Computer Vision and Pattern Recognition (CVPR), 2014 IEEE Conference on
Conference_Location :
Columbus, OH
DOI :
10.1109/CVPR.2014.111