Title :
Mining actor correlations with hierarchical concurrence parsing
Author :
Yuan, Kun ; Yao, Hongxun ; Ji, Rongrong ; Sun, Xiaoshuai
Author_Institution :
Sch. of Comput. Sci. & Technol., Harbin Inst. of Technol., Harbin, China
Abstract :
Mining actor correlations from TV series enables semantic level video understanding and facilitates users to conduct correlation-based query. In this paper, we introduce a graph-based actor correlations mining framework, which serves as the first attempt for effective actor association presentation and concurrence search. We leverage face detection and tracking to locate actors with 2D-PCA detector as pretreatment. To measure the actor association into a unified graph, we propose a context-based actor correlations hierarchical parsing approach, which considers video structure and hierarchical concurrence to refine actor association in our graph modeling. We not only can accomplish actor correlations mining, but also can acquire higher semantic information according to concurrence change. We present the actor correlation mining results in a graph-based interface to enable efficient users´ navigation and search.
Keywords :
data mining; graph theory; program compilers; video retrieval; video signal processing; 2D-PCA detector; TV series; actor association presentation; context-based actor correlation hierarchical parsing approach; correlation-based query; face detection; face tracking; graph modeling; graph-based actor correlation mining; graph-based actor correlations; graph-based interface; hierarchical concurrence parsing; semantic level video; video structure; Detectors; Face detection; Gunshot detection systems; Indexing; Information analysis; Layout; Navigation; Sun; TV; Weight measurement; Actor Correlations Analysis; Video Content Analysis; Video Context;
Conference_Titel :
Acoustics Speech and Signal Processing (ICASSP), 2010 IEEE International Conference on
Conference_Location :
Dallas, TX
Print_ISBN :
978-1-4244-4295-9
Electronic_ISBN :
1520-6149
DOI :
10.1109/ICASSP.2010.5494953