Content-based drama editing based on inter-media synchronization

Author

Yaginuma, Yoshitomo ; Sakauchi, Masao

Author_Institution

Inst. of Ind. Sci., Tokyo Univ., Japan

fYear

1996

fDate

17-23 Jun 1996

Firstpage

322

Lastpage

329

Abstract

Automatic image recognition is usually difficult. However, drama is composed of not only image but also sound and script. Therefore, higher level recognition of drama which cannot be achieved by the image analysis will be realized by integrating image analysis, sound analysis and document analysis. In this paper, focusing on the semantic descriptions in the script, content-based drama editing based on inter-media synchronization is proposed. In the proposed method, inter-media synchronization between image, sound and script is carried out using DP matching. Then, the script is edited using an ordinary text editor. Finally, the editing of drama is carried out by selecting and aligning the image and sound based on the edited script. Therefore, the proposed method can realize effective and semantic-based video editing by handling smaller and more abstracted data. The experimental results reveal the effectiveness of the proposed method

Keywords

document handling; image recognition; multimedia computing; synchronisation; text editing; DP matching; content-based drama editing; document analysis; image analysis; image recognition; intermedia synchronization; script; semantic descriptions; sound; sound analysis; text editor; Data mining; Document handling; Image analysis; Image recognition; Indexing; Layout; Loudspeakers; TV; Text analysis;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia Computing and Systems, 1996., Proceedings of the Third IEEE International Conference on

Conference_Location

Hiroshima

Print_ISBN

0-8186-7438-5

Type

conf

DOI

10.1109/MMCS.1996.534994

Filename

534994