Feature space mutual information in speech-video sequences

Author

Butz, Torsten ; Thiran, Jean-Philippe

Author_Institution

Signal Process. Inst. (ITS), Swiss Fed. Inst. of Technol. (EPFL), Lausanne, Switzerland

Volume

2

fYear

2002

fDate

2002

Firstpage

361

Abstract

We present an approach to directly study mutual relationships between audio and video signals for multimedia applications. The presented approach is mathematically based on information theory and is closely related to information theoretic classification. We show that very simple features of the audio- resp. video-channel can already contain lots of mutual information between both modalities. The mathematical approach is very general though and not restricted to the presented multimedia application.

Keywords

audio signal processing; feature extraction; image sequences; information theory; multimedia communication; speech processing; video signal processing; audio signals; digital signal processing; feature space mutual information; information theoretic classification; information theory; multimedia applications; multimedia signal processing; speech-based speaker detection; speech-video sequences; video signals; video-channel; Data mining; Feature extraction; Information theory; Marine vehicles; Mouth; Mutual information; Signal processing; Space technology; Video signal processing; World Wide Web;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2002. ICME '02. Proceedings. 2002 IEEE International Conference on

Print_ISBN

0-7803-7304-9

Type

conf

DOI

10.1109/ICME.2002.1035605

Filename

1035605