An Interactive Multimedia Diary for the Home

Author

De Silva, Gamhewage C. ; Yamasaki, Toshihiko ; Aizawa, K.

Author_Institution

Tokyo Univ.

Volume

40

Issue

5

fYear

2007

fDate

5/1/2007 12:00:00 AM

Firstpage

52

Lastpage

59

Abstract

A system for retrieval and summarization of multimedia data from a home-like environment continuously captures video and audio sequences as the inhabitants are moving inside the house. An interactive user interface based on hierarchical media segmentation incorporates user memory and intelligence data. In the long term, this system can provide valuable information for studies related to housing design, evaluating human behavior, and so on.

Keywords

audio signal processing; home computing; information retrieval; information retrieval systems; interactive systems; multimedia systems; user interfaces; video signal processing; audio sequence capture; hierarchical media segmentation; home-like environment; housing design; human behavior evaluation; interactive multimedia diary; interactive user interface; multimedia data retrieval system; multimedia data summarization system; video sequence capture; Acoustic sensors; Cameras; Content based retrieval; Humans; Information retrieval; Microphones; Multimedia systems; Smart homes; Streaming media; Wearable sensors; human-centered computing; multimedia data; smart home; system design and development; ubiquitous environment;

fLanguage

English

Journal_Title

Computer

Publisher

ieee

ISSN

0018-9162

Type

jour

DOI

10.1109/MC.2007.155

Filename

4198246