DocumentCode :
780773
Title :
Instantly indexed multimedia databases of real world events
Author :
Pingali, Gopal S. ; Opalach, Agata ; Jean, Yves D. ; Carlbom, Ingrid B.
Author_Institution :
IBM Thomas J. Watson Res. Center, Hawthorne, NY, USA
Volume :
4
Issue :
2
fYear :
2002
fDate :
6/1/2002 12:00:00 AM
Firstpage :
269
Lastpage :
282
Abstract :
We introduce a new paradigm for real-time conversion of a real world event into a rich multimedia database by processing data from multiple sensors observing the event. A real-time analysis of the sensor data, tightly coupled with domain knowledge, results in instant indexing of multimedia data at capture time. This yields semantic information to answer complex queries about the content and the ability to extract portions of data that correspond to complex actions performed in the real world. The power of such an instantly indexed multimedia database system, in content-based retrieval of multimedia data or in semantic analysis and visualization of the data, far exceeds that of systems which index multimedia data only after it is produced. We present LucentVision, an instantly indexed multimedia database system developed for the sport of tennis. This system analyzes video from multiple cameras in real time and captures the activity of the players and the ball in the form of motion trajectories. The system stores these trajectories in a database along with video, 3D models of the environment, scores, and other domain-specific information. LucentVision has been used to enhance live television and Internet broadcasts with game analyses and virtual replays in more than 250 international tennis matches.
Keywords :
content-based retrieval; database indexing; image retrieval; multimedia databases; real-time systems; sport; LucentVision; content-based retrieval; database indexing; multimedia databases; real-time systems; semantic analysis; sport; Cameras; Content based retrieval; Data mining; Data visualization; Indexes; Indexing; Information retrieval; Multimedia databases; Multimedia systems; Real time systems;
fLanguage :
English
Journal_Title :
Multimedia, IEEE Transactions on
Publisher :
ieee
ISSN :
1520-9210
Type :
jour
DOI :
10.1109/TMM.2002.1017739
Filename :
1017739
Link To Document :
بازگشت