DocumentCode :
2803779
Title :
Talking heads: introducing the tool of 3D motion fields in the study of action
Author :
Neumann, Jan ; Aloimonos, Yiannis
Author_Institution :
Center for Autom. Res., Maryland Univ., College Park, MD, USA
fYear :
2000
fDate :
2000
Firstpage :
25
Lastpage :
30
Abstract :
We demonstrate a method to complete three-dimensional (3D) motion fields on a face to serve as an intermediate representation for the study of actions. Twelve synchronized and calibrated cameras are positioned all around a talking person and observe its head in motion. We represent the head as a deformable mesh, which is fitted in a global optimization step to silhouette-contour and multi-camera stereo data derived from all images. The non-rigid displacement of the mesh from frame to frame, the 3D motion field, is determined from the normal flow information in all the images. We integrate these cues over time, thus producing a spatio-temporal representation of the talking head. Our ability to estimate 3D motion fields points to a new framework for the study of action. Using multicamera configurations we can estimate a sequence of evolving 3D motion fields representing specific actions. Then, by performing a geometric and statistical analysis on these structures, we can achieve dimensionality reduction and thus come up with powerful representations of generic human action
Keywords :
cameras; computer vision; image motion analysis; optimisation; statistical analysis; stereo image processing; 3D motion fields; calibrated cameras; deformable mesh; face; geometric analysis; global optimization; head motion; human action; multi-camera stereo data; silhouette-contour data; spatio-temporal representation; statistical analysis; three-dimensional motion fields; Automation; Cameras; Educational institutions; Encoding; Humans; Image sequences; Layout; Magnetic heads; Videos; Visualization;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Human Motion, 2000. Proceedings. Workshop on
Conference_Location :
Los Alamitos, CA
Print_ISBN :
0-7695-0939-8
Type :
conf
DOI :
10.1109/HUMO.2000.897367
Filename :
897367
Link To Document :
بازگشت