Title :
Non-rigid structure from motion with incremental shape prior
Author :
Lili Tao ; Matuszewski, Bogdan J. ; Mein, S.J.
Author_Institution :
Appl. Digital Signal & Image Process. Res. Centre, Univ. of Central Lancashire, Preston, UK
fDate :
Sept. 30 2012-Oct. 3 2012
Abstract :
Most existing approaches to the non-rigid structure from motion problem use batch type algorithms with all the data collected before 3D shape reconstruction takes place. Such a methodology is not suitable for real-time applications. Concurrent on-line estimation of the camera position and 3D structure, based only on the measurements up to that moment is much more a challenging problem. In this paper, a novel approach is proposed for recursive recovery of non-rigid structures from image sequences captured by an orthographic camera. The main novelty in the proposed method is an adaptive algorithm for construction of shape constraints imposing stability on the on-line reconstructed shapes. The proposed, adaptively learned constraints have two aspects, consisting of constraints imposed on the basic shapes, the basic “building blocks” from which shapes are reconstructed, as well as constraints imposed on the mixing coefficients in a form of their probability distribution. The constraints are updated when the current model inadequately represents new shapes. This is achieved by means of Incremental Principal Component Analysis (IPCA). Results of the proposed method are shown on synthetic and real data of articulated face.
Keywords :
image motion analysis; image reconstruction; image sequences; principal component analysis; recursive estimation; 3D shape reconstruction; 3D structure; IPCA; adaptive algorithm; articulated face; batch type algorithms; building blocks; camera position; image sequences; incremental principal component analysis; incremental shape prior; mixing coefficients; motion problem; nonrigid structure; online estimation; orthographic camera; probability distribution; real data; recursive recovery; shape constraints; synthetic data; Cameras; Face; Image reconstruction; Optimization; Principal component analysis; Shape; Vectors; Structure from motion; incremental PCA; non-rigid structure; sequential approach;
Conference_Titel :
Image Processing (ICIP), 2012 19th IEEE International Conference on
Conference_Location :
Orlando, FL
Print_ISBN :
978-1-4673-2534-9
Electronic_ISBN :
1522-4880
DOI :
10.1109/ICIP.2012.6467219