Deformation of Time-Varying-Mesh Based on Semantic Human Model

In this paper, an approach is presented for deformation of time-varying-mesh, which is a sequence of 3D mesh models. The deformation here is a process to generate mid-frames between two frames that transform smoothly from one to the other. Motion vectors between two frames are extracted based on a semantic human model with an assumption of the articulated object with piecewise-rigid motions. For this purpose, each mesh model is transformed to a volumetric model, where a distance field is constructed. In the first frame, the user manually segments the volumetric model into the semantic human model. Then, fast motion estimation of the volumetric models is performed between the two frames with a cost function based on the distance field. Using the estimated motion vectors, a realistic deformation of a mesh model is achieved. Lastly, mid-frames are interpolated linearly. The technique can be applied in many areas such as frame rate up-conversion and motion blending.