Deformable surface stereo tracking-by-detection using Second Order Cone Programming.

We present a method for tracking deformable surfaces in 3D using a stereo rig. Different from traditional recursive tracking approaches that provide a strong prior on the pose for each new frame, the proposed method tracks deformable surfaces by detecting them in individual frames. In our method, the model of the surface is represented by a triangulated mesh. The constraints for model to image keypoint correspondences, together with the constraints that preserve the lengths of mesh edges, are formulated as second order cone programming (SOCP) constraints, leading this tracking-by-detection method to be an SOCP problem that can be effectively solved. Experiments on a piece of deformed paper demonstrate the capability of the proposed tracking-by-detection method.