Motion segmentation with level sets

Motion segmentation is an important problem in video processing and compression, and in computer vision. It is usually performed by either first estimating a field of motion parameters and then segmenting it, or by applying joint motion estimation and segmentation. Motion segmentation methods often constrain the set of possible solutions by forcing motion discontinuities to coincide with intensity discontinuities. In this paper, we propose an iterative method for joint motion estimation and segmentation that is based on level sets. The motion within individual segments is parametric and the method does not use the intensity discontinuity constraint, but is shown to be accurate for images with both synthetic and natural motion compliant with the assumed motion models.