Simultaneous segmentation of range and color images based on Bayesian decision theory

This paper describe a new algorithm to segment in continuous parametric regions registered color and range images. The algorithm starts with an initial partition of small first order regions using a robust fitting method constrained by the detection of depth and orientation discontinuities in the range signal and color edges in the color signal. The algorithm then optimally group these regions into larger and larger regions using parametric functions until an approximation limit is reached. The algorithm uses Bayesian decision theory to determine the local optimal grouping and the complexity of the parametric model used to represent the range and color signals. Experimental results are presented.