Motion vector processing using the color information

In this paper, we investigate color distribution around object edges and further exploit this information for motion vector reliability analysis. Since the motion vectors are often estimated only based on luminance component, the resulting motion vectors may become unreliable for the areas with similar intensity. By making use of the color information for the received residual energy calculation, these unreliable motion vectors can effectively be identified. Moreover, the motion boundaries can be easily detected due to stronger residual energy distribution on the object boundaries. This characteristic can also be used to assist the motion vector processing in motion-compensated frame interpolation so that the interpolated object structures can be well maintained. Experimental results show that using same motion vector processing approach but with additional consideration on color information outperforms other methods.