Keypoints labeling for backgroung substraction in tracking applications

This paper studies the problem of background/object differentiation in a keypoint-based tracking application where the object is delimited with a bounding box. We present a keypoint labeling algorithm based on four features: the label of the matched keypoint, color, motion, and position. We discuss methods to best exploit these features, then we detail our labeling algorithm and validate it with some experiments on several tracking video sequences.