Visual servoing of nonholonomic cart

This paper presents a visual feedback control scheme for a nonholonomic cart without capabilities for dead reckoning. A camera is mounted on the cart and it observes cues attached on the environment. The dynamics of the cart are transformed into a coordinate system in the image plane. An image-based controller which linearizes the dynamics is proposed. Since the positions of the cues in the image plane are controlled directly, possibility of missing cues is reduced considerably. Simulations are carried out to evaluate the validity of the proposed scheme. Experiments on a radio controlled car with a CCD camera are also given