Handling Occlusions in Real-time Augmented Reality : Dealing with Movable Real and Virtual Objects

Realistic rendering in real-time augmented reality applications leads one to consider physical interactions between real and virtual worlds. One of these interactions is mutual occlusions in the rendered viewpoint. This paper presents two approaches for handling occlusions when the real objects can be displaced or deformed. The first approach is model-based. It is suited for a static viewpoint and relies only on a tracked bounding volume model within which the object’s silhouette is carved. The second approach is depthbased and makes it possible to change the viewpoint by exploiting a handheld stereo camera. Both approaches are devised to minimize the effect of real object tracking errors in the rendered viewpoint.