Physically-based augmentation of real objects with virtual content under the influence of ambient light

In this article, we introduce a new method for the augmentation of a real object with virtual content under the influence of ambient light. For this purpose, we use a physically-based simulation and spectral data which is recorded separately for each of the components: projector, ambient light and real object. Then the simulation computes the influence of every component to the scene and uses the results to compute an adjusted virtual content, which can then be displayed by a real projector in the given situation. The adjustment of the projection can therefore be computed by considering the full dynamic range of the scene and that of the virtual content. Additionally, the virtual content is visualized with informations from the environment and therefore hidden objects or reflections can be integrated into the projection. The proposed methods and the physically-based simulation are validated and visualized through different experiments.