Relighting in spatial augmented reality

As an important research field in image based rendering, relighting techniques make it possible to synthesis physically real objects in virtue scenes, which will definitely enhance sense of reality for users and thus improve user experience. On the other hand, as an important branch of augment reality, spatially augmented reality also seeks for user experience enhancement in emersions, which is achieved by aligning projected graphics with real objects. The inner characteristics of the two techniques make the integration of them very promising in enhancing user experience. This paper would discuss the integration of relighting methods in spatial augmented reality; detailed analysis on aligning virtual objects with real objects would be given and the process of relighting would also be introduced. Appealing relighting results and comparisons would be presented too. Finally, the relighting results on table-top spatially augmented reality system with an application on car models in two complex lighting conditions would be demonstrated.