Mobile onsite exploration of parallel realities with Oculus Rift

This paper reports experience in developing a parallel reality system which allows its user to observe and move around their real environment whilst wearing a stereoscopic 3D head mounted display imbued with video-see through capabilities, with their position and gaze tracked by an indoor positioning system and head tracker, allowing them to alternately view their real environment and an immersive virtual reality environment from the equivalent vantage point. In so doing the challenge of the vacancy problem is addressed by lightening the cognitive load needed to switch between realities and to navigate the virtual environment. Evaluation of the usability, system performance and value of the system are undertaken in the context of a cultural heritage application; users are able to compare a reconstruction of an important 15th century chapel with its present day instantiation.