Exploring interactivity and augmented reality in theater: A case study of Half Real

This paper presents a case study of Half Real, a live action, interactive theater show employing spatial augmented reality. Half Real is based on a murder investigation, where the live audience votes on how the investigation proceeds. Half Real immerses live actors into a virtual world projected onto the set. Using spatial augmented reality technology in theater brings new possibilities that would not be possible with simple video projection. Half Real models the set as a 3D virtual environment. Actors are tracked as they move about on stage, with the projected content responding to their movements. A real time AR system allows content to be generated procedurally. Half Real makes use of this by projecting vote options and results directly into the virtual environment. This paper describes Half Real, with a focus on the technology used to make the production possible. We describe the benefits of the techniques used and the challenges faced during production.