Using the unity® game engine as a platform for advanced real time cinema image processing

The global context of our work is the virtual production film industry. We present an efficient framework to merge a low resolution depth map sensor with a high resolution film camera. The depth sensor used is a Kinect 2. Our method is especially designed for film production requiring live (pre) visualization. To achieve realtime performance we are not using a specific customized solution software but the very popular game engine Unity®. Our process is directly implemented into this game engine to give the user all the realtime facilities of a traditional game engine.