Tele-immersive systems

In this paper we will describe how we establish an experimental framework of tele-immersive system based on the polyhedral visual hull algorithm. The system is divided into two sites: the local and the remote sites. At the local site, images of a participant are taken from a set of synchronized cameras. A polyhedral visual hull algorithm is then used to reconstruct the 3D mesh. The texture information together with the mesh model is then sent to the remote site for rendering on immersive walls. We will describe each of the system components, including segmentation, post-process filtering, visual hull reconstruction at the local site; view dependent texture mapping at the remote site. We will present some preliminary results and observations we make during initial investigations, and propose possible future work that will add further functionalities to the system.