Real-Time 3D Video Acquisition and Auto-Stereoscopic Display End-to-End Algorithm Based on Tiled Multi-projectors

In order to display the real-time 3D video with more stereoscopic vision, this paper presents a novel end-to-end auto-stereoscopic tiled-projection display algorithm including dual-view video streaming acquisition, compression, transmission, and visualization. On the server side, it gets 3D video captured by dual-camera or read from dual-view 3D video files. Then, the dual-view images are transcoded into MPEG-2 /H.264 data by the Intel Quick Sync Video engine, and distributed to all rendering clients through the real-time transport protocol. On the client side, a self-calibrated method based on a slope voting policy is designed to eliminate the dual-viewpoint perspective distortion. After performing the geometric calibration and luminance correction, the dual-view images are interleaved on the optical display screen with a two-dimensional projection resolution of 3584 × 1536 pixels. Experimental results have validated that the projection system can bring viewers much better glasses-free stereoscopic vision at above 21 × 2 frames per second.