Real time believable stereo and virtual view synthesis engine for autostereoscopic display

In this paper, an FPGA and VLSI oriented stereo and virtual view synthesis engine is designed for the autostereoscopic display in the distributed multimedia plays application. To acquire the believable rendering not only for the stereo but also for the distant virtual view synthesis, the DIBR and epipolar geometry are applied in the referenced depth and texture images. The homogeneous depth continuity is statistically analyzed and the corresponding texture is compensated for the hole filling. At the same time, the interpolation and extrapolation are also integrated for the holes which could not be filled where the disoccluded area is not available even in the referenced texture image, either. To meet the real time constraints, computation and memory access intensive modules are realized by hardware accelerating, and the processing is in raster scan pixel line stream rather than frame buffer bulk or macro block line. The simulation and implementation show that based on the correlation of depth in referenced images, the believable rendering is acquired in real time. For the 1920×1080 resolution, the maximum frame rate is 96 fps. This engine is an independent IP and could be integrated with other modules in 3D applications.