Multiview sprite generation and coding

An algorithm to generate background sprite images from multiview image sequences is presented. A dynamic-programming algorithm, first proposed in Grammalidis and Strinzis (1998), using a multiview matching cost as well as pure geometrical constraints, is used to provide an estimate of the disparity field and to identify occluded areas. By combining motion, disparity and occlusion information a sprite image corresponding to the first (main) view at the first time instant is generated. Image pixels from other views that are occluded in the main view are also added to the sprite. The sprite coding method defined by MPEG-4 is extended for multiview image sequences, based on the generated sprite. Experimental results demonstrating the performance of the proposed technique and comparing it with methods using sprite generation from monoscopic sequences are presented.