Development of a simple free viewpoint video system

Author

Jo, Seokhwan ; Lee, Dohyun ; Kim, Yoonseob ; Yoo, Chang D.

Author_Institution

Div. of EE, KAIST, Daejeon

fYear

2008

fDate

June 23 2008-April 26 2008

Firstpage

1577

Lastpage

1580

Abstract

A simple free viewpoint video system which is able not only to display user-specified views at arbitrary angle but also to efficiently stream the necessary video over a network is described. Virtual view synthesis based on projection theory was implemented to obtain intermediate views between multiple cameras. The depth information, which is required for the virtual view synthesis, was obtained using the segmentation-based stereo matching algorithm. For realtime rendering, our system was optimized using single instructions, multiple data (SIMD) technology. For efficient streaming, a novel method of combining the video with the depth information is proposed.

Keywords

image matching; rendering (computer graphics); stereo image processing; video signal processing; projection theory; realtime rendering; segmentation-based stereo matching; single instructions, multiple data technology; video system; virtual view synthesis; Bandwidth; Cameras; Decoding; Image segmentation; Layout; Network synthesis; Rendering (computer graphics); Stereo image processing; Streaming media; Three dimensional displays; SIMD; VLC; free viewpoint video; stereo matching; view synthesis;

fLanguage

English

Publisher

ieee

Conference_Titel

Multimedia and Expo, 2008 IEEE International Conference on

Conference_Location

Hannover

Print_ISBN

978-1-4244-2570-9

Electronic_ISBN

978-1-4244-2571-6

Type

conf

DOI

10.1109/ICME.2008.4607750

Filename

4607750