High-Speed Simultaneous Image Distortion Correction Transformations for a Multicamera Cylindrical Panorama Real-time Video System Using FPGA

Author

Yuan Xu ; Qinghai Zhou ; Liwei Gong ; Mingcheng Zhu ; Xiaohong Ding ; Teng, Robert K. F.

Author_Institution

Shenzhen Key Lab. of Adv. Commun. & Inf. Process., Shenzhen Univ., Shenzhen, China

Volume

24

Issue

6

fYear

2014

fDate

41791

Firstpage

1061

Lastpage

1069

Abstract

This paper presents a field-programmable gate array (FPGA) real-time multicamera cylindrical panorama video system. In this system, a novel simultaneous image transformation method has been studied (Chinese pattern pending No. 201310059020.1). Based on this method, perspective transformation, barrel correction, and cylindrical projection have been done at the same time for a multicamera system, resulting in an improvement of the overall performance. Using a low-cost parallel FPGA architecture, a high-speed real-time panoramic video system with low latency and high-performance has been developed. This video system can generate panoramic video of 5 × 1280(H) × 720(V)@15 frames/s or 5 × 1280(H) × 360(V)@30 frames/s in real-time on Xilinx Spartan6-150T FPGA. In order to display the panoramic video, a hardware display structure that can output the panoramic video in slide mode has also been constructed.

Keywords

aberrations; field programmable gate arrays; image segmentation; video cameras; Xilinx Spartan6-150T FPGA; barrel correction; cylindrical projection; field programmable gate array; image distortion correction transformations; multicamera cylindrical panorama real time video system; perspective transformation; slide mode; Cameras; Field programmable gate arrays; Lenses; Mathematical model; Optical distortion; Real-time systems; Streaming media; FPGA; Field-programmable gate array (FPGA); Image Mosaic; Multi-cameras; Omnidirectional Images; Panoramic Video System; Simultaneous Distortion Correction Transformations; image mosaic; multicameras; omnidirectional images; panoramic video system; simultaneous distortion correction transformations;

fLanguage

English

Journal_Title

Circuits and Systems for Video Technology, IEEE Transactions on

Publisher

ieee

ISSN

1051-8215

Type

jour

DOI

10.1109/TCSVT.2013.2290576

Filename

6662455