DocumentCode :
1457378
Title :
Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum
Author :
Yasuma, Fumihito ; Mitsunaga, Tomoo ; Iso, Daisuke ; Nayar, Shree K.
Author_Institution :
Image Sensing Technol. Dept., Sony Corp., Tokyo, Japan
Volume :
19
Issue :
9
fYear :
2010
Firstpage :
2241
Lastpage :
2253
Abstract :
We propose the concept of a generalized assorted pixel (GAP) camera, which enables the user to capture a single image of a scene and, after the fact, control the tradeoff between spatial resolution, dynamic range and spectral detail. The GAP camera uses a complex array (or mosaic) of color filters. A major problem with using such an array is that the captured image is severely under-sampled for at least some of the filter types. This leads to reconstructed images with strong aliasing. We make four contributions in this paper: 1) we present a comprehensive optimization method to arrive at the spatial and spectral layout of the color filter array of a GAP camera. 2) We develop a novel algorithm for reconstructing the under-sampled channels of the image while minimizing aliasing artifacts. 3) We demonstrate how the user can capture a single image and then control the tradeoff of spatial resolution to generate a variety of images, including monochrome, high dynamic range (HDR) monochrome, RGB, HDR RGB, and multispectral images. 4) Finally, the performance of our GAP camera has been verified using extensive simulations that use multispectral images of real world scenes. A large database of these multispectral images has been made available at http://wwwl.cs.columbia.edu/ CAVE/projects/gap_camera/ for use by the research community.
Keywords :
filtering theory; image colour analysis; image resolution; image segmentation; image sensors; optimisation; color filter array; dynamic range; generalized assorted pixel camera; image reconstruction; optimization method; spatial resolution; spectral detail; under-sampled channels; Assorted pixels; color filter array; color reproduction; demosaicing; dynamic range; multispectral imaging; signal to noise ratio; skin detection; sub-micrometer pixels;
fLanguage :
English
Journal_Title :
Image Processing, IEEE Transactions on
Publisher :
ieee
ISSN :
1057-7149
Type :
jour
DOI :
10.1109/TIP.2010.2046811
Filename :
5439932
Link To Document :
بازگشت