• DocumentCode
    1442992
  • Title

    Flexible Depth of Field Photography

  • Author

    Kuthirummal, Sujit ; Nagahara, Hajime ; Zhou, Changyin ; Nayar, Shree K.

  • Author_Institution
    Sarnoff Corp., Princeton, NJ, USA
  • Volume
    33
  • Issue
    1
  • fYear
    2011
  • Firstpage
    58
  • Lastpage
    71
  • Abstract
    The range of scene depths that appear focused in an image is known as the depth of field (DOF). Conventional cameras are limited by a fundamental trade-off between depth of field and signal-to-noise ratio (SNR). For a dark scene, the aperture of the lens must be opened up to maintain SNR, which causes the DOF to reduce. Also, today´s cameras have DOFs that correspond to a single slab that is perpendicular to the optical axis. In this paper, we present an imaging system that enables one to control the DOF in new and powerful ways. Our approach is to vary the position and/or orientation of the image detector during the integration time of a single photograph. Even when the detector motion is very small (tens of microns), a large range of scene depths (several meters) is captured, both in and out of focus. Our prototype camera uses a micro-actuator to translate the detector along the optical axis during image integration. Using this device, we demonstrate four applications of flexible DOF. First, we describe extended DOF where a large depth range is captured with a very wide aperture (low noise) but with nearly depth-independent defocus blur. Deconvolving a captured image with a single blur kernel gives an image with extended DOF and high SNR. Next, we show the capture of images with discontinuous DOFs. For instance, near and far objects can be imaged with sharpness, while objects in between are severely blurred. Third, we show that our camera can capture images with tilted DOFs (Scheimpflug imaging) without tilting the image detector. Finally, we demonstrate how our camera can be used to realize nonplanar DOFs. We believe flexible DOF imaging can open a new creative dimension in photography and lead to new capabilities in scientific imaging, vision, and graphics.
  • Keywords
    cameras; deconvolution; image processing; image sensors; lenses; microactuators; optical images; photography; Scheimpflug imaging; aperture; camera; dark scene; deconvolution; depth-independent defocus blur; flexible DOF imaging; flexible depth of field; image detector; imaging system; lens; microactuator; photography; sharpness; signal-to-noise ratio; single blur kernel; Apertures; Cameras; Detectors; Focusing; Layout; Lenses; Optical imaging; Photography; Signal to noise ratio; Slabs; Imaging geometry; depth-independent defocus blur.; detector motion; programmable depth of field; Algorithms; Image Enhancement; Image Processing, Computer-Assisted; Lenses; Photography;
  • fLanguage
    English
  • Journal_Title
    Pattern Analysis and Machine Intelligence, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0162-8828
  • Type

    jour

  • DOI
    10.1109/TPAMI.2010.66
  • Filename
    5432211