A novel gradient induced main subject segmentation algorithm for digital still cameras

When taking pictures, professional photographers employ a variety of composition rules. In automating these rules, it is often first necessary to detect and segment the main subject. We propose an detection and segmentation algorithm that leverages the optics in a digital still camera. Based on where the user points the camera, an autofocus filter first puts the main subject in focus and takes a picture. Then, we open the shutter aperture to diffuse light from objects that are out-of-focus, which blurs the background, and take a second picture. Using the second picture, the resulting difference in the frequency content of the main subject and the background image is then used by the proposed algorithm to detect and segment the main subject. The algorithm does not depend on prior knowledge of the indoor/outdoor setting or scene content. Algorithm complexity is similar to that of a 5×5 filter.