Natural Scene Image Recognition by Fusing Weighted Colour Moments with Bag of Visual Patches on Spatial Pyramid Layout

The problem of object/scene image classification has gained increasing attention from many researchers in computer vision. In this paper we investigate a number of early fusion methods using a novel approach to combine image colour information and the bag of visual patches (BOP) for recognizing natural scene image categories. We propose keypoints density-based weighting method (KDW) for merging colour moments and the BOP on a spatial pyramid layout. We found that the density of keypoints located in each image sub-region at specific granularity has noticeable impacts on deciding the importance of colour moments on that image sub-region. We demonstrate the validity of our approach on a six categories dataset of natural scene images. Experimental results have proved the effectiveness of our proposed approach.