High resolution visible image completion of urban region using corresponding hyperspectral image

The 2014 data fusion contest organized by IGARSS 2014 has shown an example that dual images with quite different spatial resolutions may have quite different ground coverages. Specifically, due to the technology limit of optical sensor and the incomplete flight path, the high spatial resolution visible image used in the data fusion contest can only provide a sparse ground coverage. To fill the missing area in this visible image, a simple yet effective image completion method is introduced in this paper which consists of the following two steps: First, through performing patch matching on the hyperspectral image, the most common recurring offsets between patches in the known region and those in the missing region are estimated. Second, the pixels in the missing region is completed by fusing pixels of the shifted visible images (obtained using the above estimated offsets). Experimental results show that the proposed method performs much better than multiple general image completion methods for this data set.