Multi-view video super-resolution for hybrid cameras using modified NLM and adaptive thresholding

Dual-mode (hybrid) cameras are able to simultaneously shoot two types of video streams: a high resolution with low frame rate stream and similarly a low resolution with high frame rate stream. There are some works on super-resolving the single camera video sequences. In this paper we propose a method for multi-view video super-resolution, utilizing sequences generated from a hybrid camera. In the proposed method we exploit the self-similarity in the spatial and temporal domains to reconstruct a pixel. We modify the nonlocal means method to be applied in our method. Through a combination of techniques including adaptive thresholds and specialized candidate pixel selection schemes, the proposed method reconstructs a high fidelity video stream with considerably improved performance.