Image fusion of high resolution LWIR and IITV sensors for pilotage

Infrared, image intensified and low light level CCD sensors have well recognized uses, capabilities and limitations. Several government and industry studies objectively evaluated the relative merits of these sensors as applied to day and night pilotage missions. These studies found that each sensor excelled under different conditions and environments. Most pilots preferred having at least two different types of sensors available, since they sometimes complement each other. The ultimate goal of image fusion is to provide an automated method integrating the various image information from different sensors to yield a high quality real time presentation. Ideally, such a composite should retain the essential information from each sensor while minimizing any artifacts or distortions, so that the end result is a seamless representation of reality. By putting together several technologies, image fusion offers an overall improved single image representation of thermal, visible and color, etc. Raytheon has developed image fusion algorithms for fusing high sensitivity/resolution sensors for both the long-wave infrared (LWIR) and the visible-near infrared (VNIR) spectral regions. The algorithms are implemented in real time processing hardware and have been demonstrated in various aircraft, including helicopters. The imagery from the two respective spectral bands is fused via digital image processing techniques so that the information content is optimized for a variety of daytime and nighttime scenes. Imagery from these demonstrations shows dramatic improvement in situational awareness for pilotage.