Evaluation of 60 full-reference image quality metrics on the CID:IQ

Image quality metrics have become very popular and new metrics are proposed continuously. They have usually been developed with the goal of correlating with subjective image quality assessment. We perform an extensive evaluation of 60 state-of-the-art image quality metrics, including well-known metrics, such as SSIM, multiscale SSIM, VIF, MSE, S-DEE, CID, MAD, S-CIELAB, SHAME, VSNR, and PSNR. Evaluation is performed on the on the Colourlab Image Database: Image Quality (CID:IQ), a database consisting of 690 images where the subjective data has been collected at two different viewing distances. The performance of the image quality metrics is assessed in terms of correlation to subjective data.