A novel in-loop filter based on CLDT masking effect model for HEVC

HEVC is the current joint video coding standardization project of ITU-T Video Coding Experts Group and Moving Picture Experts Group. It includes deblocking filter (DF) and adaptive loop filter (ALF) after the deblocking filter. To improve the accuracy, the deblocking filter is modified with the parameter information of intra coded blocks in this paper. Considering that the masking effect of human visual system (HVS) will eliminate the visibility of the blocking artifacts, a combined luminance and directional-texture (CLDT) masking effect model-based DF is proposed. At last, a novel Wiener-based in-loop filter is proposed, which is applied to eliminate the quantization error using both pre-DF signal and post-DF signal. Experimental results show efficiency improvement and subjective quality improvement compared with HEVC test model 2 (HM2.0) anchor.