Adaptive temporal filter for high frame-rate video

Conventionally, generation methods for the input sequences of a video encoder have been independent from its following encoding process. In other words, such generation method has not been designed in terms of improving coding efficiency, although encoder optimization and pre-filter design have been studied in order to improve coding efficiency. However, it is prospective that we can improve coding efficiency furthermore by designing the generation method based on encoder design. In this study, we propose an algorithm for generating sequences using frames sampled in the temporal high density. Over the past decade, video acquisition rates, which had been 24 Hz (cinema), 30-60 Hz (webcam) or 50-60 Hz (SD/HDcam), has broken through to reach 1000 Hz. The proposed algorithm designs an adaptive temporal down-sampling filter in terms of the reduction of inter-frame prediction error, subject to prevent from the jerki-ness caused by temporal down-sampling. Experimental results show that our approach can reduce the inter-frame prediction error on average by 0.23 [dB] compared to constant mean filter without degrading its subjective image quality.