Motion field interpolation for temporal error concealment

When transmitted over practical communication channels, compressed video can suffer severe degradation. One approach to combat the effect of channel errors is error concealment. It is an attractive choice because it does not increase the bit rate, it does not require any modifications to the encoder, it does not introduce any delays and it can be applied in almost any application. Conventional temporal concealment techniques estimate one concealment displacement for the whole damaged block and then use translational displacement compensation to conceal the block from a reference frame. The main problem with such techniques is that incorrect estimation of the concealment displacement can lead to poor concealment of the whole or most of the block. Two novel temporal concealment techniques are presented. In the first technique, motion field interpolation is used to estimate one concealment displacement per pel of the damaged block and then each pel is concealed individually. In this case, incorrect estimation of a concealment displacement will only affect the corresponding pel. On a block level this may affect few pels rather than the entire block. In the second technique, multi-hypothesis motion compensation is used to combine the first technique with a boundary matching temporal concealment technique to obtain a more robust performance. Simulation results, within both an isolated error propagation environment and an H.263 codec, show the superior subjective and objective performance of the proposed techniques when compared with conventional temporal concealment techniques