Spatio-Temporal Concealment in H.264/AVC Video Coding by 3-D Selective Extrapolation

In this contribution, we derive a spatio-temporal extrapolation method for 3-D signals. Lost areas in video signals caused by transmission errors in video communications are concealed by extrapolating the surrounding video signal into the missing area. The method is integrated into the H.264/AVC coder as concealment feature. By exploiting spatial and temporal correlations at the same time, it is possible to inherently compensate motion. Deviations in luminance occurring from frame to frame can be compensated, too. Since the spatio-temporal selective extrapolation method does not rely on motion vectors, the algorithm can be also easily applied to Intra concealment by additionally exploiting temporal correlations. Further, the frequency selective extrapolation shows especially convincing results in connection with flexible macroblock ordering (FMO) causing a chequerboard like loss pattern in case of transmission errors