Enhanced fast mode decision based on edge map and motion detail analysis for H.264/JVT

The video coding standard H.264/JVT uses intra prediction and multi-block motion estimation to improve rate-distortion (RD) performance. However, full RD cost calculation for all intra-prediction modes and exhaustive searches for optimal motion vectors for all block sizes increases the computational complexity considerably with the number of prediction modes allowed. Wc propose an enhanced fast intra-prediction mode selection strategy based on edge mapping and a novel block segmentation approach to fast inter-prediction mode selection based on notion detail analysis, bearing in mind the full utilization of the already-available intermediate calculation results. Simulation results show that the proposed algorithms can efficiently reduce computational cost by about 43.3% and 84.7% respectively while maintaining similar visual quality and bit rate.