Optimization of H.264 encoder based on SSE2

In this paper, instruction level optimization by exploiting SSE2 instructions is proposed to speed up the time-critical modules in H.264 encoder. SSE2 instruction set to execute a large number of small-size native data type operations in parallel to improve the real-time multimedia data processing capability. The contributions of the paper are manifold: Firstly, the paper shows SSE2 instruction set. Secondly, we describe the complexity analysis and theory of H.264 key modules such as integer DCT, invert integer DCT and the sum of absolute transformed difference (SATD). Thirdly, the proposed approach is applied to H.264 video encoding and the experimental results show up to 13% speedup without degrading video quality, compared with results of the original encoder in H.264.