A single-chip 600-fps real-time action recognition system employing a hardware friendly algorithm

A real-time action recognition system has been developed. In order to achieve an efficient and compact system implementation, a hardware friendly algorithm has been explored and employed in building the system. The core functions of the system, namely the whole action recognition algorithm including the motion detection, motion feature vector generation, nearest neighbor search, are entirely realized on a single FPGA chip. Operating at 63 MHz, the system can process QVGA (320 × 240) videos at a speed of 600-fps. The robustness of the system is demonstrated by real environment experiments on gesture recognition.