A Novel Approach to Communicate with Video Game Character using Cascade Classifiers

Today, video games have a special place among entertainment. In this work, we have developed an interactive video game for mobile devices. In this game, the user can control the game’s character by his face and hand gestures. Cascading classifiers along with the Haar-like features and local binary patterns are used for hand gesture recognition and face detection. The game’s character moves according to the current hand and face state received from the frontal camera. Various ideas are used to achieve the appropriate accuracy and speed. Unity 3D and OpenCV for Unity are employed in order to design and implement the video game. This game is written in C#, and developed for both the Windows and Android operating systems. The experiments show an accuracy of 86.4% in the detection of five gestures. It also has an acceptable frame rate, and can run at 11 fps and 8 fps in Windows and Android, respectively.