3D gestures on 2D screens for mobile games

In most currently available 3D mobile games, players are provided with pre-programmed 2D gestures for 3D interaction. We believe that user experience can be improved if game objects can be controlled in 3D. Common 3D manipulation techniques on 2D screens require mastery and multiple hands, and are more suited for CAD applications than games. This paper proposes a one-finger manipulation technique that enables a player to control 3D game objects by using a depth estimation technique. Experimental results show that the average completion time for a peg-in-hole task is less than 2 seconds.