Virtual Piano Design via Single-View Video Based on Multifinger Actions Recognition

As cameras become cheaper and gain popularity, vision-based input devices are highly desired and may now become a feasible solution. In this paper, a vision-based virtual piano mechanism is proposed. By tacking and analyzing the motion of the fingertips, the system can detect keystrokes and play the corresponding note on a seven-key virtual piano. Experimental results show the precision and efficiency of the proposed scheme.