Enhancing user experience through physical interaction in handheld Augmented Reality

Augmented Reality superimposes imaginary virtual objects onto the real environment by tracking and registering features of objects in real time, which gives next level user experience. AR has been a field of research for years but with recent technologies, its application and availability has spread in various fields. But, there exists a break of illusion when a user tries to interact with the virtual object. With the inclusion of sensing devices, the possibilities of interaction with the virtual object in an AR environment are a great opportunity to face. Handheld devices of recent times such as mobile phones have all components that are required to implement Augmented Reality application. The paper includes the framework that allows for the creation of AR applications on handheld devices and provides solution to integrate tracking feature within AR environment in handheld devices is proposed to provide robust and continuous integration of the user gestures with virtual objects.