A proposal to correct depth perception of virtual objects by using tactile feedback

Mixed reality (MR) is a technique which can combine a virtual environment and a real environment without making users feel that anything is unnatural. We propose a method using a see-through head mounted display (STHMD) to improve the precision of depth perception using tactile feedback. The visual accuracy of depth perception was measured when virtual objects were displayed through a STHMD. Subjects perceived the real objects to be closer to them than the virtual objects. The reason for this may be due to the optical characteristics of the HMD. We then manipulated our fingers while watching virtual objects through the STHMD. After decreasing the visual depth gap, we measured how accurately subjects moved their fingers to the exact location where the virtual objects appeared. From the results, it was found that there were depth gaps between our fingers and the virtual objects. Finally, vibratory tactile feedback was presented to the fingertip when the finger was near the virtual object. We measured how accurately subjects moved their fingers to the virtual objects. There was a range where subjects did not perceive the gap between their fingers and the virtual objects when tactile feedback was presented. The reason for this improvement was the integration between visual and tactile information. Accordingly, by controlling the degree of perceptual error through various tactile feedback, we assume that the precision of depth perception would improve. From the above results, we have proposed that using visual and tactile integration is one method that could solve the problem of inaccurate virtual objects´ depth perception