Vison-based auxiliary navigation method using augmented reality for unmanned aerial vehicles

A visual-based auxiliary navigation method using augmented reality is an immersive navigation interface with virtual navigation and decision-making information superimposed on the video of real environment. It can provide the operator with more information to behave proactively in order to forestall future problems, with less stress or effort, and to increase the successful rate of UAV missions. The components of the auxiliary navigation method using AR on UAVs are described in this paper. And a method of real-time displaying targets´ position with virtual information based on computer vision registration is researched. The real-time information is obtained by the transformation between three coordinate systems. An experimental verification bases on ARToolkit platform that is able to identify multiple markers and display real-time virtual information of targets´ distance and direction while generating auxiliary curves is also described.