Title :
Mobile augmented reality as a Chinese menu translator
Author :
Arioputra, Dimas ; Chang Hong Lin
Author_Institution :
Nat. Taiwan Univ. of Sci. & Technol., Taipei, Taiwan
Abstract :
This paper presents an application on mobile phones that translates Chinese menus into a 3D model of the menu and the name of the menu in English. The system runs on an android platform mobile phone. It uses image recognition to trace and register image markers (in this paper it is a Chinese word). Then, it processed the input into a pre-processed feature database of menu items using Features from Accelerated Segment Test (FAST) implemented by Vuforia Library. The system will check the database, and after the matching it will generate the 3D model of the food using the Unity 3D game engine. It is able to trace and render up to five 3D models of the dishes in realtime.
Keywords :
augmented reality; image recognition; image registration; language translation; mobile computing; natural language processing; smart phones; solid modelling; 3D model; Android platform mobile phone; Chinese menu translator; English; FAST; Vuforia library; features from accelerated segment test; image marker registration; image recognition; mobile augmented reality; pre-processed feature database; unity 3D game engine; Augmented reality; Cameras; Mobile handsets; Real-time systems; Solid modeling; Streaming media; Three-dimensional displays;
Conference_Titel :
Consumer Electronics - Taiwan (ICCE-TW), 2015 IEEE International Conference on
Conference_Location :
Taipei
DOI :
10.1109/ICCE-TW.2015.7217035
