Mobile augmented reality as a Chinese menu translator

Author

Arioputra, Dimas ; Chang Hong Lin

Author_Institution

Nat. Taiwan Univ. of Sci. & Technol., Taipei, Taiwan

fYear

2015

Firstpage

7

Lastpage

8

Abstract

This paper presents an application on mobile phones that translates Chinese menus into a 3D model of the menu and the name of the menu in English. The system runs on an android platform mobile phone. It uses image recognition to trace and register image markers (in this paper it is a Chinese word). Then, it processed the input into a pre-processed feature database of menu items using Features from Accelerated Segment Test (FAST) implemented by Vuforia Library. The system will check the database, and after the matching it will generate the 3D model of the food using the Unity 3D game engine. It is able to trace and render up to five 3D models of the dishes in realtime.

Keywords

augmented reality; image recognition; image registration; language translation; mobile computing; natural language processing; smart phones; solid modelling; 3D model; Android platform mobile phone; Chinese menu translator; English; FAST; Vuforia library; features from accelerated segment test; image marker registration; image recognition; mobile augmented reality; pre-processed feature database; unity 3D game engine; Augmented reality; Cameras; Mobile handsets; Real-time systems; Solid modeling; Streaming media; Three-dimensional displays;

fLanguage

English

Publisher

ieee

Conference_Titel

Consumer Electronics - Taiwan (ICCE-TW), 2015 IEEE International Conference on

Conference_Location

Taipei

Type

conf

DOI

10.1109/ICCE-TW.2015.7217035

Filename

7217035