Title :
Hadoop Based Data Processing Method and Its Application on Braille Identification
Author :
Li, Nian-feng ; Wang, Li-rong ; Zhang, Meng ; Zhang, Hua-xun
Author_Institution :
Coll. of Comput. Sci. & Technol., Changchun Univ., Changchun, China
Abstract :
It is not so efficient to store and manage massive data with traditional distributed database architecture. Hadoop, as an open source framework, is suitable for data distributed storage and management on a group of cheap machines. Based on the research of open source frameworks of Hadoop, a kind of massive data processing model based on Hadoop is provided in this paper, and its application on Braille identification is introduced. The paper also provides a test scheme for I/O performance of this data processing model under different numbers of data node and different copy coefficient and block size. The test results show that, the model provides high efficiency for large scale of data processing.
Keywords :
computer aided instruction; distributed databases; handicapped aids; public domain software; Braille identification; Hadoop; I/O performance; data distributed storage; data management; data processing method; distributed database architecture; open source framework; visually impaired student education; Cloud computing; Computational modeling; Computers; Data models; Data processing; Distributed databases; Educational institutions; Braille identification; Hadoop; data processing;
Conference_Titel :
Intelligent Networks and Intelligent Systems (ICINIS), 2012 Fifth International Conference on
Conference_Location :
Tianjin
Print_ISBN :
978-1-4673-3083-1
DOI :
10.1109/ICINIS.2012.79