Title :
Research on Database Massive Data Processing and Mining Method based on Hadoop Cloud Platform
Author :
Dan Wu ; Zhuorong Li ; Rongfang Bie ; Mingquan Zhou
Author_Institution :
Coll. of Inf. Sci. & Technol., Beijing Normal Univ. BNU, Beijing, China
Abstract :
Massive image processing technology requiresvery high for the processor and memory, which need to adopthigh performance processor and large capacity memory,because the traditional single or single core processing andordinary memory already can not satisfy the need of imageprocessing. In this paper, cloud computing function isintroduced to mass data processing system, and then throughthe Hadoop distributed computing function, combined withthe automatic distribution method of master slave node, thehigh speed data processing can be realized. Finally, comparedwith the Hadoop distributed processing algorithms and twokinds of traditional data processing algorithms, the dataprocessing speed of Hadoop distributed algorithms is fasterand its information capacity is also higher, it is a massive dataprocessing algorithm, which provides a new method for thestudy of large data, high capacity and high transmission ratedata treatment scheme.
Keywords :
cloud computing; data mining; database management systems; image processing; parallel processing; Hadoop cloud platform; Hadoop distributed computing function; cloud computing; data mining; database massive data processing; high performance processor; large capacity memory; massive image processing technology; single core processing; Algorithm design and analysis; Cloud computing; Computers; Data processing; Distributed databases; Hadoop; Cloud computing; Massive data; Large;
Conference_Titel :
Identification, Information and Knowledge in the Internet of Things (IIKI), 2014 International Conference on
DOI :
10.1109/IIKI.2014.71