The research and design of SQL processing in a data-mining system based on MapReduce

Author

Zhang, Lei ; Li, Kaiping ; Wu, Bin

Author_Institution

Beijing Key Lab. of Intell. Telecommun. Software & Multimedia, Beijing Univ. of Posts & Telecommun., Beijing, China

fYear

2011

fDate

15-17 Sept. 2011

Firstpage

301

Lastpage

305

Abstract

SQL as a database language has been widely used in the modern society. Its function mainly focuses on the data processing, which can be used in data-mining. Due to the rapid growth of data, large-scale data processing is becoming a focal point of information techniques. Though we can still use SQL, but where to store the data and how to get the data efficiently, cost effectively, can be a tricky problem. Cloud computing emerges to solve the problem. It is mainly to deal with large-scale data processing. In this paper, we design a data-mining system which can directly deal with SQL processing based on Hadoop, a parallel store and computing platform. Then we will have a discussion about running time´s efficiencies.

Keywords

SQL; cloud computing; data mining; parallel processing; MapReduce; SQL processing; Structured Query Language; cloud computing; data mining system; database language; Algorithm design and analysis; Cloud computing; Data mining; Databases; Encyclopedias; Parallel algorithms; Cloud Computing; MapReduce; SQL; data-mining;

fLanguage

English

Publisher

ieee

Conference_Titel

Cloud Computing and Intelligence Systems (CCIS), 2011 IEEE International Conference on

Conference_Location

Beijing

Print_ISBN

978-1-61284-203-5

Type

conf

DOI

10.1109/CCIS.2011.6045079

Filename

6045079