• DocumentCode
    3579715
  • Title

    Research on Database Massive Data Processing and Mining Method based on Hadoop Cloud Platform

  • Author

    Dan Wu ; Zhuorong Li ; Rongfang Bie ; Mingquan Zhou

  • Author_Institution
    Coll. of Inf. Sci. & Technol., Beijing Normal Univ. BNU, Beijing, China
  • fYear
    2014
  • Firstpage
    107
  • Lastpage
    110
  • Abstract
    Massive image processing technology requiresvery high for the processor and memory, which need to adopthigh performance processor and large capacity memory,because the traditional single or single core processing andordinary memory already can not satisfy the need of imageprocessing. In this paper, cloud computing function isintroduced to mass data processing system, and then throughthe Hadoop distributed computing function, combined withthe automatic distribution method of master slave node, thehigh speed data processing can be realized. Finally, comparedwith the Hadoop distributed processing algorithms and twokinds of traditional data processing algorithms, the dataprocessing speed of Hadoop distributed algorithms is fasterand its information capacity is also higher, it is a massive dataprocessing algorithm, which provides a new method for thestudy of large data, high capacity and high transmission ratedata treatment scheme.
  • Keywords
    cloud computing; data mining; database management systems; image processing; parallel processing; Hadoop cloud platform; Hadoop distributed computing function; cloud computing; data mining; database massive data processing; high performance processor; large capacity memory; massive image processing technology; single core processing; Algorithm design and analysis; Cloud computing; Computers; Data processing; Distributed databases; Hadoop; Cloud computing; Massive data; Large;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Identification, Information and Knowledge in the Internet of Things (IIKI), 2014 International Conference on
  • Type

    conf

  • DOI
    10.1109/IIKI.2014.71
  • Filename
    7064009