Distributed storage of network measurement data on HBase

Author

Haijie Ding ; Yuehui Jin ; Yidong Cui ; Tan Yang

Author_Institution

Beijing Key Lab. of Netwok & Switching Technol., Beijing Univ. of Posts & Telecommun., Beijing, China

fYear

2012

fDate

Oct. 30 2012-Nov. 1 2012

Firstpage

716

Lastpage

720

Abstract

As traditional network measurement systems store data in relational databases, the storage capacity and computing resource are limited, besides, the extendibility and elasticity are low. The centralized storage scheme will not meet the needs of big data analysis as the data is growing rapidly and continuously. In this paper, we adopt Hadoop and HBase-open source Cloud Computing Frameworks to store network measurement data of non-realtime and realtime applications. The distributed storage scheme is designed to meet the performance demands of storage capacity and computing resource for the mass data.

Keywords

cloud computing; parallel processing; storage management; HBase; HBase-open source cloud computing framework; Hadoop framework; computing resource; distributed storage scheme; network measurement data storage; network measurement systems; performance demands; relational databases; storage capacity; Cloud computing; Distributed databases; File systems; Memory; Probes; Scalability; Servers; Cloud computing; Distributed data storage; HBase; Hadoop; Network measurement;

fLanguage

English

Publisher

ieee

Conference_Titel

Cloud Computing and Intelligent Systems (CCIS), 2012 IEEE 2nd International Conference on

Conference_Location

Hangzhou

Print_ISBN

978-1-4673-1855-6

Type

conf

DOI

10.1109/CCIS.2012.6664268

Filename

6664268