Title :
Enumeration System on HBase for Low-Latency
Author :
Hang Chen ; Kun Lu ; MingMing Sun ; ChangLong Li ; Hang Zhuang ; Xuehai Zhou
Author_Institution :
Comput. Sci. & Technol., Univ. of Sci. & Technol. of China, Hefei, China
Abstract :
HBase is a popular distributed Key/Value storage system based on the idea of BigTable. It is being used in many data-centers, such as Facebook and Twitter, for their portability and scalability. For the system, low-latency and large storage is expected when used in industry. However, it is time consuming when retrieving one column via another one. Many technologies were considered to solve the problem. One approach is to add secondary index for HBase such as h index, which achieves high performance in retrieving. Unfortunately, when one column is of limited kinds of data, secondary index cannot reduce storage consumption when accelerating the retrieval. In this paper, we present a novel design of HBase to reduce storage consumption as well as accelerating the retrieval in the above situation. We design an enumeration system for HBase and provide an interface to create enumeration for specific column in tables. Our performance evaluation reveals that it achieves 2.27x improvement in retrieval and 12x reduction in storage compared with non-enumeration in HBase.
Keywords :
computer centres; redundancy; storage management; BigTable; Facebook; HBase; Twitter; data-center portability; data-center scalability; enumeration system; hindex; key-value storage system; performance evaluation; storage consumption; Cities and towns; Correlation; Indexes; Memory; Redundancy; Scalability; Servers; HBase; enumeration system; low-latency; redundancy; secondary index;
Conference_Titel :
Cluster, Cloud and Grid Computing (CCGrid), 2015 15th IEEE/ACM International Symposium on
Conference_Location :
Shenzhen
DOI :
10.1109/CCGrid.2015.78