Title :
A Real Time Index Model for Big Data Based on DC-Tree
Author :
DanWei Chen ; Jun Zhuang
Author_Institution :
Inf. Security Lab., Nanjing Univ. of Posts & Telecommun., Nanjing, China
Abstract :
Due to the low efficiency and poor real-time performance of actual query in big data, this paper puts forward a new multidimensional big data real-time query mode which is based on a dynamic indexing structure and the corresponding real-time query and dynamic insertion algorithm. It utilizes the Z curve to reduce dimension of multidimensional data, adopt Bloom Filter realize discrete storage and parallel computing, Meanwhile it enhances the real-time performance of data by using dynamic indexing structure DC-Tree. The results of experimental show that the model not only improves the query efficiency of big data, but also improve the real-time effect of data.
Keywords :
Big Data; database indexing; parallel processing; query processing; storage management; tree data structures; very large databases; Big Data; DC-Tree; Z curve; bloom filter; discrete storage; dynamic indexing structure; multidimensional big data real-time query mode; parallel computing; query efficiency; real time index model; real-time dynamic insertion algorithm; Algorithm design and analysis; Data models; Heuristic algorithms; Indexing; Real-time systems; Bloom Filter; DC-Tree; Z curve; big data;
Conference_Titel :
Advanced Cloud and Big Data (CBD), 2013 International Conference on
Conference_Location :
Nanjing
Print_ISBN :
978-1-4799-3260-3