DocumentCode :
1791553
Title :
Incremental window aggregates over array database
Author :
Li Jiang ; Kawashima, Hitoshi ; Tatebe, Osamu
Author_Institution :
Grad. Sch. of Syst. & Inf. Eng., Univ. of Tsukuba, Tsukuba, Japan
fYear :
2014
fDate :
27-30 Oct. 2014
Firstpage :
183
Lastpage :
188
Abstract :
We propose an efficient window aggregation method over multi-dimensional array data based on incremental computation. We improve several aggregations with different data structures exploited to achieve efficient computation: list for sum and avg, heap for max and min, and balanced binary search tree for percentile. We present time complexity analysis for the methods, and then evaluate performance with experiments in SciDB array database system with both synthetic and JRA55 meteorological dataset. Our analysis shows that performance improvement is proportional to the window size in the last dimension in theory, and the result of experiment is consistent with the analysis. In certain cases, it shows an acceleration factor more than 13 by the proposed method with percentile, while a factor over 28 with maximum.
Keywords :
computational complexity; database management systems; parallel processing; tree data structures; JRA55 meteorological dataset; SciDB array database system; acceleration factor; balanced binary search tree; data structures; heap; incremental computation; incremental window aggregates; list; multidimensional array data; time complexity analysis; window aggregation method; Aggregates; Arrays; Binary search trees; Computational efficiency; Sorting; Time complexity; Array Database; Incremental Computation; Multi-Dimensional Array; Window Aggregates;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Big Data (Big Data), 2014 IEEE International Conference on
Conference_Location :
Washington, DC
Type :
conf
DOI :
10.1109/BigData.2014.7004230
Filename :
7004230
Link To Document :
بازگشت