Title :
Parallel Dynamic Skyline Query Using MapReduce
Author :
Yuanyuan Li ; Wenyu Qu ; Zhiyang Li ; Yujie Xu ; Changqing Ji ; Junfeng Wu
Author_Institution :
Coll. of Software Technol., Dailian Jiaotong Univ., Dalian, China
Abstract :
Dynamic skyline queries are useful in decision making and data-intensive applications. With the number of data increases, such skyline calculation is a challenging problem. Unfortunately, skyline query processing in centralized system is not suitable for the case. In this paper we propose a parallel algorithm which can calculate dynamic skylines with MapReduce. Firstly, we build an appropriate Inverted Grid Index structure. Secondly, the query point q is mapped to the matching cell of grid. We proposed a coarse-grained parallel algorithm for computing global skyline cells which can eliminate out the dominated cells with respect to q according to cell dominance relationship. The data points in global skyline cells can be as candidate set of dynamic skylines. It can reduce the cost of dynamic skyline by pruning out the data points in the dominated cells in advance. Finally, we check whether each point in the global skyline cells is dynamic skyline. Our experiments show that the efficiency of this mechanism compared to standard techniques without pruning.
Keywords :
decision making; grid computing; parallel algorithms; pattern matching; query processing; Inverted Grid Index structure; MapReduce; data points; data-intensive applications; decision making; grid matching cell; parallel algorithm; parallel dynamic skyline query processing; Algorithm design and analysis; Big data; Distributed databases; Heuristic algorithms; Indexes; Parallel algorithms; Partitioning algorithms; MapReduce; dynamic skyline; global skyline cell; grid;
Conference_Titel :
Cloud Computing and Big Data (CCBD), 2014 International Conference on
DOI :
10.1109/CCBD.2014.20