Title :
Study of scalable declustering algorithms for parallel grid files
Author :
Moon, Bongki ; Acharya, Anurag ; Saltz, Joel
Author_Institution :
Dept. of Comput. Sci., Maryland Univ., College Park, MD, USA
Abstract :
The efficient storage and retrieval of large multidimensional datasets is an important concern for large-scale scientific computations, such as long-running time-dependent simulations which periodically generate snapshots of the state. The main challenge for efficiently handling such datasets is to minimize response time for multidimensional range queries. The grid file is one of the well known access methods for multidimensional and spatial data. We investigate effective and scalable declustering techniques for grid files with the primary goal of minimizing response time and the secondary goal of maximizing the fairness of data distribution. The main contributions of this paper are (1) the analytic and experimental evaluation of existing index-based declustering techniques and their extensions for grid files; and (2) the development of a proximity-based declustering algorithm called `minimax´, which is experimentally shown to scale and to consistently achieve better response time compared to available algorithms while maintaining perfect disk distribution
Keywords :
distributed databases; distributed memory systems; file organisation; indexing; minimax techniques; minimisation; parallel algorithms; query processing; spatial data structures; very large databases; access methods; data distribution fairness maximization; data retrieval; data storage; index-based declustering techniques; large-scale scientific computations; long-running time-dependent simulations; minimax; multidimensional datasets; multidimensional range queries; parallel grid files; perfect disk distribution; periodic state snapshots; proximity-based declustering algorithm; response time minimization; scalable declustering algorithms; spatial data; Algorithm design and analysis; Computational modeling; Computer science; Contracts; Delay; Delta modulation; Educational institutions; Information retrieval; Large-scale systems; Minimax techniques; Moon; Multidimensional systems; Tree data structures;
Conference_Titel :
Parallel Processing Symposium, 1996., Proceedings of IPPS '96, The 10th International
Conference_Location :
Honolulu, HI
Print_ISBN :
0-8186-7255-2
DOI :
10.1109/IPPS.1996.508092