DocumentCode :
118560
Title :
Chunking implementation of extendible array to handle address space overflow for large multidimensional data sets
Author :
Hasan, K. M. Azharul ; Omar, Mehnuma Tabassum ; Ahsan, Sk Md Masudul ; Nahar, Nazmun
Author_Institution :
Dept. of Comput. Sci. & Eng., Khulna Univ. of Eng. & Technol. (KUET), Khulna, Bangladesh
fYear :
2014
fDate :
13-15 Feb. 2014
Firstpage :
1
Lastpage :
6
Abstract :
Multidimensional array is commonly used in data warehouse or in many scientific computation of OLAP for dealing with application dataset. Different models of multidimensional array have been introduced to do this job like Traditional Multidimensional Array, Extendible array, Extended Karnaugh Map Representation etc. But Application that requires operation on large amount of data cannot be handled by these models. One common approach is to store data in chunked multidimensional arrays. Indices into an array are obtained by a normalization process that maps attribute values to integers. We have introduced an approach of storing huge amount of data contiguously in disk by applying the chunking approach to an extendible multidimensional array. This implemented approach is effective in managing memory than any other existing approach such as traditional multidimensional array. In our system data are stored in memory according to some predefined amount of memory space that will help the memory to store large amount of data through small unit of chunk where the size of chunk will never overflow the address space limit of a computer.
Keywords :
data handling; storage management; OLAP; address space overflow; application dataset; chunking approach; data storage; data warehouse; extended Karnaugh map representation; extendible array; memory management; multidimensional array; multidimensional data sets; normalization process; online analytical processing; traditional multidimensional array; Arrays; History; Memory management; Random access memory; Resource management; Vectors; Addressing Function; Array Chunking; Chunk Subscript; Extendible Array; Subarray;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Electrical Information and Communication Technology (EICT), 2013 International Conference on
Conference_Location :
Khulna
Print_ISBN :
978-1-4799-2297-0
Type :
conf
DOI :
10.1109/EICT.2014.6777871
Filename :
6777871
Link To Document :
بازگشت