Title :
Efficient index computation for array based structured data
Author :
Md Abu Hanif Shaikh; Mehnuma Tabassum Omar;K.M. Azharul Hasan
Author_Institution :
Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Bangladesh
Abstract :
Traditional computing techniques widely vary over large scale computing. Some techniques are useful for structured data while some other techniques are useful for non-structured data. To store and operation on the structured data, multidimensional array is widely used as basic data structure. But the performance of multidimensional array is very poor when the number of dimension is very high i.e. 32-dimension. Data scientist suggests linearization of dimensions for higher dimensional data. But linearized data are highly compute intensive for retrieving into original data format as well as operations are very expensive on that data. It suffers from the higher index computational cost and lower data locality. In this paper, we propose an index computation algorithm based on generalized two-dimensional structure. We showed that the accessing cost of array elements is higher for traditional multidimensional array over generalized two-dimensional representation. Though the most sequential access of main memory is itself very simple for any compiler yet experimental results showed a better performance. Both theoretical analysis and experiment are done to show its´ effectiveness of the proposed algorithm.
Keywords :
"Arrays","Indexing","Algorithm design and analysis","Big data","Computational efficiency","Parallel processing"
Conference_Titel :
Electrical Information and Communication Technology (EICT), 2015 2nd International Conference on
Print_ISBN :
978-1-4673-9256-3
DOI :
10.1109/EICT.2015.7391930