Title :
Serving datacube tuples from main memory
Author :
Ross, Kenneth A. ; Zaman, Kazi A.
Author_Institution :
Columbia Univ., NY, USA
Abstract :
Existing datacube precomputation schemes materialize selected datacube tuples on disk, choosing the most beneficial cuboids (i.e., combinations of dimensions) to materialize given a space limit. However in the context of a data-warehouse receiving frequent “append” updates to the database, the cost of keeping these disk-resident cuboids up-to-date can be high. In this paper we propose a main memory based framework which provides rapid response to queries and requires considerably less maintenance cost than a disk based scheme in an append-only environment. For a given datacube query, we first look among a set of previously materialized tuples for a direct answer. If not found, we use a hash based scheme reminiscent of partial match retrieval to rapidly compute the answer to the query from the finest-level data stored in a special in-memory data structure. Our approach is limited to the important class of applications in which the finest granularity tuples of the datacube fit in main memory. We present analytical and experimental results demonstrating the benefits of our approach
Keywords :
data structures; data warehouses; file organisation; relational databases; data warehouse; datacube precomputation schemes; datacube tuples; disk based scheme; disk-resident cuboids; granularity tuples; hash based scheme; in-memory data structure; main memory; partial match retrieval; Aggregates; Cloud computing; Costs; Data engineering; Data structures; Databases; Greedy algorithms; Marketing and sales; Medical treatment; Random access memory;
Conference_Titel :
Scientific and Statistical Database Management, 2000. Proceedings. 12th International Conference on
Conference_Location :
Berlin
Print_ISBN :
0-7695-0686-0
DOI :
10.1109/SSDM.2000.869787