DocumentCode
659550
Title
Workload-aware aggregate maintenance in columnar in-memory databases
Author
Muller, Sebastian ; Butzmann, Lars ; Klauck, Stefan ; Plattner, Hasso
Author_Institution
Hasso Plattner Inst., Univ. of Potsdam, Potsdam, Germany
fYear
2013
fDate
6-9 Oct. 2013
Firstpage
62
Lastpage
69
Abstract
Database workloads generated by enterprise applications are comprised of short-running transactional as well as long-running analytical queries with resource-intensive aggregations. The expensive aggregate queries can be significantly accelerated by using materialized views. This speed-up, however, comes with the cost of materialized view maintenance which is necessary to guarantee consistency when the underlying data changes. While several view maintenance strategies are applicable in the context of an in-memory column store, their performance depends on various factors, most importantly the ratio between queries accessing the materialized view and queries altering the base data, called insert ratio. As a contribution in this paper, we propose algorithms that determine the best-performing view maintenance strategy based on the currently monitored factors. Using our novel materialized aggregate engine, we are able to switch between view maintenance strategies on demand. We have created cost models for the identified view maintenance strategies that determine at which insert ratio it is advisable to switch to another strategy. Our benchmarks in SanssouciDB reveal that for all identified workloads, switching between maintenance strategies is more beneficial than staying with a single strategy.
Keywords
business data processing; database management systems; query processing; transaction processing; SanssouciDB benchmarks; aggregate queries; base data; columnar in-memory databases; database workloads; enterprise applications; in-memory column store; insert ratio; long-running analytical queries; materialized aggregate engine; materialized view maintenance cost; resource-intensive query aggregation; short-running transactional queries; workload-aware aggregate maintenance; Aggregates; Benchmark testing; Cost function; Databases; Dictionaries; Maintenance engineering; Switches;
fLanguage
English
Publisher
ieee
Conference_Titel
Big Data, 2013 IEEE International Conference on
Conference_Location
Silicon Valley, CA
Type
conf
DOI
10.1109/BigData.2013.6691699
Filename
6691699
Link To Document