Layout-Conscious Optimization: Beyond Hybrid Row-Column Storage Model

Hybrid row-column storage model [1][4], a common database approach for both OLTP and OLAP, have attracted a lot of attention in the past few years. Previous works about hybrid row-column approach mainly focus on physical storage. In this paper, we propose the idea of Layout-Conscious Optimization(LCO), techniques that fully exploits possibilities and take advantages of hybrid row-column data layout in all layers of DBMS, e.g., physical storage, query processing as well as network transfer. We believe LCO offer new opportunities to improve the performance of DBMS. To demonstrate the power of LCO, we present the design of a row-column hybrid network transfer protocol for DBMS, which reduces data transfer by 75% while incurs little extra cost on CPU.