DocumentCode
3144202
Title
Monte Carlo query processing of uncertain multidimensional array data
Author
Ge, Tingjian ; Grabiner, David ; Zdonik, Stan
Author_Institution
Dept. of Comput. Sci., Univ. of Kentucky, Lexington, KY, USA
fYear
2011
fDate
11-16 April 2011
Firstpage
936
Lastpage
947
Abstract
Array database systems are architected for scientific and engineering applications. In these applications, the value of a cell is often imprecise and uncertain. There are at least two reasons that a Monte Carlo query processing algorithm is usually required for such uncertain data. Firstly, a probabilistic graphical model must often be used to model correlation, which requires a Monte Carlo inference algorithm for the operations in our database. Secondly, mathematical operators required by science and engineering domains are much more complex than those of SQL. State-of-the-art query processing uses Monte Carlo approximation. We give an example of using Markov Random Fields combined with an array´s chunking or tiling mechanism to model correlated data. We then propose solutions for two of the most challenging problems in this framework, namely the expensive array join operation, and the determination and optimization of stopping conditions of Monte Carlo query processing. Finally, we perform an extensive empirical study on a real world application.
Keywords
Markov processes; Monte Carlo methods; approximation theory; database management systems; mathematical operators; probability; query processing; Markov random fields; Monte Carlo approximation; Monte Carlo inference algorithm; Monte Carlo query processing algorithm; array chunking mechanism; array database systems; array tiling mechanism; mathematical operators; probabilistic graphical model; uncertain multidimensional array data; Arrays; Monte Carlo methods; Query processing; Semantics; Temperature distribution; Temperature sensors;
fLanguage
English
Publisher
ieee
Conference_Titel
Data Engineering (ICDE), 2011 IEEE 27th International Conference on
Conference_Location
Hannover
ISSN
1063-6382
Print_ISBN
978-1-4244-8959-6
Electronic_ISBN
1063-6382
Type
conf
DOI
10.1109/ICDE.2011.5767887
Filename
5767887
Link To Document