• DocumentCode
    3144202
  • Title

    Monte Carlo query processing of uncertain multidimensional array data

  • Author

    Ge, Tingjian ; Grabiner, David ; Zdonik, Stan

  • Author_Institution
    Dept. of Comput. Sci., Univ. of Kentucky, Lexington, KY, USA
  • fYear
    2011
  • fDate
    11-16 April 2011
  • Firstpage
    936
  • Lastpage
    947
  • Abstract
    Array database systems are architected for scientific and engineering applications. In these applications, the value of a cell is often imprecise and uncertain. There are at least two reasons that a Monte Carlo query processing algorithm is usually required for such uncertain data. Firstly, a probabilistic graphical model must often be used to model correlation, which requires a Monte Carlo inference algorithm for the operations in our database. Secondly, mathematical operators required by science and engineering domains are much more complex than those of SQL. State-of-the-art query processing uses Monte Carlo approximation. We give an example of using Markov Random Fields combined with an array´s chunking or tiling mechanism to model correlated data. We then propose solutions for two of the most challenging problems in this framework, namely the expensive array join operation, and the determination and optimization of stopping conditions of Monte Carlo query processing. Finally, we perform an extensive empirical study on a real world application.
  • Keywords
    Markov processes; Monte Carlo methods; approximation theory; database management systems; mathematical operators; probability; query processing; Markov random fields; Monte Carlo approximation; Monte Carlo inference algorithm; Monte Carlo query processing algorithm; array chunking mechanism; array database systems; array tiling mechanism; mathematical operators; probabilistic graphical model; uncertain multidimensional array data; Arrays; Monte Carlo methods; Query processing; Semantics; Temperature distribution; Temperature sensors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Engineering (ICDE), 2011 IEEE 27th International Conference on
  • Conference_Location
    Hannover
  • ISSN
    1063-6382
  • Print_ISBN
    978-1-4244-8959-6
  • Electronic_ISBN
    1063-6382
  • Type

    conf

  • DOI
    10.1109/ICDE.2011.5767887
  • Filename
    5767887