• DocumentCode
    2506929
  • Title

    Evaluating window joins over unbounded streams

  • Author

    Kang, Jaewoo ; Naughton, Jeffery F. ; Viglas, Stratis D.

  • Author_Institution
    Dept. of Comput. Sci., Univ. of Wisconsin-Madison, Madison, WI, USA
  • fYear
    2003
  • fDate
    5-8 March 2003
  • Firstpage
    341
  • Lastpage
    352
  • Abstract
    We investigate algorithms for evaluating sliding window joins over pairs of unbounded streams. We introduce a unit-time-basis cost model to analyze the expected performance of these algorithms. Using this cost model, we propose strategies for maximizing the efficiency of processing joins in three scenarios. First, we consider the case where one stream is much faster than the other. We show that asymmetric combinations of join algorithms, (e.g., hash join on one input, nested-loops join on the other) can outperform symmetric join algorithm implementations. Second, we investigate the case where system resources are insufficient to keep up with the input streams. We show that we can maximize the number of join result tuples produced in this case by properly allocating computing resources across the two input streams. Finally, we investigate strategies for maximizing the number of result tuples produced when memory is limited, and show that proper memory allocation across the two input streams can result in significantly lower resource usage and/or more result tuples produced.
  • Keywords
    optimisation; query formulation; query processing; resource allocation; hash join; input stream; memory allocation; nested-loops join; sliding window join evaluation; symmetric join algorithm implementation; system resource; unbounded stream; unit-time-basis cost model; Data engineering;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Engineering, 2003. Proceedings. 19th International Conference on
  • Print_ISBN
    0-7803-7665-X
  • Type

    conf

  • DOI
    10.1109/ICDE.2003.1260804
  • Filename
    1260804