• DocumentCode
    501823
  • Title

    Query Optimization over Distributed Data Stream

  • Author

    Wang, Shuang ; Tan, Zhenhua ; Gao, Xiaoxing

  • Author_Institution
    Software Coll., Northeastern Univ., Shenyang, China
  • Volume
    2
  • fYear
    2009
  • fDate
    12-14 Aug. 2009
  • Firstpage
    415
  • Lastpage
    418
  • Abstract
    Recent research efforts in the fields of data stream processing show the increasing importance of processing data streams, e.g., in the e-science domain. Together with the advent of peer-to-peer (P2P) networks and grid computing, this leads to the necessity of developing new techniques for distributing and processing continuous queries over data streams in such networks. These systems often have to process multiple similar but different continuous aggregation queries simultaneously. Since executing each query separately can lead to significant scalability and performance problems, it is vital to share resources by exploiting similarities in the queries. The challenge is to identify overlapping computations that may not be obvious in the queries themselves. In this paper, we propose a novel algorithmic solution for problem of finding the minimum number of queries in such a distributed-streams setting, in order to optimize the communicate cost across the network. The experiment result show that our approach gives us as much as magnitude performance improvement over the no-share settings.
  • Keywords
    grid computing; peer-to-peer computing; query processing; continuous aggregation queries; data stream processing; distributed data stream; grid computing; peer-to-peer networks; query optimization; Aggregates; Condition monitoring; Cost function; Network-on-a-chip; Query processing; Routing; Scalability; System performance; Telecommunication traffic; Wireless sensor networks; aggregation; data stream; distributed system; group by query; multi-query optimization;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Hybrid Intelligent Systems, 2009. HIS '09. Ninth International Conference on
  • Conference_Location
    Shenyang
  • Print_ISBN
    978-0-7695-3745-0
  • Type

    conf

  • DOI
    10.1109/HIS.2009.198
  • Filename
    5254496