• DocumentCode
    1791580
  • Title

    Meeting predictable buffer limits in the parallel execution of event processing operators

  • Author

    Mayer, Ruben ; Koldehofe, Boris ; Rothermel, Kurt

  • Author_Institution
    Inst. for Parallel & Distrib. Syst., Univ. of Stuttgart, Stuttgart, Germany
  • fYear
    2014
  • fDate
    27-30 Oct. 2014
  • Firstpage
    402
  • Lastpage
    411
  • Abstract
    Complex Event Processing (CEP) systems enable applications to react to live-situations by detecting event patterns (complex events) in data streams. With the increasing number of data sources and the increasing volume at which data is produced, parallelization of event detection is becoming of tremendous importance to limit the time events need to be buffered before they actually can be processed by an event detector - named event processing operator. In this paper, we propose a pattern-sensitive partitioning model for data streams that is capable of achieving a high degree of parallelism for event patterns which formerly could only be consistently detected in a sequential manner or at a low parallelization degree. Moreover, we propose methods to dynamically adapt the parallelization degree to limit the buffering imposed on event detection in the presence of dynamic changes to the workload. Extensive evaluations of the system behavior show that the proposed partitioning model allows for a high degree of parallelism and that the proposed adaptation methods are able to meet the buffering level for event detection under high and dynamic workloads.
  • Keywords
    buffer storage; data handling; parallel processing; CEP systems; buffering; complex event processing systems; data sources; data streams; data volume; dynamic workloads; event detection parallelization; event patterns detection; event processing operators; parallel execution; parallelization degree; pattern-sensitive partitioning model; predictable buffer limits; system behavior; time events; Adaptation models; Corporate acquisitions; Correlation; Delays; Event detection; Middleware; Monitoring; Complex Event Processing; Data Parallelization; Quality of Service; Self-Adaptation; Stream Processing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Big Data (Big Data), 2014 IEEE International Conference on
  • Conference_Location
    Washington, DC
  • Type

    conf

  • DOI
    10.1109/BigData.2014.7004257
  • Filename
    7004257