• DocumentCode
    3777237
  • Title

    DBalancer: A tool for dynamic changing of workers number in storm

  • Author

    Zhida Zang;R.N. Rao

  • Author_Institution
    Distributed Computing Lab, Shanghai Jiaotong University, China
  • Volume
    1
  • fYear
    2015
  • Firstpage
    142
  • Lastpage
    145
  • Abstract
    The workers´ number of a specific topology is fixed once it starts in Storm. This causes unnecessary waste of resources when workload shrinks down. In this paper, we propose an approach called DBalancer to dynamically increase or decrease the number of workers according to statistics of real-time data rate. DBalancer consists of three components: (1) Collector is used to collect data information about whether or not there is data at each period, (2) Decision Maker is used to statistic data rate information and make decision to increase or decrease the number of workers, (3) Rebalancer is used to execute decision made by Decision Maker. By applying DBalancer, we observe obvious lower memory occupation when workload comes down.
  • Keywords
    "Storms","Real-time systems","Topology","Big data","Programming","Computational modeling","Algorithm design and analysis"
  • Publisher
    ieee
  • Conference_Titel
    Computer Science and Network Technology (ICCSNT), 2015 4th International Conference on
  • Type

    conf

  • DOI
    10.1109/ICCSNT.2015.7490724
  • Filename
    7490724