Towards a Common Benchmark Framework for Cloud Brokers

Cloud computing has attracted a lot of interest from both academia and industry because of the promise of cost-effectiveness. As a result, increasingly large numbers of cloud services have become available. This implies challenges in brokering between the cloud consumers and providers. To meet this demand, several cloud brokers have been introduced. Unfortunately, most of the cloud brokers cannot solve real life scenarios and cannot be evaluated in an unbiased manner because their evaluations are often academic and independent. This paper proposes a new benchmark to evaluate and compare cloud brokers. Our benchmark called Cloud Broker Challenge (CBC) describes the cloud providers, cloud consumers, and goals with five variety levels of complexities. CBC Benchmark is useful to the Cloud community for an unbiased evaluation and comparison of brokers and can potentially enable development of real-life cloud brokers.