Luis Tomás
Johan Tordsson
ABSTRACT
Despite the potential given by the combination of multi-tenancy and virtualization, resource utilization in today's data centers is still low. We identify three key characteristics of cloud services and infrastructure as-a-service management practices: burstiness in service workloads, fluctuations in virtual machine resource usage over time, and virtual machines being limited to pre-defined sizes only. Based on these characteristics, we propose scheduling and admission control algorithms that incorporate resource overbooking to improve utilization. A combination of modeling, monitoring, and prediction techniques is used to avoid overpassing the total infrastructure capacity. A performance evaluation using a mixture of workload traces demonstrates the potential for significant improvements in resource utilization while still avoiding overpassing the total capacity.
- A. Ali-Eldin, J. Tordsson, and E. Elmroth. An adaptive hybrid elasticity controller for cloud infrastructures. In Proc. of Network Operations and Management Symposium (NOMS), pages 204--212. IEEE, 2012.Google Scholar
Cross Ref
- L. A. Barroso and U. Holzle. The case for energy-proportional computing. Computer, 40(12):33--37, 2007. Google ScholarDigital Library
- A. Beloglazov and R. Buyya. Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Transactions on Parallel and Distributed Systems, In press. Google ScholarDigital Library
- G. Birkenheuer, A. Brinkmann, and H. Karl. The gain of overbooking. In E. Frachtenberg and U. Schwiegelshohn, editors, Job Scheduling Strategies for Parallel Processing, volume 5798 of LNCS, pages 80--100. 2009. Google ScholarDigital Library
- D. Breitgand, Z. Dubitzky, A. Epstein, A. Glikson, and I. Shapira. Sla-aware resource over-commit in an iaas cloud. In Proc. of 8th Intl. Conference on Network and Service Management (CNSM), pages 73--81, 2012. Google ScholarDigital Library
- W. Cirne and F. Berman. A comprehensive model of the supercomputer workload. In Proc. of the Intl. Workshop on Workload Characterization, pages 140--148, 2001. Google ScholarDigital Library
- A. Corradi, M. Fanelli, and L. Foschini. VM Consolidation: a Real Case Based on OpenStack Cloud. Future Generation Computer Systems, In Press.Google Scholar
- M. Dobber, R. van der Mei, and G. Koole. A prediction method for job runtimes on shared processors: Survey, statistical analysis and new avenues. Performance Evaluation, 64(7-8):755--781, 2007. Google ScholarDigital Library
- R. Ghosh and V. K. Naik. Biting off safely more than you can chew: Predictive analytics for resource over-commit in iaas cloud. In Proc. of 5th Intl. Conference on Cloud Computing, pages 25--32, 2012. Google ScholarDigital Library
- D. Gmach, J. Rolia, and L. Cherkasova. Selling t-shirts and time shares in the cloud. In Proc. of Intl. Symposium on Cluster, Cloud and Grid Computing (CCGrid), pages 539--546, 2012. Google ScholarDigital Library
- R. Guerin, H. Ahmadi, and M. Naghshineh. Equivalent capacity and its application to bandwidth allocation in high-speed networks. Selected Areas in Communications, 9(7):968--981, 1991. Google ScholarDigital Library
- S. He, L. Guo, M. Ghanem, and Y. Guo. Improving resource utilisation in the cloud environment using multivariate probabilistic models. In Proc. of 5th Intl. Conference on Cloud Computing (CLOUD), pages 574--581, 2012. Google ScholarDigital Library
- H. Jin, X. Shi, W. Qiang, and D. Zou. An adaptive meta-scheduler for data intensive applications. Intl. Journal of Grid and Utility Computing, 1(1):32--37, 2005. Google ScholarDigital Library
- M. Kalantari and M. K. Akbari. Grid performance prediction using state-space model. Concurrency and Computation: Practice and Experience, 21(9):1109--1130, 2009. Google ScholarDigital Library
- Y. C. Lee and A. Y. Zomaya. Energy efficient utilization of resources in cloud computing systems. The Journal of Supercomputing, 60(2):268--280, 2012. Google ScholarDigital Library
- libvirt: The virtualization API. Web page at http://libvirt.org/, Visited 2013-03-13.Google Scholar
- LTTng Project. Linux Trace Toolkit - next generation. Web page at http://lttng.org/lttng2.0, Visited 2013-03-13.Google Scholar
- X. Meng, C. Isci, J. Kephart, L. Zhang, E. Bouillet, and D. Pendarakis. Efficient resource provisioning in compute clouds via VM multiplexing. In Proc. of the Intl. Conference on Autonomic Computing (ICAC), pages 11--20, 2010. Google ScholarDigital Library
- Nagios - The Industry Standard in IT infrastructure Monitoring. Web page at http://www.nagios.org/, Visited 2013-03-13.Google Scholar
- Page view statistics for Wikimedia projects. Web page at http://dumps.wikimedia.org/other/pagecounts-raw/, Visited 2013-03-13.Google Scholar
- C. Reiss, A. Tumanov, G. R. Ganger, R. H. Katz, and M. A. Kozuch. Towards understanding heterogeneous clouds at scale:Google trace analysis. Technical Report ISTC-CC-TR-12-101, Carnegie Mellon University, Pittsburgh, PA, USA, Apr. 2012. http://www.istc-cc.cmu.edu/publications/papers/2012/ISTC-CC-TR-12-101.pdf.Google Scholar
- J. Subramanian, S. Stidham, and C. J. Lautenbacher. Airline yield management with overbooking, cancellations, and no-shows. Transportation Science, 33(2):147--167, 1999. Google ScholarDigital Library
- A. Sulistio, K. H. Kim, and R. Buyya. Managing cancellations and no-shows of reservations with overbooking to increase resource revenue. In Proc. of 8th Intl. Symposium on Cluster Computing and the Grid (CCGrid), pages 267--276, 2008. Google ScholarDigital Library
- L. Tomás, A. Caminero, C. Carrión, and B. Caminero. Exponential Smoothing for Network-aware Meta-scheduler in Advance in Grids. In Proc. of the 6th Intl. Workshop on Scheduling and Resource Management on Parallel and Distributed Systems (SRMPDS), pages 323--330, 2010. Google ScholarDigital Library
- L. Tomás, A. C. Caminero, C. Carrión, and B. Caminero. Network-aware meta-scheduling in advance with autonomous self-tuning system. Future Generation Computer Systems, 27(5):486--497, 2011. Google ScholarDigital Library
- B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In ACM SIGOPS Operating Systems Design and Implementation (OSDI), pages 239--254. ACM, 2002. Google ScholarDigital Library
Index Terms
- Improving cloud infrastructure utilization through overbooking
Recommendations
Improving Utilization of Infrastructure Clouds
CCGRID '11: Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid ComputingA key advantage of infrastructure-as-a-service (IaaS) clouds is providing users on-demand access to resources. To provide on-demand access, however, cloud providers must either significantly overprovision their infrastructure (and pay a high price for ...
A taxonomic survey on load balancing in cloud
Cloud computing aims to provide seamless computing services to the millions of consumers across the world. Datacenter, the engine of cloud computing, hosts large scale computing resources (hardware and software) at the backend of cloud. In the recent ...
An efficient energy-aware approach for dynamic VM consolidation on cloud platforms
AbstractThe cloud computing environments rely heavily on virtualization that enables the physical hardware resources to be shared among cloud users by creating virtual machines (VMs). With an overloaded physical machine, the resource requests by virtual ...
Comments