Abstract
The primary motivation for enterprises to adopt virtualization technologies is to create a more agile and dynamic IT infrastructure -- with server consolidation, high resource utilization, the ability to quickly add and adjust capacity on demand -- while lowering total cost of ownership and responding more effectively to changing business conditions. However, effective management of virtualized IT environments introduces new and unique requirements, such as dynamically resizing and migrating virtual machines (VMs) in response to changing application demands. Such capacity management methods should work in conjunction with the underlying resource management mechanisms. In general, resource multiplexing and scheduling among virtual machines is poorly understood. CPU scheduling for virtual machines, for instance, has largely been borrowed from the process scheduling research in operating systems. However, it is not clear whether a straight-forward port of process schedulers to VM schedulers would perform just as well. We use the open source Xen virtual machine monitor to perform a comparative evaluation of three different CPU schedulers for virtual machines. We analyze the impact of the choice of scheduler and its parameters on application performance, and discuss challenges in estimating the application resource requirements in virtualized environments.
- Credit Scheduler, http://wiki.xensource.com/xenwiki/CreditScheduler.Google Scholar
- HP-UX Workload Manager, http://www.hp.com/products1/unix/operating/wlm/.Google Scholar
- Httperf. http://www.hpl.hp.com/research/linux/httperf/. Last accessed 1/17/2006.Google Scholar
- IBM Enterprise Workload Manager, http://www.ibm.com/developerworks/autonomic/ewlm/.Google Scholar
- Iperf: The TCP/UDP Bandwidth Measurement Tool. http://dast.nlanr.net/Projects/Iperf.Google Scholar
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the 19th ACM SOSP, 2003. Google ScholarDigital Library
- L. Cherkasova and R. Gardner Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor. In Proceedings of the Annual Technical Usenix Conference, 2005. Google ScholarDigital Library
- H. M. Deitel. Operating Systems. Addison-Wesley, 1990. Google ScholarDigital Library
- K. J. Duda and D. R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. In Proceedings of the 17th ACM SOSP, 1999. Google ScholarDigital Library
- R. B. Essick. An event based fair share scheduler. In Proceedings of the Winter USENIX Conference, 1990.Google Scholar
- K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. Warfield, and M. Williamson. Reconstructing I/O. Technical report, 2004.Google Scholar
- T. Garfinkel and M. Rosenblum. When virtual is harder than real: Security challenges in virtual machine based computing environments. In Proceedings of the 10th HotOS, 2005. Google ScholarDigital Library
- P. Goyal, X. Guo, and H. M. Vin. A hierarchial cpu scheduler for multimedia operating systems. In OSDI '96: Proceedings of the second USENIX symposium on Operating systems design and implementation, pages 107--121, New York, NY, USA, 1996. ACM Press. Google ScholarDigital Library
- D. Gupta, L. Cherkasova, R. Gardner, and A. Vahdat. Enforcing Performance Isolation Across Virtual Machines in Xen. In Proceedings of the 7th International Middleware Conference, 2006. Google ScholarDigital Library
- D. Gupta, R. Gardner, and L. Cherkasova. XenMon: QoS Monitoring and Performance Profiling Tool. Technical report, HPL-2005-187, 2005.Google Scholar
- J. L. Hellerstein. Achieving Service Rate Objectives with Decay Usage Scheduling. In IEEE Transactions on Software Engineering, 1993. Google ScholarDigital Library
- G. J. Henry. The fair share scheduler. AT&T Bell Labs Technical Journal, 63(8):1945--1957, 1984.Google Scholar
- J. Kay and P. Lauder. A fair share scheduler. Commun. ACM, 31(1):44--55, 1988. Google ScholarDigital Library
- S. J. Leffler, M. K. McKusick, and M. J. Karels. The Design and Implementation of the 4.3 BSD Unix Operating System. Addison-Wesley, 1988.Google ScholarDigital Library
- I. M. Leslie, D. Mcauley, R. Black, T. Roscoe, P. T. Barham, D. Evers, R. Fairbairns, and E. Hyden. The Design and Implementation of an Operating System to Support Distributed Multimedia Applications. IEEE Journal of Selected Areas in Communications, 1996. Google ScholarDigital Library
- J. Nieh and M. S. Lam. A smart scheduler for multimedia applications. ACM Trans. Comput. Syst., 21(2):117--163, 2003. Google ScholarDigital Library
- I. Pratt. Xen Roadmap. http://wiki.xensource.com/xenwiki/XenRoadMap.Google Scholar
- I. Stoica, H. Abdel-Wahab, K. Jeffay, S. K. Baruah, J. E. Gehrke, and C. G. Plaxton. A proportional share resource allocation algorithm for real-time, time-shared systems. In RTSS '96: Proceedings of the 17th IEEE Real-Time Systems Symposium (RTSS '96), page 288, Washington, DC, USA, 1996. IEEE Computer Society. Google ScholarDigital Library
- C. A. Waldspurger. Lottery and stride scheduling: Flexible proportional-share resource management. Technical report, Cambridge, MA, USA, 1995. Google ScholarDigital Library
Index Terms
- Comparison of the three CPU schedulers in Xen
Recommendations
Xen and the art of virtualization
SOSP '03Numerous systems have been designed which use virtualization to subdivide the ample resources of a modern computer. Some require specialized hardware, or cannot support commodity operating systems. Some target 100% binary compatibility at the expense of ...
Xen and the art of virtualization
SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principlesNumerous systems have been designed which use virtualization to subdivide the ample resources of a modern computer. Some require specialized hardware, or cannot support commodity operating systems. Some target 100% binary compatibility at the expense of ...
Xen and Co.: Communication-Aware CPU Management in Consolidated Xen-Based Hosting Platforms
Recent advances in software and architectural support for server virtualization have created interest in using this technology in the design of consolidated hosting platforms. Since virtualization enables easier and faster application migration as well ...
Comments