Pradeep Padala
Mustafa Uysal
Sharad Singhal
Kenneth Salem
ABSTRACT
Data centers are often under-utilized due to over-provisioning as well as time-varying resource demands of typical enterprise applications. One approach to increase resource utilization is to consolidate applications in a shared infrastructure using virtualization. Meeting application-level quality of service (QoS) goals becomes a challenge in a consolidated environment as application resource needs differ. Furthermore, for multi-tier applications, the amount of resources needed to achieve their QoS goals might be different at each tier and may also depend on availability of resources in other tiers. In this paper, we develop an adaptive resource control system that dynamically adjusts the resource shares to individual tiers in order to meet application-level QoS goals while achieving high resource utilization in the data center. Our control system is developed using classical control theory, and we used a black-box system modeling approach to overcome the absence of first principle models for complex enterprise applications and systems. To evaluate our controllers, we built a testbed simulating a virtual data center using Xen virtual machines. We experimented with two multi-tier applications in this virtual data center: a two-tier implementation of RUBiS, an online auction site, and a two-tier Java implementation of TPC-W. Our results indicate that the proposed control system is able to maintain high resource utilization and meets QoS goals in spite of varying resource demands from the applications.
- T. F. Abdelzaher, K. G. Shin, and N. Bhatti. Performance guarantees for web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, 13, 2002. Google Scholar
Digital Library
- C. Amza, A. Ch, A. L. Cox, S. Elnikety, R. Gil, K. Rajamani, E. Cecchet, and J. Marguerite. Specification and implementation of dynamic web site benchmarks. In Proceedings of WWC-5: IEEE 5th Annual Workshop on Workload Characterization, October 2002.Google ScholarCross Ref
- A. Andrzejak, M. Arlitt, and J. Rolia. Bounding the resource savings of utility computing models. Technical Report HPL-2002-339, Hewlett Packard LaboratoriesGoogle Scholar
- M. Aron, P. Druschel, and W. Zwaenepoel. Cluster reserves: a mechanism for resource management in cluster-based network servers. In Proceedings of the international conference on Measurement and modeling of computer systems(ACM SIGMETRICS), pages 90--101, 2000. Google ScholarDigital Library
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP), pages 164--177, October 2003. Google ScholarDigital Library
- H. W. Cain, R. Rajwar, M. Marden, and Mikko H. Lipasti. An architectural evaluation of java TPC-W. In HPCA, pages 229--240, 2001. Google ScholarDigital Library
- A. Chandra, W. Gong, and P. Shenoy. Dynamic resource allocation for shared data centers using online measurements. In Proceedings of the Eleventh IEEE/ACM International Workshop on Quality of Service (IWQoS). Google ScholarDigital Library
- J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP), October 2001. Google ScholarDigital Library
- Y. Diao, N. Gandhi, J. L. Hellerstein, S. Parekh, and D. M. Tilbury. Mimo control of an apache web server: Modeling and controller design. In Proceedings of American Control Conference (ACC), 2002.Google Scholar
- Y. Diao, J. L. Hellerstein, S. Parekh, R. Griffith, G. E. Kaiser, and D. Phung. A control theory foundation for self-managing computing systems. IEEE journal on selected areas in communications, 23(12):2213--2222, December 2005. Google ScholarDigital Library
- S. Elnikety, E. Nahum, J. Tracey, and W. Zwaenepoel. A method for transparent admission control and request scheduling in e-commerce web sites. In Proceedings of the 13th international conference on World Wide Web, 2004. Google ScholarDigital Library
- S. Graupner, J. Pruyne, and S. Singhal. Making the utility data center a power station for the enterprise grid. Technical Report HPL-2003-53, Hewlett Packard Laboratories, March 2003.Google Scholar
- J. L. Hellerstein. Designing in control engineering of computing systems. In Proceedings of American Control Conference, 2004.Google Scholar
- J. L. Hellerstein, Y. Diao, S. Parekh, and D. M. Tilbury. Feedback Control of Computing Systems. IEEE Press/Wiley Interscience, 2004. Google ScholarDigital Library
- M. B. Jones, D. Rosu, and M-C. Rosu. Cpu reservations and time constraints: efficient, predictable scheduling of independent activities. In Proceedings of the 16th ACM Symposium on Operating System Principles (SOSP), October 1997. Google ScholarDigital Library
- A. Kamra, V. Misra, and E. Nahum. Yaksha: A self-tuning controller for managing the performance of 3-tiered web sites. In Proceedings of the International Workshop on Quality of Service (IWQoS), June 2004.Google ScholarCross Ref
- C. Karamanolis, M. Karlsson, and X. Zhu. Designing controllable computer systems. In Proceedings of the USENIX Workshop on Hot Topics in Operating Systems, pages 49--54, June 2005. Google ScholarDigital Library
- M. Karlsson, C. Karamanolis, and X. Zhu. Triage: Performance isolation and differentiation for storage systems. In Proceedings of the 12th IEEE International Workshop on Quality of Service (IWQoS), 2004.Google ScholarCross Ref
- A. Karve, T. Kimbrel, G. Pacifici, M. Spreitzer, M. Steinder, M. Sviridenko, and A. Tantawi. Dynamic placement for clustered web applications. In Proceedings of the 15th International Conference on World Wide Web, pages 595--604, May 2006. Google ScholarDigital Library
- X. Liu, X. Zhu, S. Singhal, and M. Arlitt. Adaptive entitlement control of resource partitions on shared servers. In Proceedings of the 9th International Symposium on Integrated Network Management, May 2005.Google Scholar
- C. Lu, T. F. Abdelzaher, J. Stankovic, and S. Son. A feedback control approach for guaranteeing relative delays in web servers. In Proceedings of the IEEE Real-Time Technology and Applications Symposium, 2001. Google ScholarDigital Library
- Y. Lu, T. F. Abdelzaher, and A. Saxena. Design, implementation, and evaluation of differentiated caching serives. IEEE Transactions on Parallel and Distributed Systems, 15(5), May 2004. Google ScholarDigital Library
- J. Nieh and M. S. Lam. The design, implementation, and evaluation of smart: A scheduler for multimedia applications. In Proceedings of the 16th ACM Symposium on Operating System Principles (SOSP), October 1997. Google ScholarDigital Library
- J. Rolia, X. Zhu, M. Arlitt, and A. Andrzejak. Statistical service assurances for applications in utility grid environments. Performance Evaluation Journal, 58(2-3), November 2004. Google ScholarDigital Library
- K. Shen, H. Tang, T. Yang, and L. Chu. Integrated resource management for cluster-based internet services. ACM SIGOPS Operating Systems Review, 36(SI):225--238, 2002. Google ScholarDigital Library
- D. C. Steere, A. Goel, J. Gruenberg, D. McNamee, C. Pu, and J. Walpole. A feedback-driven proportion allocator for real-rate scheduling. In Proceedings of the 3rd Symposium on Operating Systems Design and Implementation (OSDI), February 1999. Google ScholarDigital Library
- B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Fifth symposium on operating systems design and implementation (OSDI), pages 239 -- 254, December 2002. Google ScholarDigital Library
- B. Urgaonkar, P. J. Shenoy, A. Chandra, and P. Goyal. Dynamic provisioning of multi-tier internet applications. In Proceedings of International Conference on Autonomic Computing (ICAC), pages 217--228, 2005. Google ScholarDigital Library
- C. A. Waldspurger and W. E. Weihl. Lottery scheduling: flexible proprotional-share aresource management. In Proceedings of the 1st Symposium on Operating Systems Design and Implementation (OSDI), November 1994. Google ScholarDigital Library
- Z. Wang, X. Zhu, and S. Singhal. Utilization and slo-based control for dynamic sizing of resource partitions. Technical Report HPL-2005-126R1, Hewlett Packard Laboratories, Feb 2005.Google ScholarDigital Library
- Y. Zhang, A. Bestavros, M. Guirguis, I. Matta, and R. West. Friendly virtual machines: leveraging a feedback-control model for application adaptation. In Michael Hind and Jan Vitek, editors, VEE, pages 2--12. ACM, 2005. Google ScholarDigital Library
- X. Zhu, Z. Wang, and S. Singhal. Utility driven workload management using nested control design. In Proceedings of American Control Conference (ACC), June 2006.Google Scholar
Index Terms
- Adaptive control of virtualized resources in utility computing environments
Recommendations
Adaptive control of virtualized resources in utility computing environments
EuroSys'07 Conference ProceedingsData centers are often under-utilized due to over-provisioning as well as time-varying resource demands of typical enterprise applications. One approach to increase resource utilization is to consolidate applications in a shared infrastructure using ...
Automated control of multiple virtualized resources
EuroSys '09: Proceedings of the 4th ACM European conference on Computer systemsVirtualized data centers enable sharing of resources among hosted applications. However, it is difficult to satisfy service-level objectives(SLOs) of applications on shared infrastructure, as application workloads and resource consumption patterns ...
Server consolidation with migration control for virtualized data centers
Virtualization has become a key technology for simplifying service management and reducing energy costs in data centers. One of the challenges faced by data centers is to decide when, how, and which virtual machines (VMs) have to be consolidated into a ...
Comments