skip to main content
10.1145/1555271.1555277acmconferencesArticle/Chapter ViewAbstractPublication PagesicacConference Proceedingsconference-collections
research-article

Elastic management of cluster-based services in the cloud

Published:19 June 2009Publication History

ABSTRACT

In this paper we analyze the deployment of generic clustered services on top of a virtualized infrastructure layer that combines a VM manager (the OpenNebula engine) and a cloud resource provider (Amazon EC2). The use of this virtualization layer between the service and the physical infrastructure extends the classical benefits of VM platforms to distributed infrastructures. Additionally, the integration of the cloud in this layer allows us to give additional capacity to the services using an external provider, thus complementing the local infrastructure without notice from the users or affecting the service workload. This flexible approach, which separates the resource provisioning from the service management, provides important benefits: elastic service capacity to adapt it to its dynamic workload; physical infrastructure partitioning to isolate it from other running services; and support for heterogeneous configurations tailored for each service class. The feasibility of the proposed approach is analyzed for two different clustered services: a classical computing cluster and a web server.

References

  1. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.Google ScholarGoogle Scholar
  2. A. Fox, S. D. Gribble, Y. Chawathe, E. A. Brewer, and P. Gauthier. Cluster-based scalable network services. SIGOPS Oper. Syst. Rev., 31(5):78--91, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. OpenNebula. http://opennebula.org.Google ScholarGoogle Scholar
  4. B. Sotomayor, R. Montero, I. Llorente, and I. Foster. Capacity Leasing in Cloud Systems using the OpenNebula Engine. In Workshop on Cloud Computing and its Applications (CCA08).Google ScholarGoogle Scholar
  5. Sun Grid Engine. http://gridengine.sunsource.net/.Google ScholarGoogle Scholar
  6. OpenVPN. http://openvpn.net.Google ScholarGoogle Scholar
  7. S. Garfinkel. An Evaluation of Amazon's Grid Computing Services: EC2, S3, and SQS. Technical Report TR-08-07, Center for Research on Computation and Society, Hardvard University, 2007.Google ScholarGoogle Scholar
  8. R. F. Van der Wijngaart and M. A. Frumkin. NAS Grid Benchmarks Version 1.0. Technical Report NAS-02-005, NASA Advanced Supercomputing (NAS), 2002.Google ScholarGoogle Scholar
  9. M. A. Frumkin and R. F. Van der Wijngaart. NAS Grid Benchmarks: A Tool for Grid Space Exploration. J. Cluster Computing, 5(3):247--255, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. E. Walker, J. Gardner, V. Litvin, and E. Turner. Creating personal adaptive clusters for managing scientific jobs in a distributed computing environment. In Proceedings of the IEEE Challenges of Large Applications in Distributed Environments, 2006.Google ScholarGoogle ScholarCross RefCross Ref
  11. I. Raicu, Y. Zhao, C. Dumitrescu, I. Foster, and M. Wilde. Falkon: a Fast and Light-weight tasK executiON farmework. In Proceedings of the IEEE/ACM SuperComputing, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. W. Emeneker, D. Jackson, J. Butikofer, and D. Stanzione. Dynamic Virtual Clustering with Xen and Moab. Lecture Notes in Computer Science, 2006.Google ScholarGoogle Scholar
  13. M. Rodriguez, D. Tapiador, J. Fontan, E. Huedo, R. Montero, and I. Llorente. Dynamic Provisioning of Virtual Clusters for Grid Computing. In Proceedings of the 3rd Workshop on Virtualization in High-Performance Cluster and Grid Computing (VHPC'08), in conjuction with EuroPar, 2008.Google ScholarGoogle Scholar
  14. T. Freeman and K. Keahey. Flying Low: Simple Leases with Workspace Pilot. In Proceedings of the EuroPar, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov. The Eucalyptus Open-source Cloud-computing System. In Proc. of Cloud Computing and Its Applications, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. BioTeam. Howto: Unicluster and Amazon EC2. Technical report, BioTeam Lab Summary, 2008.Google ScholarGoogle Scholar
  17. I. Llorente, R. Moreno-Vozmediano, and R. Montero. Cloud Computing for on-Demand Grid Resource Provisioning. In Advances in Parallel Computing, IOS Press (in press), 2009.Google ScholarGoogle Scholar
  18. J. Fronckowiak. Auto-Scaling Web Sites Using Amazon EC2 and Scalr. In Amazon EC2 Articles and Tutorials, 2008.Google ScholarGoogle Scholar

Index Terms

  1. Elastic management of cluster-based services in the cloud

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            ACDC '09: Proceedings of the 1st workshop on Automated control for datacenters and clouds
            June 2009
            64 pages
            ISBN:9781605585857
            DOI:10.1145/1555271

            Copyright © 2009 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 19 June 2009

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader