Skip to main content
SpringerLink
Log in

Cost-Effective Provisioning and Scheduling of Deadline-Constrained Applications in Hybrid Clouds

  • Conference paper
Book cover Web Information Systems Engineering - WISE 2012 (WISE 2012)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 7651))

Included in the following conference series:

Abstract

In order to meet distributed application deadlines, Resource Management Systems (RMSs) have to utilize additional resources from public Cloud providers when in-house resources cannot cope with the demand of the applications. As a means to enable this feature, called Cloud Bursting, the RMS has to be able to determine when, how many, and for how long such resources are required and provision them dynamically. The RMS has also to determine which tasks will be executed on them and in which order they will be submitted (scheduling). Current approaches for dynamic provisioning of Cloud resources operate at a per-job level, ignoring characteristics of the whole organization workload, which leads to inefficient utilization of Cloud resources. This paper presents an architecture for coordinated dynamic provisioning and scheduling that is able to cost-effectively complete applications within their deadlines by considering the whole organization workload at individual tasks level when making decisions and an accounting mechanism to determine the share of the cost of utilization of public Cloud resources to be assigned to each user. Experimental results show that the proposed strategy can reduce the total utilization of public Cloud services by up to 20% without any impact in the capacity of meeting application deadlines.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Buyya, R., Yeo, C.S., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems 25(6), 599–616 (2009)

    Article  Google Scholar 

  2. Gentzsch, W.: Sun Grid Engine: towards creating a compute power grid. In: Proceedings of the 1st International Symposium on Cluster Computing and the Grid (CCGrid 2001), Brisbane, Australia, pp. 35–36 (May 2001)

    Google Scholar 

  3. Vecchiola, C., Chu, X., Buyya, R.: Aneka: A software platform for .NET-based cloud computing. In: Gentzsch, W., Grandinetti, L., Joubert, G. (eds.) High Speed and Large Scale Scientific Computing, pp. 267–295. IOS Press, Amsterdam (2009)

    Google Scholar 

  4. Feitelson, D.G.: Scheduling parallel jobs on clusters. In: Buyya, R. (ed.) High Performance Cluster Computing, vol. 1. Prentice-Hall, Upper Saddle River (1999)

    Google Scholar 

  5. Braun, T.D., et al.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing 61(6), 810–837 (2001)

    Article  Google Scholar 

  6. Silva, D., Cirne, W., Brasileiro, F.: Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids. In: Kosch, H., Böszörményi, L., Hellwagner, H. (eds.) Euro-Par 2003. LNCS, vol. 2790, pp. 169–180. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  7. Cooper, K., et al.: New grid scheduling and rescheduling methods in the GrADS project. In: Proceedings of the 18th International Parallel and Distributed Processing Symposium (IPDPS 2004), Santa Fe, USA (April 2004)

    Google Scholar 

  8. Weng, C., Lu, X.: Heuristic scheduling for bag-of-tasks applications in combination with QoS in the computational grid. Future Generation Computer Systems 21(2), 271–280 (2005)

    Article  Google Scholar 

  9. Dong, F.: A taxonomy of task scheduling algorithms in the grid. Parallel Processing Letters 17(4), 439–454 (2007)

    Article  MathSciNet  Google Scholar 

  10. Salehi, M.A., Javadi, B., Buyya, R.: Resource provisioning based on lease preemption in InterGrid. In: Proceedings of the 34th Australasian Computer Science Conference (ACSC 2011), Perth, Australia (January 2011)

    Google Scholar 

  11. Assunção, M.D., di Costanzo, A., Buyya, R.: Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In: Proceedings of the 18th International Symposium on High Performance Distributed Computing (HPDC 2009), Munich, Germany, pp. 141–150 (2009)

    Google Scholar 

  12. Salehi, M., Buyya, R.: Adapting Market-Oriented Scheduling Policies for Cloud Computing. In: Hsu, C.-H., Yang, L.T., Park, J.H., Yeo, S.-S. (eds.) ICA3PP 2010, Part I. LNCS, vol. 6081, pp. 351–362. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  13. Moreno-Vozmediano, R., Montero, R.S., Llorente, I.M.: Multicloud deployment of computing clusters for loosely coupled MTC applications. IEEE Transactions on Parallel and Distributed Systems 22(6), 924–930 (2011)

    Article  Google Scholar 

  14. Lee, Y.C., Zomaya, A.: Rescheduling for reliable job completion with the support of clouds. Future Generation Computer Systems 26(8), 1192–1199 (2010)

    Article  Google Scholar 

  15. den Bossche, R.V., Vanmechelen, K., Broeckhove, J.: Cost-efficient scheduling heuristics for deadline constrained workloads on hybrid clouds. In: Proceedings of the 3rd IEEE International Conference on Cloud Computing Technology and Science (CloudCom 2011), Athens, Greece, pp. 320–327 (December 2011)

    Google Scholar 

  16. Vázquez, C., Huedo, E., Montero, R.S., Llorente, I.M.: Dynamic provision of computing resources from grid infrastructures and cloud providers. In: Proceedings of the Workshops at the Grid and Pervasive Computing Conference, Geneva, Switzerland, pp. 113–120 (May 2009)

    Google Scholar 

  17. Mateescu, G., Gentzsch, W., Ribbens, C.J.: Hybrid computing–where HPC meets grid and cloud computing. Future Generation Computer Systems 7(5), 440–453 (2011)

    Article  Google Scholar 

  18. Mao, M., Li, J., Humphrey, M.: Cloud auto-scaling with deadline and budget constraints. In: Proceedings of the 11th International Conference on Grid Computing (GRID 2010), Brussels, Belgium, pp. 41–48 (October 2010)

    Google Scholar 

  19. Calheiros, R.N., Vecchiola, C., Karunamoorthy, D., Buyya, R.: The Aneka platform and QoS-driven resource provisioning for elastic applications on hybrid clouds. Future Generation Computer Systems 28(6), 861–870 (2012)

    Article  Google Scholar 

  20. Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Transactions on Parallel and Distributed Systems 13(3), 260–274 (2002)

    Article  Google Scholar 

  21. Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software: Practice and Experience 41(1), 23–50 (2011)

    Article  Google Scholar 

  22. Iosup, A., Sonmez, O., Anoep, S., Epema, D.: The performance of bags-of-tasks in large-scale distributed systems. In: Proceedings of the 17th International Symposium on High Performance Distributed Computing (HPDC 2008), Boston, USA, pp. 97–108 (June 2008)

    Google Scholar 

  23. Garg, S.K., Yeo, C.S., Anandasivam, A., Buyya, R.: Environment-conscious scheduling of HPC applications on distributed cloud-oriented data centers. Journal of Parallel and Distributed Computing 71(6), 732–749 (2011)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Cloud Computing and Distributed Systems (CLOUDS) Laboratory, Department of Computing and Information Systems, The University of Melbourne, Australia

    Rodrigo N. Calheiros & Rajkumar Buyya

Authors
  1. Rodrigo N. Calheiros
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajkumar Buyya
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Science, Fudan University, 825 Zhangheng Rd., Shanghai, 201203, China

    X. Sean Wang

  2. Department of Computer Science, College of Engineering, Science and Engineering Offices, The University of Illinois at Chicago, 851 South Morgan Street (M/C 152), 60607-7053, Chicago, Illinois, USA

    Isabel Cruz

  3. Department of Informatics and Telecommunications, University of Athens, GR15784, Ilisia, Athens, Greece

    Alex Delis

  4. Centre for Applied Informatics, Victoria University, PO Box 14428, 8001, Melbourne, VIC, Australia

    Guangyan Huang

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Calheiros, R.N., Buyya, R. (2012). Cost-Effective Provisioning and Scheduling of Deadline-Constrained Applications in Hybrid Clouds. In: Wang, X.S., Cruz, I., Delis, A., Huang, G. (eds) Web Information Systems Engineering - WISE 2012. WISE 2012. Lecture Notes in Computer Science, vol 7651. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35063-4_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35063-4_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35062-7

  • Online ISBN: 978-3-642-35063-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation