Skip to main content
SpringerLink
Log in

Docker Cluster Management for the Cloud - Survey Results and Own Solution

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

Docker provides a good basis to run composite applications in the cloud, especially if those are not cloud-aware, or cloud-native. However, Docker concentrates on managing containers on one host, but SaaS providers need a container management solution for multiple hosts. Therefore, a number of tools emerged that claim to solve the problem. This paper classifies the solutions, maps them to requirements from a case study and identifies gaps and integration requirements. We close some of these gaps with our own integration components and tool enhancements, resulting in the currently most complete management suite.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Pahl, C.: Containerization and the PaaS Cloud. IEEE Cloud Comput., 24–31 (2015)

  2. Scheepers, M. J.: Virtualization and Containerization of Application Infrastructure: A Comparison. Presented at the 21st Twente Student Conference on IT , Twente The Netherlands June 23 (2014)

  3. Pahl, C., Lee, B.: Containers and clusters for edge cloud architectures-a technology review (2015)

  4. Ranjan, R.: The cloud interoperability challenge. IEEE Cloud comput. 1, 20–24 (2014)

    Article  Google Scholar 

  5. Rosen, R.: Linux containers and the future cloud. Linux J 2014, 3 (2014)

    Google Scholar 

  6. Kratzke, N.: Lightweight virtualization cluster how to overcome cloud vendor Lock-In. J. Comput. Commun. 2, 1–7 (2014)

    Article  Google Scholar 

  7. Rubens, P.: Docker No Longer the Only Container Game in Town, http://bit.ly/1IlkI0s (2015)

  8. Hecht, L.: How Open Source Communities Power Docker and the Container Ecosystem, http://bit.ly/1LSIoLW (2015)

  9. Turnbull, J.: The Docker Book: Containerization is the new virtualization James Turnbull (2014)

  10. Lewis, J., Fowler, M.: Microservices, http://bit.ly/1dI7ZJQ (2014)

  11. Papazoglou, M. P.: Service-Oriented Computing: Concepts, characteristics and directions. In: Web Information Systems Engineering (WISE 2003). 4Th Int. Conf. On. Pp. 3–12. IEEE (2003)

  12. Mietzner, R., Leymann, F., Papazoglou, M. P.: Defining Composite Configurable SaaS Application Packages Using SCA, variability descriptors and multi-tenancy patterns. In: ICIW 2008. IEEE (2008)

  13. Cockcroft, A.: State of the Art in Microservices. Presented at the DockerCon Europe 14 , Amsterdam Netherlands December 4 (2014)

  14. Evans, E.: Domain Driven Design: Tackling Complexity in the Heart of Software. Addison-Wesley, Boston (2003)

    Google Scholar 

  15. Binz, T., Breitenbücher, U., Kopp, O., Leymann, F.: TOSCA: Portable Automated Deployment and Management of Cloud Applications. In: Advanced Web Services. Pp. 527–549. Springer (2014)

  16. Roßbach, P.: Docker poster. Entwickler mag docker spez (2014)

  17. Docker Ecosystem Mindmap, http://bit.ly/1BjDgtW

  18. Peinl, R.: Docker ecosystem on Google Docs, http://bit.ly/1DJ0eS4

  19. Docker, Inc.: About, http://bit.ly/1OjEBLl

  20. Crane, C.: The Container Ecosystem Project, http://bit.ly/1RkyBTu

  21. Wallner, R.: A breakdown of layers and tools within the container and microservices ecosystem, http://bit.ly/21cttZN (2015)

  22. Williams, A.: The Docker & Container Ecosystem The New Stack (2015)

  23. Chauhan, M. A., Babar, M. A.: Migrating Service-Oriented System to Cloud Computing: an Experience Report. In: Cloud Computing (CLOUD) 2011, IEEE Int. Conf. On. Pp. 404–411. IEEE (2011)

  24. Coffey, J., White, L., Wilde, N., Simmons, S.: Locating Software Features in a SOA Composite Application. In: 8Th European Conf. on Web Services (ECOWS 2010). Pp. 99–106. IEEE (2010)

  25. Sefraoui, O., Aissaoui, M., Eleuldj, M.: Openstack: toward an open-source solution for cloud computing. Int. J. Comput. Appl. 55, 38–42 (2012)

    Google Scholar 

  26. Koukis, V.: Flexible Storage for HPC Clouds with Archipelago and Ceph. In: 8Th Workshop on Virtualization in High-Performance Cloud Computing. ACM (2013)

  27. Chadwick, D. W., Siu, K., Lee, C., Fouillat, Y., Germonville, D.: Adding federated identity management to openstack. J. Grid Comput 12, 3–27 (2014)

    Article  Google Scholar 

  28. Piraghaj, S. F., Dastjerdi, A. V., Calheiros, R. N., Buyya, R.: Efficient Virtual Machine Sizing for Hosting Containers as a Service. In: IEEE World Congress on Services. Pp. 31–38. IEEE (2015)

  29. Jain, R., Paul, S.: Network virtualization and software defined networking for cloud computing: a survey. Commun. Mag. IEEE 51, 24–31 (2013)

    Article  Google Scholar 

  30. Day, S.: Docker Registry V2 - A New Model for Image Distribution. In: Docker Con 2015. , San Francisco (2015)

  31. Hausenblas, M.: Docker Registries: the Good, the Bad & the Ugly, http://bit.ly/1OsrnIu

  32. Mills, K., Filliben, J., Dabrowski, C.: Comparing VM Placement Algorithms for On-Demand Clouds. In: 3Rd Int. Conf. on Cloud Computing Technology and Science (Cloudcom). Pp. 91–98. IEEE (2011)

  33. Verma, A., Pedrosa, L., Korupolu, M., Tune, D. O. E., Wilkes, J.: Large-Scale Cluster Management at Google with Borg. In: 10Th European Conference on Computer Systems. P. 18. ACM (2015)

  34. Schwarzkopf, M., Konwinski, A., Abd-El-Malek, M., Wilkes, J.: Omega: Flexible, Scalable Schedulers for Large Compute Clusters. In: 8Th ACM European Conf. on Computer Systems. Pp. 351–364. 1 (2013)

  35. Bucchiarone, A., Gnesi, S.: A Survey on Services Composition Languages and Models. In: Intl. Workshop on Web Services–Modeling and Testing (WS-Mate 2006). P. 51 (2006)

  36. Caballer, M., Blanquer, I., Moltó, G., de Alfonso, C.: Dynamic management of virtual infrastructures. J. Grid Comput 13, 53–70 (2015)

    Article  Google Scholar 

  37. Bachlechner, D., Siorpaes, K., Fensel, D., Toma, I.: Web Service Discovery-A Reality Check. In: 3Rd European Semantic Web Conference (2006)

  38. Vukojevic-Haupt, K., Haupt, F., Karastoyanova, D., Leymann, F.: Service Selection for On-demand Provisioned Services. In: 18Th Intl. Enterprise Distributed Object Computing Conference (EDOC’14). Pp. 120–127. IEEE (2014)

  39. Serebryany, I., Rhoads, M.: SmartStack: Service Discovery in the Cloud, http://bit.ly/1bRcjo2(2013)

  40. Swan, C.: ClusterHQ Launches Flocker to Facilitate Robust Stateful Docker Containers, http://bit.ly/1KH3zG3 (2014)

  41. Hall, S.: Five Storage Companies That Speak To Docker’s Next Wave, http://bit.ly/1VBHYzp (2015)

  42. Han, S.: Getting Started With the Docker RBD Volume Plugin, http://bit.ly/1RYVONi (2015)

  43. Lorido-Botran, T., Miguel-Alonso, J., Lozano, J. A.: A review of auto-scaling techniques for elastic applications in cloud environments. J. Grid Comput 12, 559–592 (2014)

    Article  Google Scholar 

  44. Costache, C., Machidon, O., Mladin, A., Sandu, F., Bocu, R.: Software-Defined Networking of Linux Containers. In: 13Th Roedunet Conference. IEEE (2014)

  45. Drutskoy, D., Keller, E., Rexford, J.: Scalable network virtualization in software-defined networks. IEEE Internet Comput. 17, 20–27 (2013)

    Article  Google Scholar 

  46. Rimal, B. P., Jukan, A., Katsaros, D., Goeleven, Y.: Architectural requirements for cloud computing systems: an enterprise cloud approach. J. Grid Comput 9, 3–26 (2011)

    Article  Google Scholar 

  47. Liu, H., Wee, S.: Web Server Farm in the Cloud: Performance Evaluation and Dynamic Architecture. In: Cloud Computing. Pp. 369–380. Springer (2009)

  48. Aceto, G., Botta, A., De Donato, W., Pescapè, A.: Cloud monitoring: a survey. Comput. Netw 57, 2093–2115 (2013)

    Article  Google Scholar 

  49. Ward, J. S., Barker, A.: Observing the clouds: a survey and taxonomy of cloud monitoring. J. Cloud Comput. Adv. Syst. Appl. 3, 40 (2014)

    Article  Google Scholar 

  50. Yegulalp, S.: Docker Datacenter promises end-to-end container control for enterprises, http://bit.ly/1QYXoK1 (2016)

  51. Polvi, A.: The Security-minded Container Engine by CoreOS: rkt Hits 1.0, http://bit.ly/1S3iyw5 (2016)

  52. Kratzke, N.: About Microservices, Containers and their Underestimated Impact on Network Performance. CLOUD Comput. 2015, 180 (2015)

    Google Scholar 

  53. Kazemier, A.: BalancerBattle, https://github.com/observing/balancerbattle

  54. Felter, W., Ferreira, A., Rajamony, R., Rubio, J.: An upyeard performance comparison of virtual machines and linux containers. Research Report RC25482, IBM Almaden (2014)

  55. Seo, K. -T., Hwang, H. -S., Moon, I. -Y., Kwon, O. -Y., Kim, B. -J.: Performance comparison analysis of linux container and virtual machine for building cloud. Adv. Sci. Technol. Lett. Netw. Commun 66, 105–107 (2014)

    Article  Google Scholar 

  56. Kabhal: Introduce multiple scaling strategies mesosphere/marathon Issue #1477, http://bit.ly/1QAETBl(2015)

  57. Lindner, M., Galán, F., Chapman, C., Clayman, S., Henriksson, D., Elmroth, E.: The Cloud Supply Chain: a Framework for Information, Monitoring, Accounting and Billing 2Nd Int. Conf. on Cloud Comp (2010)

  58. Sreelakshmi, S.: OpenContrail – Kubernetes Integration, http://bit.ly/1Q91Jun (2015)

  59. Peinl, R., Holzschuher, F.: The Docker Ecosystem Needs Consolidation. In: 5Th Intl. Conf. on Cloud Computing and Services Science (CLOSER 2015) 535-542 SCITEPRESS, Lisbon, Portugal (2015)

  60. Kazemi, S.: CRIU Support in Docker for Native Checkpoint and Restore. In: Linux Plumbers Conference 2015. , Seattle, Washington, USA (2015)

  61. Berman, L.: Are Diego and Docker Really Good Friends?, http://bit.ly/1WGpAW4 (2015)

  62. Dadgar, A.: Nomad, http://bit.ly/1MV4bYB (2015)

  63. Hashicorp: Nomad vs. Other Software, http://bit.ly/1OsqLCG (2015)

  64. Owens, K.: Building Cisco’s IoE PaaS with Mantl, http://bit.ly/1KFP9Ck (2015)

  65. Yegulalp, S.: Hypernetes unites Kubernetes, OpenStack for multitenant container management, http://bit.ly/1QvVrUS (2015)

  66. Crisp Research Open cloud alliance - openness as an imperative crisp research (2014)

  67. Kratzke, N.: A lightweight virtualization cluster reference architecture derived from open source PaaS platforms. Open J. Mob. Comput. Cloud Comput 1, 17–30 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Information Systems, Hof University, Alfons-Goppel-Platz 1, Hof, Germany

    René Peinl, Florian Holzschuher & Florian Pfitzer

Authors
  1. René Peinl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Florian Holzschuher
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Florian Pfitzer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to René Peinl.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peinl, R., Holzschuher, F. & Pfitzer, F. Docker Cluster Management for the Cloud - Survey Results and Own Solution. J Grid Computing 14, 265–282 (2016). https://doi.org/10.1007/s10723-016-9366-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-016-9366-y

Keywords

Search

Navigation