ABSTRACT
Shipping-container-based data centers have been introduced as building blocks for constructing mega-data centers. However, it is a challenge on how to interconnect those containers together with reasonable cost and cabling complexity, due to the fact that a mega-data center can have hundreds or even thousands of containers and the aggregate bandwidth among containers can easily reach tera-bit per second. As a new inner-container server-centric network architecture, BCube [9] interconnects thousands of servers inside a container and provides high bandwidth support for typical traffic patterns. It naturally serves as a building block for mega-data center.
In this paper, we propose MDCube, a high performance interconnection structure to scale BCube-based containers to mega-data centers. MDCube uses the high-speed uplink interfaces of the commodity switches in BCube containers to build the inter-container structure, reducing the cabling complexity greatly. MDCube puts its inter- and inner-container routing intelligences solely into servers to handle load-balance and fault-tolerance, thus directly leverages commodity instead of high-end switches to scale. Through analysis, we prove that MDCube has low diameter and high capacity. Both simulations and experiments in our testbed demonstrate the fault-tolerance and high network capacity of MDCube.
- M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In Proc. SIGCOMM, 2008. Google ScholarDigital Library
- L. Barroso, J. Dean, and U. Hölzle. Web Search for a Planet: The Google Cluster Architecture. IEEE Micro, March-April 2003. Google ScholarDigital Library
- L. Bhuyan and D. Agrawal. Generalized Hypercube and Hyperbus Structures for a Computer Network. IEEE trans. Computers, April 1984. Google ScholarDigital Library
- D. Borthakur. The Hadoop Distributed File System: Architecture and Design. http://hadoop.apache.org/core/docs/current/hdfs design.pdf.Google Scholar
- CloudStore. Higher Performance Scalable Storage. http://kosmosfs.sourceforge.net/.Google Scholar
- J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI'04, 2004. Google ScholarDigital Library
- S. Ghemawat, H. Gobioff, and S. Leung. The Google File System. In ACM SOSP'03, 2003. Google ScholarDigital Library
- A. Greenberg, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, and S. Sengupta. VL2: A Scalable and Flexible Data Center Network. In Proc. SIGCOMM, 2009. Google ScholarDigital Library
- C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: A High Performance, Server-centric Network Architecture for Modular Data Centers. In Proc. SIGCOMM, 2009. Google ScholarDigital Library
- C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: A Scalable and Fault Tolerant Network Structure for Data Centers. In Proc. SIGCOMM, 2008. Google ScholarDigital Library
- IBM. Scalable Modular Data Center. http://www-935.ibm.com/services/us/its/pdf/smdc-eb-sfe03001-usen-00-022708.pdf.Google Scholar
- M. Isard, M. Budiu, and Y. Yu. Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. In ACM EuroSys, 2007. Google ScholarDigital Library
- Randy H. Katz. Tech Titans Building Boom, Feb. 2009.Google Scholar
- F. Leighton. Introduction to Parallel Algorithms and Architectures: Arrays. Trees. Hypercubes. Morgan Kaufmann, 1992. Google ScholarDigital Library
- Rackable Systems. Rackable Systems ICE Cube™ Modular Data Center. http://www.rackable.com/products/icecube.aspx.Google Scholar
- Verari Systems. The Verari FOREST Container Solution: The Answer to Consolidation. http://www.verari.com/forest spec.asp.Google Scholar
- M. Waldrop. Data Center in a Box. Scientific American, July 2007.Google ScholarCross Ref
Index Terms
- MDCube: a high performance network structure for modular data center interconnection
Recommendations
BCube: a high performance, server-centric network architecture for modular data centers
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communicationThis paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports ...
VL2: a scalable and flexible data center network
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communicationTo be agile and cost effective, data centers should allow dynamic resource allocation across large server pools. In particular, the data center network should enable any server to be assigned to any service. To meet these goals, we present VL2, a ...
BCube: a high performance, server-centric network architecture for modular data centers
SIGCOMM '09This paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports ...
Comments