skip to main content
10.1145/1851182.1851223acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Free Access

Helios: a hybrid electrical/optical switch architecture for modular data centers

Published:30 August 2010Publication History

ABSTRACT

The basic building block of ever larger data centers has shifted from a rack to a modular container with hundreds or even thousands of servers. Delivering scalable bandwidth among such containers is a challenge. A number of recent efforts promise full bisection bandwidth between all servers, though with significant cost, complexity, and power consumption. We present Helios, a hybrid electrical/optical switch architecture that can deliver significant reductions in the number of switching elements, cabling, cost, and power consumption relative to recently proposed data center network architectures. We explore architectural trade offs and challenges associated with realizing these benefits through the evaluation of a fully functional Helios prototype.

References

  1. M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity, Data Center Network Architecture. In ACM SIGCOMM '08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic Flow Scheduling for Data Center Networks. In NSDI '10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. T. E. Anderson, S. S. Owicki, J. B. Saxe, and C. P. Thacker. High-speed Switch Scheduling for Local-area Networks. ACM Trans. on Computer Systems (TOCS), 11(4):319--352, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. L. Aronson, B. Lemoff, L. Buckman, and D. Dolfi. Low-Cost Multimode WDM for Local Area Networks up to 10 Gb/s. IEEE Photonics Technology Letters, 10(10):1489--1491, 1998.Google ScholarGoogle ScholarCross RefCross Ref
  5. K. J. Barker, A. Benner, R. Hoare, A. Hoisie, A. K. Jones, D. K. Kerbyson, D. Li, R. Melhem, R. Rajamony, E. Schenfeld, S. Shao, C. Stunkel, and P. Walker. On the Feasibility of Optical Circuit Switching for High Performance Computing Systems. In SC '05. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. B. Canney. IBM Portable Modular Data Center Overview. http://www-05.ibm.com/se/news/events/datacenter/pdf/PMDC_Introducion_-_Brian_Canney.pdf, 2009.Google ScholarGoogle Scholar
  7. J. Edmonds. Paths, trees and flowers. Canadian Journal on Mathematics, pages 449--467, 1965.Google ScholarGoogle ScholarCross RefCross Ref
  8. N. Farrington, E. Rubow, and A. Vahdat. Data Center Switch Architecture in the Age of Merchant Silicon. In IEEE Hot Interconnects '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. VL2: A Scalable and Flexible Data Center Network. In ACM SIGCOMM '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: A High Performance, Server-Centric Network Architecture for Modular Data Centers. In ACM SIGCOMM '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: A Scalable and Fault-Tolerant Network Structure for Data Centers. In ACM SIGCOMM '08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. J. R. Hamilton. An Architecture for Modular Data Centers. In CIDR '07.Google ScholarGoogle Scholar
  13. S. Kandula, J. Padhye, and P. Bahl. Flyways To De-Congest Data Center Networks. In ACM Hotnets '09.Google ScholarGoogle Scholar
  14. I. Keslassy, S.-T. Chuang, K. Yu, D. Miller, M. Horowitz, O. Solgaard, and N. McKeown. Scaling Internet Routers Using Optics. In ACM SIGCOMM '03. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. A. V. Krishnamoorthy. The Intimate Integration of Photonics and Electronics. In Advances in Information Optics and Photonics. SPIE, 2008.Google ScholarGoogle Scholar
  16. L. Y. Lin, E. L. Goldstein, and R. W. Tkach. Free-Space Micromachined Optical Switches for Optical Networking. IEEE J. Selected Topics in Quantum Electronics, 5(1):4--9, 1999.Google ScholarGoogle ScholarCross RefCross Ref
  17. Y. Lu, M. Wang, B. Prabhakar, and F. Bonomi. ElephantTrap: A Low Cost Device for Identifying Large Flows. In IEEE Hot Interconnects '07. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. N. McKeown. The iSLIP Scheduling Algorithm for Input-Queued Switches. IEEE/ACM Trans. on Networking, 7(2):188--201, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. OpenFlow: Enabling Innovation in Campus Networks. ACM SIGCOMM CCR, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. P. Newman, G. Minshall, and T. Lyon. IP Switching-ATM under IP. IEEE/ACM Trans. on Networking, 6(2):117--129, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. R. F. Pierret. Semiconductor Device Fundamentals. Addison Wesley, 1996.Google ScholarGoogle Scholar
  22. K. Psounis, A. Ghosh, B. Prabhakar, and G. Wang. SIFT: A Simple Algorithm for Tracking Elephant Flows, and Taking Advantage of Power Laws. In 43rd Allerton Conference on Communication, Control and Computing, 2005.Google ScholarGoogle Scholar
  23. R. Ramaswami and K. Sivarajan. Optical Networks: a Practical Perspective. Morgan Kaufmann, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. M. F. Tung. An Introduction to MEMS Optical Switches. http://eng-2k-web.engineering.cornell.edu/engrc350/ingenuity/Tung_MF_issue_1.pdf, 2001.Google ScholarGoogle Scholar
  25. J. S. Turner. Terabit Burst Switching. J. of High Speed Networking, 8(1):3--16, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. D. Vantrease, R. Schreiber, M. Monchiero, M. McLaren, N. P. Jouppi, M. Fiorentino, A. Davis, N. Binkert, R. G. Beausoleil, and J. H. Ahn. Corona: System Implications of Emerging Nanophotonic Technology. In ISCA '08. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. K. V. Vishwanath, A. Greenberg, and D. A. Reed. Modular Data Centers: How to Design Them? In Proc. of the 1st ACM Workshop on Large-Scale System and Application Performance (LSAP), 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. G. Wang, D. G. Andersen, M. Kaminsky, M. Kozuch, T. S. E. Ng, K. Papagiannaki, M. Glick, and L. Mummert. Your Data Center Is a Router: The Case for Reconfigurable Optical Circuit Switched Paths. In ACM HotNets '09.Google ScholarGoogle Scholar
  29. H. Wu, G. Lu, D. Li, C. Guo, and Y. Zhang. MDCube: A High Performance Network Structure for Modular Data Center Interconnection. In ACM CoNEXT '09. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Arista 7148SX Switch. http://www.aristanetworks.com/en/7100_Series_SFPSwitches.Google ScholarGoogle Scholar
  31. Calient Networks. http://www.calient.net.Google ScholarGoogle Scholar
  32. Cisco Data Center Infrastructure 2.5 Design Guide. www.cisco.com/application/pdf/en/us/guest/netsol/ns107/c649/ccmigration_09186a008073377d.pdf.Google ScholarGoogle Scholar
  33. HP Performance Optimized Datacenter. ftp://ftp.hp.com/pub/c-products/servers/pod/north_america_pod_datasheet_041509.pdf.Google ScholarGoogle Scholar
  34. International Technology Roadmap for Semiconductors, 2007.Google ScholarGoogle Scholar
  35. SGI ICE Cube. http://www.sgi.com/pdfs/4160.pdf.Google ScholarGoogle Scholar
  36. Sun Modular Datacenter. http://www.sun.com/service/sunmd.Google ScholarGoogle Scholar
  37. Voltaire Vantage 8500 Switch. http://www.voltaire.com/Products/Ethernet/voltaire_vantage_8500..Google ScholarGoogle Scholar

Index Terms

  1. Helios: a hybrid electrical/optical switch architecture for modular data centers

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGCOMM '10: Proceedings of the ACM SIGCOMM 2010 conference
        August 2010
        500 pages
        ISBN:9781450302012
        DOI:10.1145/1851182
        • cover image ACM SIGCOMM Computer Communication Review
          ACM SIGCOMM Computer Communication Review  Volume 40, Issue 4
          SIGCOMM '10
          October 2010
          481 pages
          ISSN:0146-4833
          DOI:10.1145/1851275
          Issue’s Table of Contents

        Copyright © 2010 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 30 August 2010

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate554of3,547submissions,16%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader