skip to main content
research-article
Free Access

Exascale computing and big data

Published:25 June 2015Publication History
Skip Abstract Section

Abstract

Scientific discovery and engineering innovation requires unifying traditionally separated high-performance computing and big data analytics.

References

  1. Amarasinghe, S. et al. Exascale Software Study: Software Challenges in Extreme-Scale Systems. Defense Advanced Research Projects Agency, Arlington, VA, 2009; http://www.cs.rice.edu/~vs3/PDF/Sarkar-ACS-July-2011-v2.pdfGoogle ScholarGoogle Scholar
  2. American Association for the Advancement of Science. Guide to R&D Funding - Historical Data. AAAS, Washington, D.C., 2015; http://www.aaas.org/page/historical-trends-federal-rdGoogle ScholarGoogle Scholar
  3. Chang, F. et al. Bigtable: A distributed storage system for structured data. ACM Transactions on Computer Systems 26, 2 (June 2008), 4:1--4:26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Datta, K. et al. Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures. In Proceedings of the 2008 ACM/IEEE Conference on Supercomputing (Austin, TX, Nov. 15--21). IEEE Press, Piscataway, NJ, 2008, 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dennard, R.H., Gaensslen, F.H., Yu, H.-n., Rideout, V.L., Bassous, E., and LeBlanc, A.R. Design of ion-implanted MOSFETs with very small physical dimensions. IEEE Journal of Solid State Circuits 9, 5 (Jan. 1974), 256--268.Google ScholarGoogle ScholarCross RefCross Ref
  6. Dongarra, J.J. The LINPACK benchmark: An explanation. In Proceedings of the First International Conference on Supercomputing (Athens, Greece, June 8--12). Springer-Verlag, New York, 1988, 456--474. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dongarra, J.J. et al. The international exascale software project roadmap. International Journal of High Performance Computing Applications 25, 1 (Feb. 2011), 3--60. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Esmaeilzadeh, H., Blem, E., Amant, R.S., Sankaralingam, K., and Burger, D. Dark silicon and the end of multicore scaling. In Proceedings of the 38th Annual International Symposium on Computer Architecture (San Jose, CA, June 4--8). ACM, New York, 2011, 365--376. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Fuller, S.H. and Millett, L.I. Computing performance: Game over or next level? Computer 44, 1 (Jan. 2011), 31--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Geist, A. and Lucas, R. Major computer science challenges at exascale. International Journal of High Performance Applications 23, 4 (Nov. 2009), 427--436. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Gill, P., Jain, N., and Nagappan, N. Understanding network failures in data centers: Measurement, analysis, and implications. Proceedings of ACM SIGCOMM 41, 4 (Aug, 2011), 350--361. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Hey, T., Tansley, S., and Tolle, K. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, Redmond, WA, 2009; http://research.microsoft.com/en-us/UM/redmond/about/collaboration/fourthparadigm/4th_PARADIGM_BOOK_complete_HR.pdfGoogle ScholarGoogle Scholar
  13. Kamil, S., Shalf, J., and Strohmaier, E. Power efficiency in high-performance computing. In Proceedings of the Fourth Workshop on High-Performance, Power-Aware Computing (Miami, FL, Apr.). IEEE Press, 2008.Google ScholarGoogle ScholarCross RefCross Ref
  14. Kogge, P., Bergman, K., Borkar, S. et al. Exascale Computing Study: Technology Challenges in Achieving Exascale Systems. U.S. Defense Advanced Research Projects Agency, Arlington, VA, 2008; http://www.cse.nd.edu/Reports/2008/TR-2008-13.pdfGoogle ScholarGoogle Scholar
  15. Lucas, R., Ang, J., Bergman, K., Borkar, S. et al. Top Ten Exascale Research Challenges. Office of Science, U.S. Department of Energy, Washington, D.C., Feb. 2014; http://science.energy.gov/~/media/ascr/ascac/pdf/meetings/20140210/Top10reportFEB14.pdfGoogle ScholarGoogle Scholar
  16. Meuer, H., Strohmaier, E., Dongarra, J. and Simon, H. Top 500 Supercomputer Sites, 2015; http://www.top500.orgGoogle ScholarGoogle Scholar
  17. Nobelprize.org. Nobel Prize in Chemistry 2013; http://www.nobelprize.org/nobel_prizes/chemistry/laureates/2013/press.htmlGoogle ScholarGoogle Scholar
  18. Olston, C., Reed, B., Strivastava, U., Kumar, R., and Tomkins, A. Pig Latin: A not-so-foreign language for data processing. In Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data (Vancouver, BC, Canada, June 9-12). ACM Press, New York, 2008, 1099--1110. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Partnership for Advanced Computing in Europe (PRACE). 2014; http://www.prace-ri.eu/Google ScholarGoogle Scholar
  20. Pinheiro, E., Weber, W.-D., and Barroso, L.A. Failure trends in a large disk drive population. In Proceedings of the Fifth USENIX Conference on File and Storage Technologies (San Jose, CA, Feb. 13--16). USENIX Association, Berkeley, CA, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Schroeder, B. and Gibson, G.A. Understanding disk failure rates: What does an MTTF of 1,000,000 hours mean to you? ACM Transactions on Storage 3, 3 (Oct. 2007), 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Schroeder, B., Pinheiro, E., and Weber, W.-D. DRAM errors in the wild: A large-scale field study. In Proceedings of the 11th International Joint Conference on Measurement and Modeling of Computer Systems (Seattle, WA, June). ACM Press, New York, 2009, 193--204. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. U.S. Department of Energy. Synergistic Challenges in Data-Intensive Science and Exascale Computing. Report of the Advanced Scientific Computing Advisory Committee Subcommittee, Mar. 30, 2013; http://science.energy.gov/~/media/ascr/ascac/pdf/reports/2013/ASCAC_Data_Intensive_Computing_report_final.pdfGoogle ScholarGoogle Scholar
  24. U.S. Department of Energy. The Opportunities and Challenges of Exascale Computing. Office of Science, Washington, D.C., 2010; http://science.energy.gov/~/media/ascr/ascac/pdf/reports/Exascale_subcommittee_report.pdfGoogle ScholarGoogle Scholar
  25. White, T. Hadoop: The Definitive Guide. O'Reilly Media, May 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exascale computing and big data

                  Recommendations

                  Comments

                  Login options

                  Check if you have access through your login credentials or your institution to get full access on this article.

                  Sign in

                  Full Access

                  • Published in

                    cover image Communications of the ACM
                    Communications of the ACM  Volume 58, Issue 7
                    July 2015
                    102 pages
                    ISSN:0001-0782
                    EISSN:1557-7317
                    DOI:10.1145/2797100
                    • Editor:
                    • Moshe Y. Vardi
                    Issue’s Table of Contents

                    Copyright © 2015 ACM

                    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                    Publisher

                    Association for Computing Machinery

                    New York, NY, United States

                    Publication History

                    • Published: 25 June 2015

                    Permissions

                    Request permissions about this article.

                    Request Permissions

                    Check for updates

                    Qualifiers

                    • research-article
                    • Popular
                    • Refereed

                  PDF Format

                  View or Download as a PDF file.

                  PDFChinese translation

                  eReader

                  View online with eReader.

                  eReader

                  HTML Format

                  View this article in HTML Format .

                  View HTML Format