skip to main content
10.1145/301816.301823acmconferencesArticle/Chapter ViewAbstractPublication PagesiopadsConference Proceedingsconference-collections
Article
Free Access

Cluster I/O with River: making the fast case common

Authors Info & Claims
Published:01 May 1999Publication History
First page image

References

  1. 1.Supercomputers: Plug and Play. The Economist, November 1998.Google ScholarGoogle Scholar
  2. 2.A.C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, D. E. Culler, L M. Hellerstein, and D. A. Patterson. High-Performance Sorting on Networks of Workstations. In SIGMOD '97, May 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. 3.A.C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, D. E. Culler, J. M. Hellerstein, and D. A. Patterson. Searching for the Sorting Record: Experiences in Tuning NOW-Sort. In SPDT '98, Aug. 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 4.H.E. Bal, M. E Kaashoek, and A. S. Tanenbaum. Orca: A Language for Parallel Programming of Distributed Systems. IEEE Transactions on Software Engineering, 18(3):190-205, Mar. 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. 5.T. Barclay, R. Barnes, J. Gray, and P. Sundaresan. Loading Databases Using Dataflow Parallelism. SIGMOD Record (ACM Special Interest Group on Management of Data), 23(4):72-83, December 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6.B. Bershad, D. Black, D. DeWitt, G. Gibson, K. Li, L. Peterson, and M. Stair. Operating system support for high-performance parallel I/O systems. Technical Report CCSF-40, Scalable I/O Initiative, Caltech Concurrent Supercomputing Facilities, Cattech, I994.Google ScholarGoogle Scholar
  7. 7.R. D. Blumofe, C. E Joerg, B. C. Kuszmaul, C. E. Leiserson, K. H. Randall, and Y. Zhou. Cilk: An Efficient Multithreaded Runtime System. In Proceedings of the 5th Symposium on Principles and Practice of Parallel Programming, July 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. 8.R. D. Blumofe and E A. Lisiecld. Adaptive and Reliable Parallel Computing on Networks of Workstations. In USENIX, editor, 1997Annual Technical Conference, January 6-10, 199Z Anaheim, CA, pages 133--147, Berkeley, CA, USA, Jan. 1997. USENIX. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. 9.N. Boden, D. Cohen, R. E, F~lderman, A. KuIawik, and C. Seitz. Myrlnet: A Gigabit-per-sccond local Area Network. IEEE Micro, February 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. 10.L-E Cabrera and D. D. E. Long. Swift: Using distributed disk striping to provide high FO data rates. Computing Systems, 4(4):405-436, Fall 1991.Google ScholarGoogle Scholar
  11. 11.N. L Cardero. Implementation of tuple space. PhD thesis, Department of Computer Science, Yale University, December 1987.Google ScholarGoogle Scholar
  12. 12.S. Chakrabarti, E. Deprit, E.-L Ira, L Jones, A. Krishnamurthy, C.-P. Wen, and K. Yetick. Multipol: A Distributed Data Structure Library. Technical Report CSD-95-879, University of California, Berkeley, July 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13.A. Choudhary, R. Bordawekar, M. Harry, R. Krishnaiyer, R. Ponnusamy, I'. Singh, and R. Thakur. PASSION: parallel and scalable software for input-output. Technical Report SCC8-636, ECE Dept., NPAC and CASE Center, Syracuse University, September 1994.Google ScholarGoogle Scholar
  14. 14.E. E Codd. A Relational Model of Data for Large Shared Data Banks. Communications of the ACM, 13(6):377-387, June 1970. Also published in/as: 'Readings in Database Systems, 3rd Edition', M. Stonebraker and J. Hellerstein, Morgan-Kaufmann, 1998, pp. 5-15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. 15.G. Copeland, W. Alexander, E. Boughter, and T. Keller. Data Placement in Bubba. SIGMOD Record (ACM Special Interest Group on Management of Data), 17(3):99-I08, Sept. I988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. 16.E E Corbett and D. G. Feitelson. The Vesta parallel file system. ACM Transactions on Computer Systems, I4(3):225-264, August 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. 17.T. R Council. TPC-D Individual Results, 1998. http://www.tpc.org/results/tpc.d.results.page.html.Google ScholarGoogle Scholar
  18. 18.D. E. CuBer, A. Dusseau, S. C. Goldstein, A. Krishnamurthy, S. Lumetta, T. von Eicken, and IC Yelick. Parallel Programming in Split-C. In Proceedings of Supercomputing '93, pages 262- 273, I993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. 19.D. DeWitt and J. Gray. Parallel database systems: The future of high-performance database systems. Communications of the ACM, 35(6):85-98,June 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. 20.D. J. DeWitt, S. Ghandeharizadeh, and D. Schneider. A Performance Analysis of the Gamma Database Machine. SIGMOD Record (ACM Special Interest Group on Management of Data), 17(3):350-360, Sept. 1988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. 21.G. Geist and V. Sundemm. The Evolution of the PVM Concurrent Computing System. In COMPCON, February 1993.Google ScholarGoogle ScholarCross RefCross Ref
  22. 22.D. Gelemter, N. Carriero, S. Chandran, and S. Chang. Parallel programmiagin Linda. In D. Degroot, editor, 1985 International Conference on Parallel Processing, pages 255-263, ! 985.Google ScholarGoogle Scholar
  23. 23.S. C. Goldstein, K. E. Schauser, and D. E. Culler. Lazy Threads: Implementing a Fast Parallel Call. Journal of Parallel and Distributed Computing, 37(1):5-20, Aug. 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. 24.G. Graefe. Encapsulation of Parallelism in the Volcano Query Processing System. SIGMOD Record (ACM Special Interest Group on Management of Data), 19(2): 102-111, June 1990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. 25.J. Gray. What Happens When Processors Are Infinitely Fast And Storage Is Free? Invited Talk: 1997 IOPADS, November 1997.Google ScholarGoogle Scholar
  26. 26.H.-I. Hsiao and D. DeWitt. Chained Declustering: A new availability strategy for multiprocessor database machines. In Proceedings of 6th International Data Engineering Conference, pages 456--465, I990. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. 27.L Huber, C. I_. Etford, D. A. Reed, A. A. Chien, and D. S. Blumenthal. PPFS: A high performance portable parallel file system. In Proceedings of the 9th ACM International Conference on Supercomputing, pages 385-394, Barcelona, July 1995. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. 28.M. Kitsuregawa, H. Tanaka, and 1". Moto-Oka. GRACE: Relational algebra machine based on hash and sort # its design coneepts. Journal of the Information Processing Society of Japan, 6(3):148-155,1983.Google ScholarGoogle Scholar
  29. 29.S. Kleiman, J. Voll, j. Eykholt, A. Shivalingiah, D. Williams, M. Smith, S. Barton, and G. Skinner. Symmetric Multiprocessing in Solaris 2.0. In Proceedings of COMPCON Spring '92, 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. 30.D. Kotz. Disk-directed I/O for MIMD multiprocessors. In Proceedings of the 1994 Symposium on Operating Systems Design and Implementation, pages 61-74. USENIX Association, November 1994. Updated as Dartmouth TR PCS.-TR94-226 on November 8, 1994. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. 31.S. Kubica, T. Robey, and C. Moorman. Data parallel programming with the Khoros Data Services Library. Lecture Notes in Computer Science, 1388:963-973,1998.Google ScholarGoogle ScholarCross RefCross Ref
  32. 32.B. Lindsey. SMP lntra-Ouery Parallelism in DB2 UDB. Database Seminar at U.C. Berkeley, February 1998.Google ScholarGoogle Scholar
  33. 33.S. J. LoVerso, M. Isman, A. Nanopoulos, W. Nesheim, E. D. Milne, and R. Wheeler. sfs: A parallel file system for the CM-5. In Proceedingsof the 1993 Summer USENIX Technical Conference, pages 291-305,1993.Google ScholarGoogle Scholar
  34. 34.A. Mainwaring and D. Culler. Active Message Applications Programming Interface and Communication Subsystem Organization. Technical Report CSD-96-9 t 8, University of California at Berkeley, October 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. 35.J. N. Matthews, D. Roselti, A. M. Costello, R. Y. Wang, and T. E. Anderson. Improving the performance of log-structured file systems with adaptive methods. In Proceedings of the 16th Symposium on Operating Systems Principles (SOSP-97), volume 31,5 of Operating Systems Review, pages 238-251, Saint-Malo, France, OctoberS-8 1997. ACM SIGOPS, ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. 36.R. V. Meter. Observing the Effects of Multi-Zone Disks. In Proceedings of the 1997 USF#IX Conference, Jan. 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. 37.N. Nieuwejaar and D. Kotz. The Galley parallel file system. In tVoceedings of the IOtA ACM International Conference on Supercomputing, pages 374-381, Philadelphia, PA, May 1996. ACM Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. 38.B. Nitzberg. Performance of the iPSC#60 Concurrent File System. Technical Report RHD-92-020, NAS Systems Division, NASA Ames, December 1992.Google ScholarGoogle Scholar
  39. 39.S. #ki_n_, M. Lauria, and A. C#ien. High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet. In Proceedings of the 1995 ACM/IEEE Supercomputing Conference, December 3--8, 1995, San Diego Convention Center, San Diego, CA, USA. ACM Press and IEEE Computer Society Press, 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. 40.G. Papadopolous# Untitled. Talk at W'mter NOW Retreat, July 1997.Google ScholarGoogle Scholar
  41. 41.D. M. Ritchie. A Stream Input-Output System. BLTJ, 63(8, Part 2):1897-1910, October 1984.Google ScholarGoogle Scholar
  42. 42.J.H. Saltzer, D. P. Reed, and D. D. Clark. End-to-End Arguments in System Design. ACM Transactions on Computer Systems, pages 277-288, November 1984. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. 43.D. Scales and M. Laln. Transparent Fault Tolerance for Parallel Applications on Networks of Workstaions. In Proceedings ofthe 1996 USENIX Conference, Jan. 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. 44.M. Seltzer and C. Small. SeIf-Monitoring and Self-Adapting Systems. In Proceedings of the 1997 Workshop on Hot Topics on Operating Systems, Chatham, MA, May 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. 45.L. D. Shapiro. Join processing in database systems with large main memories. ACM Transactions on Database Systems, 11(3):239-264, Sept. 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. 46.M. Stonebraker, J. Chen, N. Nathan, C. Paxson, and J. Wu. Tioga:providing data management support for scientific visualization applications. In International Conference On Very Large Data Bases (VLDB '93), pages 25-38, San Francisco, Ca., USA, Aug. 1993. Morgan Kaufmann Publishers, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. 47.The MPI Forum. MPI: A Message Passing Interface. In Proceedings of Supercomputing '93, pages 878--883, November 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. 48.T. yon Eicken, A. Basu, V. Buch, and W. Vogels. U-Net: A User-Level Network Interface for ParaIle} and Distributed Computing. In Proceedings of the 14th A CM Symposium on Operating Systems Principles, pages 40-53, December 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. 49.T. yon Eicken, D. E. Culler, S. C. Goldstein, and ICE. Schauser. Active Messages: a Mechanism for Integrated Communication and Computation. In Proceedings of the 19th Annual International Symposium on Computer Architecture, pages 256-266, Gold Coast, Australia, May 19-21, 1992. ACM SIGARCH and IEEE Computer Society TCCA. Computer Architecture News, 20(2), May 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. 50.R. W'mter and K. Auerbach. The Big Trine: 1998 Winter VI.DB Survey. Database Programming and Design, 1998.Google ScholarGoogle Scholar
  51. 51.R. Wolniewicz and G. Graefe. Algebraic Optimization of Computations over Scientific Databases. In VLDB '93, pages 13-24, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Cluster I/O with River: making the fast case common

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            IOPADS '99: Proceedings of the sixth workshop on I/O in parallel and distributed systems
            May 1999
            98 pages
            ISBN:1581131232
            DOI:10.1145/301816

            Copyright © 1999 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 1 May 1999

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • Article

            Acceptance Rates

            IOPADS '99 Paper Acceptance Rate9of30submissions,30%Overall Acceptance Rate19of56submissions,34%

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader