skip to main content
article
Free Access

A cost-effective, high-bandwidth storage architecture

Authors Info & Claims
Published:01 October 1998Publication History
Skip Abstract Section

Abstract

This paper describes the Network-Attached Secure Disk (NASD) storage architecture, prototype implementations oj NASD drives, array management for our architecture, and three, filesystems built on our prototype. NASD provides scalable storage bandwidth without the cost of servers used primarily, for transferring data from peripheral networks (e.g. SCSI) to client networks (e.g. ethernet). Increasing datuset sizes, new attachment technologies, the convergence of peripheral and interprocessor switched networks, and the increased availability of on-drive transistors motivate and enable this new architecture. NASD is based on four main principles: direct transfer to clients, secure interfaces via cryptographic support, asynchronous non-critical-path oversight, and variably-sized data objects. Measurements of our prototype system show that these services can be cost-effectively integrated into a next generation disk drive ASK. End-to-end measurements of our prototype drive andfilesysterns suggest that NASD cun support conventional distributed filesystems without performance degradation. More importantly, we show scaluble bandwidth for NASD-specialized filesystems. Using a parallel data mining application, NASD drives deliver u linear scaling of 6.2 MB/s per clientdrive pair, tested with up to eight pairs in our lab.

References

  1. Acharya98 Acharaya, A. et al, Active Disks, ACM ASPLOS, Oct 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Agrawal94 Agrawal, R. and Srikant, R. Fast Algorithms for Mining Association Rules, VLDB, Sept 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Anderson96 Anderson, T, et al. Serverless Network File Systems, A CM TOCS 14(1), Feb 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Anderson97 Anderson, J.M. et al., Continuous Profiling: Where Have All the Cycles Gone?, A CM SOSP, Oct 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Anderson98a Anderson, D. Network Attached Storage Research, www. nsic. org/nasd/meetings, html, March 1998.]]Google ScholarGoogle Scholar
  6. Anderson98b Anderson, D. Network Attached Storage Research, www. nsic. org/nasd/meetings, html, June 1998.]]Google ScholarGoogle Scholar
  7. Anderson98c Anderson, D., et al. Cheating the I/O Bottleneck: Network Storage with Trapeze/Myrinet, USENIX, June 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Baker91 Baker, M.G. et al., Measurements of a Distributed File System", ACM SOSP, Oct 1991.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Bellare96 Bellare, M., Canetti, R. and Krawczyk, H., Keying Hash Functions for Message Authentication, Crypto '96, 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Benner96 Benner, A.F., Fibre Channel: Gigabit Communications and l/O for Computer Networks, McGraw Hill, 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Birrell80 Birell, A.D. and Needham, R.M., A Universal File Server, IEEE TSE 6 (5), Sept1980.]]Google ScholarGoogle Scholar
  12. Boden95 Boden , N.J., et al., Myrinet: A Gigabit-per-Second Local Area Network, IEEE Micro, Feb 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Cabrera91 Cabrera, L. and Long, D., Swift: Using Distributed Disk Striping to Provide High I/O Data Rates, Computing Systems 4:4, Fall 1991.]]Google ScholarGoogle Scholar
  14. Cao93 Cao, P., et al., The TickerTAIP Parallel RAID Architecture, ACM ISCA, May 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Corbett96 Corbett, P., et al., Proposal for a Common Parallel File System Programming Language, Scalable I/0 Initiative CalTech CACR 130, Nov 1996.]]Google ScholarGoogle Scholar
  16. Deering95 Deering, S. and Hinden, R., Intemet Protocol Version 6 Specification, RFC 1883, Dec 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. deJonge93 deJonge, W., Kaashoek, M.F. and Hsieh. W.C. The Logical Disk: A New Approach to Improving File Systems, A CM SOSP, Dec 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Dennis66 Dennis, J.B. and Van Horn, E.C., "Programming Semantics for Multiprogrammed Computations", CA CM 9, 3, 1966]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Drapeau94 Drapeau, A.L., et al., RAID-II: A High-Bandwidth Network File Server, A CM ISCA, 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Gibson97a Gibson, G., et al., File Server Scaling with Network-Attached Secure Disks, ACM SiGMETRICS, June 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Gibson97b Gibson, G., et al. Filesystems for Network- Attached Secure Disks, TR CMU-CS-97-118, July 1997.]]Google ScholarGoogle Scholar
  22. Gobioff97 Gobioff, H., Gibson, G. and Tygar, D., Security for Network Attached Storage Devices, TR CMU-CS-97- 185, Oct 1997.]]Google ScholarGoogle Scholar
  23. Golding95 Golding, R., Shriver, E., Sullivan, T., and Wilkes, J., "Attribute-managed storage," Workshop on Modeling and Specification of I/O, San Antonio, TX, Oct 1995.]]Google ScholarGoogle Scholar
  24. Gong89 Gong, L., A Secure Identity-Based Capability System IEEE Syrup. on Security and Privacy, May 1989.]]Google ScholarGoogle Scholar
  25. Grochowski96 Grochowski, E.G. and Hoyt, R.F., Future Trends in Hard Disk Drives, IEEE Trans. on Magnetics 32 (3), May 1996.]]Google ScholarGoogle ScholarCross RefCross Ref
  26. Hartman93 Hartman, J.H. and Ousterhout, J.K., The Zebra Striped Network File System, A CM SOSP, Dec 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Hitz90 Hitz, D. et al., Using UNIX as One Component of a Lightweight Distributed Kernel for Multiprocessor File Servers, Winter USENIX, 1990.]]Google ScholarGoogle Scholar
  28. Hitz94 Hitz, D., Lau, J. and Malcolm, M. File Systems Design for an NFS File Server Appliance, Winter USENIX, January 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Horst95 Horst, R.W. TNet: A Reliable System Area Network, IEEE Micro, Feb 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Howard88 Howard, J.H. et al., Scale and Performance in a Distributed File System, ACM TOCS 6 (1), February 1988.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. IEEE95 IEEE P1244. "Reference Model for Open Storage Systems Interconnection-Mass Storage System Reference Model Version 5", Sept 1995]]Google ScholarGoogle Scholar
  32. Intel97 Intel Corporation, Virtual Interface (VI) Architecture, www. viarch.org, Dec 1997.]]Google ScholarGoogle Scholar
  33. Karger88 Karger, RA., "Improving Security and Performance for Capability Systems", University of Cambridge Computer Laboratory Technical Report No. 149, Oct 1988.]]Google ScholarGoogle Scholar
  34. Knudsen96 Knudsen, L. and Preneel, B., Hash functions based on block ciphers and quaternary codes. Advances in Cryptology ASIA CRYPT, Nov 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Lee96 Lee, E.K. and Thekkath, C.A., Petal: Distributed Virtual Disks, ACM ASPLOS, Oct 1996.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Long94 Long, D.D.E., et al, Swift/RAID: A Distributed RAID System, Computing Systems 7,3, Summer 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Maeda93 Maeda, C., and Bershad, B., "Protocol Service Decomposition for High-Performance Networking", 14th A CM SOSP, Dec. 1993.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. McKusick84 McKusick, M.K. et al., A Fast File System for UNIX, ACM TOCS 2, August 1984.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Miller88 Miller, S.W., A Reference Model for Mass Storage Systems, Advances in Computers 27, 1988.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Mitchell81 Mitchell, J. and Dion, J., A Comparison of Two Network-Based File Servers, A CM SOSP, Dec 1981.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. MPI95 The MPI Forum, The Message-Passing Interface Standard, www. mcs. anl. gov/mpi/standard, html, May 1995.]]Google ScholarGoogle Scholar
  42. Neuman94 Neuman, B.C. and Ts'o, T., Kerberos: An Authentication Service for Computer Networks, IEEE Communications 32,9, Sept 1994.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Patterson88 Patterson, D.A., et al., A Case for Redundant Arrays of Inexpensive Disks, ACM SIGMOD, June 1988.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Pricewatch98 www. pricewatch, com, July 1998.]]Google ScholarGoogle Scholar
  45. Riedel98 Riedel, E., et al., "Active Storage for Large-Scale Data Mining and Multimedia" VLDB, Aug 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Sachs94 Sachs, M.W. et al., LAN and I/O Convergence: A Survey of the Issues, IEEE Computer, Dec 1994.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Sandberg85 Sandberg, R. et al., Design and Implementation of the Sun Network Filesystem, Summer USENIX, June 1985, pp. 119-130.]]Google ScholarGoogle Scholar
  48. Srivastava94 Srivastava, A., and Eustace, A., ATOM: A system for building customized program analysis tools, WRL Technical Report TN-41, 1994.]]Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Tanenbaum86 Tanenbaum, A.S., Mullender, S.J. and van Renesse, R., Using Sparse Capabilities in a Distributed System, Sixth Conference on Distributed Computing, 1986.]]Google ScholarGoogle Scholar
  50. Thekkath97 Thekkath, C., et al., Frangipani: A Scalable Distributed File System, ACM SOSP, Oct 1997.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. TPC98 Transaction Performance Council TPC-C Executive Summaries, URL: www. tpc. org, Mar 1998.]]Google ScholarGoogle Scholar
  52. TriCore97 TriCore News Release, Siemens' New 32-bit Embedded Chip Architecture Enables Next Level of Performance in Real-Time Electronics Design, www. tri-core, com, Sept 1997.]]Google ScholarGoogle Scholar
  53. VanMeter96 Van Meter, R., Hotz, S. and Finn, G., Derived Virtual Devices: A Secure Distributed File System Mechanism, Fifth NASA Goddard Conference on Mass Storage Systems and Technologies, Sep 1996.]]Google ScholarGoogle Scholar
  54. VanMeter98 Van Meter, R., et al., VISA: Netstation's Virtual Intemet SCSI Adapter, A CM ASPLOS, Oct 1998.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Verbauwhede87 Verbauwhede, I. et al., H. Security Considerations in the Design and Implementation of a New DES Chip, EUROCRYPT, 1987.]]Google ScholarGoogle Scholar
  56. vonEicken95 von Eicken, T., Basu, A., Buch, V. and Vogels, W. U-Net: A User-Level Network interface for Parallel and Distributed Computing, ACM SOSP, Dec 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Watson95 Watson, R., Coyne, R., The Parallel i/O Architecture of the High-Performance Storage System (HPSS), 14th IEEE Symposium on Mass Storage Systems, September 1995.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Wilkes79 Wilkes, M.V. and Needham, R.M., The Cambridge CAP Computer and Its Operating System, 1979.]] Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Wilkes92 Wilkes, J. Hamlyn - An Interface for Senderbased Communications, Hewlett-Packard Laboratories Technical Report HPL-OSR-92-13, Nov 1992.]]Google ScholarGoogle Scholar
  60. Wulf74 Wulf, W.A. et al., "HYDRA: The Kernel of a Multiprocessor Operating System", CACM, i7,6, June 1974]] Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A cost-effective, high-bandwidth storage architecture

                        Recommendations

                        Comments

                        Login options

                        Check if you have access through your login credentials or your institution to get full access on this article.

                        Sign in

                        Full Access

                        • Published in

                          cover image ACM SIGPLAN Notices
                          ACM SIGPLAN Notices  Volume 33, Issue 11
                          Nov. 1998
                          309 pages
                          ISSN:0362-1340
                          EISSN:1558-1160
                          DOI:10.1145/291006
                          Issue’s Table of Contents
                          • cover image ACM Conferences
                            ASPLOS VIII: Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
                            October 1998
                            326 pages
                            ISBN:1581131070
                            DOI:10.1145/291069

                          Copyright © 1998 ACM

                          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                          Publisher

                          Association for Computing Machinery

                          New York, NY, United States

                          Publication History

                          • Published: 1 October 1998

                          Check for updates

                          Qualifiers

                          • article

                        PDF Format

                        View or Download as a PDF file.

                        PDF

                        eReader

                        View online with eReader.

                        eReader