Chaitanya Baru
ABSTRACT
This paper describes the architecture of the SDSC Storage Resource Broker (SRB). The SRB is middleware that provides applications a uniform API to access heterogeneous distributed storage resources including, filesystems, database systems, and archival storage systems. The SRB utilizes a metadata catalog service, MCAT, to provide a "collection"-oriented view of data. Thus, data items that belong to a single collection may, in fact, be stored on heterogeneous storage systems. The SRB infrastructure is being used to support digital library projects at SDSC. This paper describes the architecture and various features of the SDSC SRB.
- D. Adams, D. Hansen, K. Walker, and J. Gash. Scientific data archive at the Environmental Molecular Sciences Laboratory. In Procs. of Sixth Goddard Conference on Mass Storage Systems and Technologies, p. 409, Silver Spring, MD, 1998.Google Scholar
- C. Baru. Archiving Metadata. In Procs. of European Conf. on Digital Libraries (EUroDL, Crete, Greece, 1998.Google Scholar
- C. Baru, R. Frost, J. Lopez, R. Marciano, R. Moore, A. Rajasekar, and M. Wan. Metadata design for a massive data analysis system. In Procs. of CASCON'96, Toronto, CA, 1996.Google Scholar
- C. Baru, R. Moore, A. Rajasekar, W. Schroeder, M. Wan, R. Klobuchar, D. Wade, R. Sharpe, and J. Terstriep. A data handling architecture for a prototype federal application. In Procs. of the 6th Goddard Conference on Mass Storage Systems and Technologies, Silver Spring, Maryland, 1998.Google Scholar
- C. Baru and A. Rajasekar. A Iierarchical Access Control Scheme for Digital Libraries. In Procs. of the ACM Conf. on Digital Libraries, Pittsburgh, PA, 1998. Google ScholarDigital Library
- M. Bowman and B. Camargo. Digital Libraries: The Next Generation in File System Technology. D-Lib Magazine, February, 1998.Google Scholar
- Dublin Core. Dublin Core Metadata. In http://purl.org/metadata/dublin_core, 1997.Google Scholar
- J. Davis. Datalinks: Managing external data with DB2 Universal Database. In http://www.software.ibm.com/data/pubs/papers/datalink.html, IBM Corporation, 1998.Google Scholar
- IBM DL. IBM Digital Library. In http://www.software.ibm.com/is/dig-lib, IBM Corporation, 1998.Google Scholar
- DOCT. The Distributed Object Computation Testbed Project. In http://www.sdsc.edu/DOCT, San Diego Supercomputer Center, La Jolla, CA, 1998.Google Scholar
- J. Frew, M. Freeston, R. Kemp, J. Simpson, T. Smith, A. Wells, and Q. Zheng. The Alexandria Digital Library testbed. D-Lib Magazine, July/August, 1996.Google ScholarDigital Library
- J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayana, N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1), 1996. Google ScholarDigital Library
- HPSS. High Performance Storage System. In http://www.sdsc.edu/HPSS, San Diego Supercomputer Center, La Jolla, CA, 1997.Google Scholar
- R. Moore. Enabling petabyte computing, The Unpredictable Certainty, Information Infrastructure through 2000. National Academy Press, 1997.Google Scholar
- R. Moore, C. Baru, S. Karin, and A. Rajasekar. Information based computing. In Procs. of the Workshop on Research and Development Opportunities in Federal Information Services, Washington, D.C., 1997.Google Scholar
- R. Moore, R. Marciano, M. Wan, T. Sherwin, and R. Frost. Towards the interoperability of Web, database, and mass storage technologies for petabyte archives. In Procs. of the 5th Conference on Mass Storage Systems and Technologies, Silver Spring, MD, 1996.Google Scholar
- V. Ogle and R. Wilensky. Testbed Development for the Berkeley Digital Library Project. D-Lib Magazine, July/August, 1996.Google Scholar
- W. Pfeiffer. Evaluation of a Multithreaded Architecture for Defense Applications. In http://www.sdsc.edu/mta_eval/darpa, San Diego Supercomputer Center, La Jolla, CA, 1997.Google Scholar
- W. Schroeder. The SDSC Encryption and Authentication (SEA) System. Concurrency Practice and Experience, April, 1998.Google Scholar
- A. Spector and M. Kazar. Wide-area file service and the AFS experience. UNIX Review, 7(3), 1989.Google Scholar
Index Terms
- The SDSC storage resource broker
Recommendations
The SDSC storage resource broker
CASCON '98: Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative researchThis paper describes the architecture of the SDSC Storage Resource Broker (SRB). The SRB is middleware that provides applications a uniform API to access heterogeneous distributed storage resources including, filesystems, database systems, and archival ...
The Grid Resource Broker workflow engine
2nd International Workshop on Workflow Management and Applications in Grid Environments (WaGe2007)Increasingly, complex scientific applications are structured in terms of workflows. These applications are usually computationally and-or data intensive and thus are well suited for execution in grid environments. Distributed, geographically spread ...
The Grid Resource Broker portal: Research Articles
Workshop on Grid Computing Portals (GCE 2005)This paper describes the Grid Resource Broker (GRB), a Grid portal built leveraging a set of high-level, Globus-Toolkit-based Grid libraries called GRB libraries. The portal leverages the Liferay framework to provide users with an intuitive, highly ...
Comments