skip to main content
10.1145/276304.276338acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
Article
Free Access

On parallel processing of aggregate and scalar functions in object-relational DBMS

Authors Info & Claims
Published:01 June 1998Publication History

ABSTRACT

Nowadays parallel object-relational DBMS are envisioned as the next great wave, but there is still a lack of efficient implementation concepts for some parts of the proposed functionality. Thus one of the current goals for parallel object-relational DBMS is to move towards higher performance. In this paper we develop a framework that allows to process user-defined functions with data parallelism. We will describe the class of partitionable functions that can be processed parallelly. We will also propose an extension which allows to speed up the processing of another large class of functions by means of parallel sorting. Functions that can be processed by means of our techniques are often used in decision support queries on large data volumes, for example. Hence a parallel execution is indispensable.

References

  1. 1.Antoshenkov, G., Ziauddin, G.: Query Processing and Optimization in Oracle Rdb. VLDB Journal 5(4): 229- 237 (1996). Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. 2.Carey, M. J., Dewitt, D. J.: Of Objects and Databases: A Decade of Turmoil, VLDB 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. 3.Carey, M. J., Mattos, N., Nori, A.: Object-Relational Database Systems: Principles, Products, and Challenges (Tutorial). SIGMOD 1997: 502. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 4.Chamberlin, D.: Using the New DB2, Morgan Kaufman Publishers, San Francisco, 1996.Google ScholarGoogle Scholar
  5. 5.Chatziantoniou, D., Ross, K. A.: Groupwise Processing o f Relational Queries. VLDB 1997: 476-485. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6.Chaudhuri, S., Shim, K.: Optimization of Queries with User-defined Predicates. VLDB 1996: 87-98. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. 7.Davis, J. R.: Creating an extensible, Object-Relational Data Management Environment: IBM's Universal Database, White Paper, Database Associates International, 1996.Google ScholarGoogle Scholar
  8. 8.DeSloch, S., Mattos, N.: Integrating SQL Databases with Content-Specific Search Engines. VLDB 1997: 528-537. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. 9.DeWitt, D., Gray, J.: Parallel Database Systems: The Future of High Performance Database Systems, In: CACM, Vol.35, No.6, 85-98, 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. 10.DeWitt, D.: Parallel Object-Relational Database Systems: Challenges & Opportunities, invited talk, PDIS 1996.Google ScholarGoogle Scholar
  11. 11.DeWitt, D. J., Carey, M., Naughton, J., Asgarian, M., Gehrke, J., Shah, D.: The BUCKY Object-Relational Benchmark, SIGMOD 1997: 135-146. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. 12.Graefe, G.: Query Evaluation Techniques for Large Databases. Computing Surveys 25(2): 73-170 (1993). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13.Graefe, G.: The Cascades Framework for Query Optimization. Data Engineering Bulletin 18(3): 19-29 (1995).Google ScholarGoogle Scholar
  14. 14.Gray, J.: A Survey of Parallel Database Techniques and Systems, in: Tutorial handout at VLDB 1995.Google ScholarGoogle Scholar
  15. 15.Gray, J., Chaudhuri, S., Bosworth, A., Layman, A., Reichart, D., Venkatrao, M., Pellow, E, Pirahesh, H.: Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals, Data Mining and Knowledge Discovery 1, p. 29-53, Kluwer Academic Publishers, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. 16.Haas, L. M., Chang, W., Lohman, G. M., McPherson, J., Wilms, P. E, Lapis, G., Lindsay, B. G., Pirahesh, H., Carey, M. J., Shekita, E. J.: Starburst Mid-Flight: As the Dust Clears. TKDE 2(1): 143-160 (1990). Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. 17.Haas, L. M., Kossmann, D., Wimmers, E. L., Yang, J.: Optimizing Queries Across Diverse Data Sources. VLDB 1997: 276-285. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. 18.Hellerstein, J. M., Stonebraker, M.: Predicate Migration: Optimizing Queries with Expensive Predicates. SIGMOD 1993: 267-276. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. 19.Hellerstein, J. M., Naughton, J. E, Pfeffer, A.: Generalized Search Trees for Database Systems. VLDB 1995: 562-573. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. 20.H ellerstein, J. M., Naughton, J. F.: Query Execution Techniques for Caching Expensive Methods. SIGMOD 1996: 423-434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. 21.IBM DB2 Universal Database SQL Reference Version 5, Document Number S10J-8165-00, 1997: 441-453.Google ScholarGoogle Scholar
  22. 22.Illustra User's Guide, Illustra Information Technologies, Inc., 1995.Google ScholarGoogle Scholar
  23. 23.Informix Corporation, http://www.informix.com/informix/products/techbrfs/dblade/program/2122871 .htm, August 1997.Google ScholarGoogle Scholar
  24. 24.Jaedicke, M., Mitschang, B.: A Framework for Parallel Processing of Aggregate and Scalar Functions in Object-Relational DBMS, TUM-I 9741, SFB-Bericht Nr. 342/25/97 A, September 1997. (http://www3.informatik.tu-muenchen.de/public/projekte/sfb342/publications.html).Google ScholarGoogle Scholar
  25. 25.Lohman, G. M.: Grammar-like Functional Rules for Representing Query Optimization Alternatives. SIG- MOD 1988: 18-27. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. 26.Mattos, N." An Overview of the SQL3 Standard, Database Technology Institute, IBM Santa Teresa Lab, San Jose, California, July 1996Google ScholarGoogle Scholar
  27. 27.Mattos, N., Del31och, S., DeMichiel, L., Carey, M.: Object-Relational DB2, IBM White Paper, July 1996.Google ScholarGoogle Scholar
  28. 28.McKenna, W. J., Burger, L., Hoang, C., Truong, M.: EROC: A Toolkit for Building NEATO Query Optimizers. VLDB 1996:111-121. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. 29.Ng, W., Levene, M.: OSQL: An Extension to SQL to Manipulate Ordered Relational Databases. IDEAS 1997: 358-367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. 30.Niblack, W., Barber, R., Equitz, W., Flickner, M., Glasman, E. H., Petkovic, D., Yanker, P., Faloutsos, C., Taubin, G.: The QBIC Project: Querying Images by Content, Using Color, Texture, and Shape. Storage and Retrieval for Image and Video Databases (SPIE) 1993: 173-187.Google ScholarGoogle Scholar
  31. 31.O'Connell, W., Ieong, I.T., Schrader, D., Watson, C., Au, G., Biliris, A., Choo, S., Colin, P., Linderman, G., Panagos, E., Wang, J., Waiters, T.: Prospector: A Content-Based Multimedia Server for Massively Parallel Architectures. SIGMOD 1996: 68-78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. 32.Olson, M. A., Hong, W. M., Ubell, M., Stonebraker, M.: Query Processing in a Parallel Object-Relational Database System, Data Engineering Bulletin, 12/1996.Google ScholarGoogle Scholar
  33. 33.Oracle Corporation, http://www.oracle.com/st/, August 1997.Google ScholarGoogle Scholar
  34. 34.Oracle Corporation, http://www.oracle.com/st/cartridges/context/, August 1997.Google ScholarGoogle Scholar
  35. 35.Oracle Corporation, http://www.oracle.com/st/cartridges/time/, August 1997.Google ScholarGoogle Scholar
  36. 36.Patel, J., Yu, J. Kabra, N., Tufte, K., Nag, B., Burger, J., Hall, N., Ramasamy, K., Lueder, R., Ellman, C., Kupsch, J., Guo, S., DeWitt, D. J., Naughton, J.: Building A Scalable GeoSpatial Database System: Technology, Implementation, and Evaluation, SIGMOD 1997: 336- 347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. 37.Red Brick Systems, Inc., http://www.redbrick.com/rbsg/html/whpap.html, August 1997.Google ScholarGoogle Scholar
  38. 38.Seshadri, P., Livny, M., Ramakrishnan, R.: The Case for Enhanced Abstract Data Types. VLDB 1997: 66-75. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. 39.Shatdal, A., Naughton, J. F.: Adaptive Parallel Aggregation Algorithms. SIGMOD 1995: 104-114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. 40.Stonebraker, M.: inclusion of New Types in Relational Data Base Systems. ICDE 1986: 262-269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. 41.Stonebraker, M.: The Case for Shared Nothing. Database Engineering Bulletin 9(1): 4-9 (1986).Google ScholarGoogle Scholar
  42. 42.Stonebraker, M., Moore, D.: Object-Relational DBMSs - The Next Great Wave, Morgan Kaufman Publishers, 1996. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. 43.Valduriez, P.: Parallel Database Systems: Open Problems and New Issues, in: Distributed and Parallel Databases, Vol. 1, No. 2, April 1993, 137-166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. 44.Yan, W. P., Larson, P.: Eager Aggregation and Lazy Aggregation. VLDB 1995: 345-357. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. On parallel processing of aggregate and scalar functions in object-relational DBMS

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        SIGMOD '98: Proceedings of the 1998 ACM SIGMOD international conference on Management of data
        June 1998
        599 pages
        ISBN:0897919955
        DOI:10.1145/276304

        Copyright © 1998 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 June 1998

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • Article

        Acceptance Rates

        Overall Acceptance Rate785of4,003submissions,20%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader