skip to main content
10.1145/1526709.1526790acmconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

OpenRuleBench: an analysis of the performance of rule engines

Authors Info & Claims
Published:20 April 2009Publication History

ABSTRACT

The Semantic Web initiative has led to an upsurge of the interest in rules as a general and powerful way of processing, combining, and analyzing semantic information. Since several of the technologies underlying rule-based systems are already quite mature, it is important to understand how such systems might perform on the Web scale. OpenRuleBench is a suite of benchmarks for analyzing the performance and scalability of different rule engines. Currently the study spans five different technologies and eleven systems, but OpenRuleBench is an open community resource, and contributions from the community are welcome. In this paper, we describe the tested systems and technologies, the methodology used in testing, and analyze the results.

References

  1. H. Aıt-Kaci. Warren's abstract machine: a tutorial reconstruction. MIT Press, Cambridge, MA, 1991. http://www.freetechbooks.com/warren-s-abstract-machine-a-tutorial-reconstruction-t397.html. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. K.R. Apt, H. Blair, and A. Walker. Towards a theory of declarative knowledge. In J. Minker, editor, Foundations of Deductive Databases and Logic Programming, pages 89--148. Morgan Kaufmann, Los Altos, CA, 1988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. I. Balbin, G. S. Port, K. Ramamohanarao, and K. Meenakshi. Efficient bottom-up computation of queries on stratified databases. J. Log. Program., 11(3--4):295--344, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. C. Beeri and R. Ramakrishnan. On the power of magic. Journal of Logic Programming, 10:255--300, April 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. B. Bishop and F. Fischer. Iris -- integrated rule inference system. In International Workshop on Advancing Reasoning on the Web: Scalability and Commonsense (ARea 2008), June 2008.Google ScholarGoogle Scholar
  6. F. Bry, N. Eisinger, T. Eiter, T. Furche, G. Gottlob, C. Ley, B. Linse, R. Pichler, and F. Wei. Foundations of Rule-Based Query Answering. In Proceedings of Summer School Reasoning Web 2007, Dresden, Germany (3rd--7th September 2007), volume 4634 of LNCS, pages 1--153. REWERSE, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. F. Calimeri, S. Cozza, G. Ianni, and N. Leone. Computable functions in ASP: Theory and implementation. In Int'l Conference on Logic Programming, pages 407--424, December 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. The China benchmark suite, 2001. http://www.cs.unipr.it/China/Benchmarks/.Google ScholarGoogle Scholar
  9. K.L. Clark. Negation as failure. In H. Gallaire and J. Minker, editors, Logic and Data Bases, pages 292--322. Plenum Press, 1978.Google ScholarGoogle ScholarCross RefCross Ref
  10. C.L. Forgy. Rete: a fast algorithm for the many pattern/many object pattern match problem. Atrificial Intelligence, 19(1):17--37, September 1982.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. H. Garcia--Molina, J.D. Ullman, and J. Widom. Database Systems: The Complete Book. Prentice-Hall, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Gelfond and N. Leone. Logic programming and knowledge representation -- the A-Prolog perspective. Artificial Intelligence, 138(1--2):3--38, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. M. Gelfond and V. Lifschitz. The stable model semantics for logic programming. In Logic Programming: Proceedings of the Fifth Conference and Symposium, pages 1070--1080, 1988.Google ScholarGoogle Scholar
  14. Y. Guo, Z. Pan, and J. Heflin. LUBM: A benchmark for OWL knowledge base systems. Journal of Web Semantics, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. M. Kifer, A. Bernstein, and P.M. Lewis. Database Systems: An Application Oriented Approach, Complete Version (2nd Edition). Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. M. Kifer, G. Lausen, and J. Wu. Logical foundations of object-oriented and frame-based languages. Journal of ACM, 42:741--843, July 1995. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. M. Kifer and E.L. Lozinskii. Implementing logic programs as a database system. In IEEE 3-d Int'l Conference on Data Engineering, pages 375--385, February 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. O. Lassila and R.R. Swick (editors). Resource description framework (RDF) model and syntax specification. Technical report, W3C, February 1999. http://www.w3.org/TR/1999/REC-rdf-syntax-19990222/.Google ScholarGoogle Scholar
  19. L. Ma, Y. Yang, Z. Qiu, G. Xie, Y. Pan, and S. Liu. Towards a complete OWL ontology benchmark. In European Semantic Web Conference, pages 125--139, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Openrulebench web site, 2008. http://rulebench.projects.semwebcentral.org.Google ScholarGoogle Scholar
  21. Prolog benchmarking, 1985. http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/lang/prolog/code/bench/0.html.Google ScholarGoogle Scholar
  22. T.C. Przymusinski. On the declarative semantics of deductive databases and logic programs. In J. Minker, editor, Foundations of Deductive Databases and Logic Programming, pages 193--216. Morgan Kaufmann, Los Altos, CA, 1988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Y Sure, S Staab, and J Angele. Ontoedit: Guiding ontology development by methodology and inferencing. In 1st International Conf. on Ontologies, Databases, and Applications of Semantics, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. T. Swift and D.S. Warren. An abstract machine for SLG resolution: Definite programs. In Int'l Logic Programming Symposium, Cambridge, MA, November 1994. MIT Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. H.J. ter Horst. Combining RDF and part of OWL with rules: Semantics, decidability, complexity. In International Semantic Web Conference (ISWC), pages 668--684, November 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. G. Terracina, N. Leone, V. Lio, and C. Panetta. Experimenting with recursive queries in database and logic programming systems. Journal of the Theory and Practice of Logic Programming, 8(2):129--165, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. J.F. Ullman. Principles of Database and Knowledge-Base Systems, Volume 1. Computer Science Press, Rockville, MD, 1988. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. A. Van Gelder. The alternating fixpoint of logic programs with negation. Journal of Computer and System Sciences, 47(1):185--221, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. A. Van Gelder, K.A. Ross, and J.S. Schlipf. The well-founded semantics for general logic programs. Journal of ACM, 38(3):620--650, 1991. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. D.S. Warren. Memoing for logic programming. Communications of ACM, 35(3):93--111, March 1992. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. D.S. Warren. Programming in tabled prolog. Manuscript. http://www.cs.sunysb.edu/ warren/xsbbook/, 1999.Google ScholarGoogle Scholar

Index Terms

  1. OpenRuleBench: an analysis of the performance of rule engines

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        WWW '09: Proceedings of the 18th international conference on World wide web
        April 2009
        1280 pages
        ISBN:9781605584874
        DOI:10.1145/1526709

        Copyright © 2009 IW3C2 org

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 April 2009

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate1,899of8,196submissions,23%

        Upcoming Conference

        WWW '24
        The ACM Web Conference 2024
        May 13 - 17, 2024
        Singapore , Singapore

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader