ABSTRACT
The Semantic Web initiative has led to an upsurge of the interest in rules as a general and powerful way of processing, combining, and analyzing semantic information. Since several of the technologies underlying rule-based systems are already quite mature, it is important to understand how such systems might perform on the Web scale. OpenRuleBench is a suite of benchmarks for analyzing the performance and scalability of different rule engines. Currently the study spans five different technologies and eleven systems, but OpenRuleBench is an open community resource, and contributions from the community are welcome. In this paper, we describe the tested systems and technologies, the methodology used in testing, and analyze the results.
- H. Aıt-Kaci. Warren's abstract machine: a tutorial reconstruction. MIT Press, Cambridge, MA, 1991. http://www.freetechbooks.com/warren-s-abstract-machine-a-tutorial-reconstruction-t397.html. Google ScholarDigital Library
- K.R. Apt, H. Blair, and A. Walker. Towards a theory of declarative knowledge. In J. Minker, editor, Foundations of Deductive Databases and Logic Programming, pages 89--148. Morgan Kaufmann, Los Altos, CA, 1988. Google ScholarDigital Library
- I. Balbin, G. S. Port, K. Ramamohanarao, and K. Meenakshi. Efficient bottom-up computation of queries on stratified databases. J. Log. Program., 11(3--4):295--344, 1991. Google ScholarDigital Library
- C. Beeri and R. Ramakrishnan. On the power of magic. Journal of Logic Programming, 10:255--300, April 1991. Google ScholarDigital Library
- B. Bishop and F. Fischer. Iris -- integrated rule inference system. In International Workshop on Advancing Reasoning on the Web: Scalability and Commonsense (ARea 2008), June 2008.Google Scholar
- F. Bry, N. Eisinger, T. Eiter, T. Furche, G. Gottlob, C. Ley, B. Linse, R. Pichler, and F. Wei. Foundations of Rule-Based Query Answering. In Proceedings of Summer School Reasoning Web 2007, Dresden, Germany (3rd--7th September 2007), volume 4634 of LNCS, pages 1--153. REWERSE, 2007. Google ScholarDigital Library
- F. Calimeri, S. Cozza, G. Ianni, and N. Leone. Computable functions in ASP: Theory and implementation. In Int'l Conference on Logic Programming, pages 407--424, December 2008. Google ScholarDigital Library
- The China benchmark suite, 2001. http://www.cs.unipr.it/China/Benchmarks/.Google Scholar
- K.L. Clark. Negation as failure. In H. Gallaire and J. Minker, editors, Logic and Data Bases, pages 292--322. Plenum Press, 1978.Google ScholarCross Ref
- C.L. Forgy. Rete: a fast algorithm for the many pattern/many object pattern match problem. Atrificial Intelligence, 19(1):17--37, September 1982.Google ScholarDigital Library
- H. Garcia--Molina, J.D. Ullman, and J. Widom. Database Systems: The Complete Book. Prentice-Hall, 2008. Google ScholarDigital Library
- M. Gelfond and N. Leone. Logic programming and knowledge representation -- the A-Prolog perspective. Artificial Intelligence, 138(1--2):3--38, 2002. Google ScholarDigital Library
- M. Gelfond and V. Lifschitz. The stable model semantics for logic programming. In Logic Programming: Proceedings of the Fifth Conference and Symposium, pages 1070--1080, 1988.Google Scholar
- Y. Guo, Z. Pan, and J. Heflin. LUBM: A benchmark for OWL knowledge base systems. Journal of Web Semantics, 2005. Google ScholarDigital Library
- M. Kifer, A. Bernstein, and P.M. Lewis. Database Systems: An Application Oriented Approach, Complete Version (2nd Edition). Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 2005. Google ScholarDigital Library
- M. Kifer, G. Lausen, and J. Wu. Logical foundations of object-oriented and frame-based languages. Journal of ACM, 42:741--843, July 1995. Google ScholarDigital Library
- M. Kifer and E.L. Lozinskii. Implementing logic programs as a database system. In IEEE 3-d Int'l Conference on Data Engineering, pages 375--385, February 1987. Google ScholarDigital Library
- O. Lassila and R.R. Swick (editors). Resource description framework (RDF) model and syntax specification. Technical report, W3C, February 1999. http://www.w3.org/TR/1999/REC-rdf-syntax-19990222/.Google Scholar
- L. Ma, Y. Yang, Z. Qiu, G. Xie, Y. Pan, and S. Liu. Towards a complete OWL ontology benchmark. In European Semantic Web Conference, pages 125--139, 2006. Google ScholarDigital Library
- Openrulebench web site, 2008. http://rulebench.projects.semwebcentral.org.Google Scholar
- Prolog benchmarking, 1985. http://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/lang/prolog/code/bench/0.html.Google Scholar
- T.C. Przymusinski. On the declarative semantics of deductive databases and logic programs. In J. Minker, editor, Foundations of Deductive Databases and Logic Programming, pages 193--216. Morgan Kaufmann, Los Altos, CA, 1988. Google ScholarDigital Library
- Y Sure, S Staab, and J Angele. Ontoedit: Guiding ontology development by methodology and inferencing. In 1st International Conf. on Ontologies, Databases, and Applications of Semantics, 2002. Google ScholarDigital Library
- T. Swift and D.S. Warren. An abstract machine for SLG resolution: Definite programs. In Int'l Logic Programming Symposium, Cambridge, MA, November 1994. MIT Press. Google ScholarDigital Library
- H.J. ter Horst. Combining RDF and part of OWL with rules: Semantics, decidability, complexity. In International Semantic Web Conference (ISWC), pages 668--684, November 2005. Google ScholarDigital Library
- G. Terracina, N. Leone, V. Lio, and C. Panetta. Experimenting with recursive queries in database and logic programming systems. Journal of the Theory and Practice of Logic Programming, 8(2):129--165, 2008. Google ScholarDigital Library
- J.F. Ullman. Principles of Database and Knowledge-Base Systems, Volume 1. Computer Science Press, Rockville, MD, 1988. Google ScholarDigital Library
- A. Van Gelder. The alternating fixpoint of logic programs with negation. Journal of Computer and System Sciences, 47(1):185--221, 1993. Google ScholarDigital Library
- A. Van Gelder, K.A. Ross, and J.S. Schlipf. The well-founded semantics for general logic programs. Journal of ACM, 38(3):620--650, 1991. Google ScholarDigital Library
- D.S. Warren. Memoing for logic programming. Communications of ACM, 35(3):93--111, March 1992. Google ScholarDigital Library
- D.S. Warren. Programming in tabled prolog. Manuscript. http://www.cs.sunysb.edu/ warren/xsbbook/, 1999.Google Scholar
Index Terms
- OpenRuleBench: an analysis of the performance of rule engines
Recommendations
Backward Chaining Ontology Reasoning Systems with Custom Rules
WWW '16 Companion: Proceedings of the 25th International Conference Companion on World Wide WebIn the semantic web, content is tagged with "meaning" or "semantics" to facilitate machine processing and web searching. In general, question answering systems that are built on top of reasoning and inference face a number of difficult issues. In this ...
A performance benchmark over semantic rule checking approaches in construction industry
As more and more architectural design and construction data is represented using the Resource Description Framework (RDF) data model, it makes sense to take advantage of the logical basis of RDF and implement a semantic rule checking process as it is ...
A Testing Framework for OWL-DL Reasoning
SKG '08: Proceedings of the 2008 Fourth International Conference on Semantics, Knowledge and GridOWL and RDF/RDFS are ontological languages developed by the World Wide Web Consortium (W3C), which have become a de facto standard for the ontological descriptions in various domains. The evolution of these standards was influenced by the numerous ...
Comments