Abstract
We propose a knowledge representation approach to the semantic retrieval by content of graphics described in Scalable Vector Graphics (SVG), the novel XML based W3C approved standard language for describing two-dimensional graphics.
The approach is based on a description logic devised for the semantic indexing and retrieval of complex objects. We provide a syntax to describe basic shapes, complex objects as compositions of basic ones, and transformations. An extensional semantics, which is compositional, is introduced for defining retrieval, classification, and subsumption services. Algorithms exploiting reasoning services, which are sound with respect to the semantics, are also described.
Using our logical approach as a formal specification, we implemented a prototype system. A set of experiments, carried out on a testbed of SVG documents to assess the retrieval capabilities of the system, is presented.
Similar content being viewed by others
References
M. Aiello, "Computing spatial similarity by games," in AI*IA-01, F. Esposito (Ed.), No. 2175 in Lecture Notes in Artificial Intelligence, Springer-Verlag, 2001, pp. 99–110.
S. Antani, R. Kasturi, and R. Jain, "A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video," Pattern Recognition, Vol. 35, No. 4, pp. 945–965, 2002.
E. Ardizzone, A. Chella, and S. Gaglio,"Hybrid computation and reasoning for artificial vision," in Artificial Vision, Academic Press, V. Cantoni, S. Levialdi, and V. Roberto (Eds.), 1997, pp. 193–221.
F. Baader and P. Hanschke, "A schema for integrating concrete domains into concept languages," in Proceedings of the Twelfth International Joint Conference on Artificial Intelligence (IJCAI91), Sydney, 1991, pp. 452–457.
E. Bertino and B. Catania, "A constraint-based approach to shape m anagement in multimedia databases," MultiMedia Systems, Vol. 6, pp. 2–16, 1998.
P. Bollmann, F. Jochum, U. Reiner, V. Weissmann, and H. Zuse, "The LIVEproject-retrieval experiments based on evaluation viewpoints," in SIGIR-85, ACM New York, 1985, pp. 213–214.
A. Borgida, "Description logics in data management," IEEETransactions onKnowledge and Data Engineering, Vol. 7, No. 5, pp. 671–682, 1995.
R. Brooks, "Symbolic reasoning among 3-D models and 2-D images," Artificial Intelligence, Vol. 17, pp. 285–348, 1981.
D. Cardoze and L. Schulman, "Pattern matching for spatial point sets," in Proceedings of the Thirtyninth Annual Symposium on the Foundations of Computer Science (FOCS98), Palo Alto, CA, 1998, pp. 156–165.
A. Celentano and E. Di Sciascio, "Features integration and relevance feedback analysis in image similarity evaluation," Journal of Electronic Imaging, Vol. 7, No. 2, pp. 308–317, 1998.
S. Chang, Q. Shi, and C. Yan, "Iconic indexing by 2D strings," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 9, No. 3, pp. 413–428, 1983.
L. Chew, M. Goodrich, D. Huttenlocher, K. Kedem, J. Kleinberg, and D. Kravets, "Geometric pattern matching under euclidean motion," Computational Geometry, Vol. 7, pp. 113–124, 1997.
I. Cox, M. Miller, T. Minka, and T. Papathomas, "The bayesian image retrieval system, picHunter," IEEE Transactions on Image Processing, Vol. 9, No. 1, pp. 20–37, 2000.
A. Del Bimbo, "Visual Information Retrieval, Morgan Kaufmann ed., 1999.
E. Di Sciascio, F. Donini, and M. Mongiello, "Spatial layout representation for query by sketch content based image retrieval," Pattern Recognition Letters, Vol. 23, No. 13, pp. 1599–1612, 2002a.
E. Di Sciascio, F. Donini, and M. Mongiello, "Structured knowledge representation for image retrieval," Journal of Artificial Intelligence Research, Vol. 16, pp. 209–257, 2002b.
E. Di Sciascio and M. Mongiello, "Query by sketch and relevance feedback for content-based image retrieval over the Web," Journal of Visual Languages and Computing, Vol. 10, No. 6, pp. 565–584, 1999.
F. Donini, M. Lenzerini, D. Nardi, and A. Schaerf, "Reasoning in description logics," in Foundations of Knowledge Representation, G. Brewka (Ed.) CSLI-Publications, 1996, pp. 191–236.
S. Edelmann, Representation and Recognition in Vision, The MIT Press, 1999.
E. El-Kwae and M. Kabuka, "A robust framework for content-based retrieval by spatial similarity in image databases," ACM Transactions on Information Systems, Vol. 17, No. 2, pp. 174–198, 1999.
N. Fuhr, N. GÖvert, and T. RÖlleke, "DOLORES: A system for logic-based retrieval of multimedia objects," in Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Developement in Information Retrieval (SIGIR 98), Melbourne, Australia, 1998, pp. 257–265.
V. Gudivada, "?R-String: A geometry-based representation for Efficient and effiective retrieval of images by spatial similarity," IEEE Transactions on Knowledge and Data Engineering, Vol. 10, No. 3, pp. 504–512, 1998.
V. Gudivada and J. Raghavan, "Design and eevaluation of algorithms for image retrieval by spatial similarity," ACM Transactions on Information Systems, Vol. 13, No. 2, pp. 115–144, 1995.
V. H aarslev, C. Lutz, and R. MÖeller, "Foundations of spatioterminological reasoning with description logics," in Proceedings of the Sixth International Conference on Principles of Knowledge Representation and Reasoning (KR'98), 1998, pp. 112–123.
M.-S. Hacid and C. Rigotti, "Representing and reasoning on conceptual queries over image databases," in Proceedings of the Twelfth International Symposium on Methodologies for Intelligent Systems (ISMIS99), Springer-Verlag: Warsaw, Poland, 1999, pp. 340–348.
J. Hartman and J. Wernecke, The VRML 2.0 Handbook, Addison-Wesley, 1996.
D. Marr, Vision, W.H. Freeman and Co., Oxford, 1982.
C. Meghini, F. Sebastiani, and U. Straccia, "A model of multimedia information retrieval," Journal of the ACM, Vol. 48, No. 5, pp. 909–970, 2001.
R. Moeller, B. Neumann, and M. Wessel, "Towards computer vision with description logics: Some recent progress," in Proceedings of the IEEE Integration of Speech and Image Understanding, 1999, pp. 101–115.
B. Nebel, Reasoning and Revision in Hybrid Representation Systems, No. 422 in Lecture Notes in Artificial Intelligence, Springer-Verlag, 1990.
R. Reiter and A. Mackworth, "A logical framework for depiction and image interpretation," Artificial Intelligence, Vol. 41, No. 2, pp. 125–155, 1989.
Y. Rui, T. Huang, and S. Mehrotra, "Content-based image retrieval with relevance feedback in MARS," in Proceedings of the IEEE International Conference on Image Processing (ICIP'97), 1997, pp. 815–818.
A. Sanfeliu and K. Fu, "A distance measure between attributed relational graphs for pattern recognition," IEEE Transactions on Systems, Man, and Cybernetics, Vol. 13, No. 3, pp. 353–362, 1983.
Scalable Vector Graphics Specification, http://www.w3.org/TR/SVG/. 2001.
U. Straccia, "Reasoning within fuzzy description logics," Journal of Artificial Intelligence Research, Vol. 14, pp. 137–166, 2001.
H. Tagare, F. Vos, C. Jaffe, and J. Duncan, "Arrangement: A spatial relation between parts for evaluating similarity of tomographic Section," IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 9, pp. 880–893, 1995.
J.D. U llman, Principles of Database and Knowledge Base Systems, Vol. 1. Computer Science Press: Potomac, Maryland, 1988.
W.A. Woods and J.G. Schmolze, "The KL-ONE family," in Semantic Networks in Artificial Intelligence, F.W. Lehmann (Ed.), Pergamon Press, 1992, pp. 133-178. Published as a special issue of Computers & Mathematics with Applications, Vol. 23, No. 2-9.
J. Yen, "Generalizing term subsumption languages to fuzzy logic," in Proceedings of the Twelfth International Joint Conference on Artificial Intelligence (IJCAI'91), 1991, pp. 472–477.
L. Zadeh, "Fuzzy sets," Information and Control, Vol. 8, pp. 338–353, 1965.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Di Sciascio, E., Donini, F.M. & Mongiello, M. A Logic for SVG Documents Query and Retrieval. Multimedia Tools and Applications 24, 125–153 (2004). https://doi.org/10.1023/B:MTAP.0000036840.61778.04
Issue Date:
DOI: https://doi.org/10.1023/B:MTAP.0000036840.61778.04