Abstract
In this paper we present a new approach to the automatic semantic indexing of digital photographs based on the extraction of logic relations from their textual descriptions. The method is based on shallow parsing and propositional analysis of the descriptions using an ontology for the domain of application. We describe the semantic representation formalism, the ontology, and the algorithms involved in the automatic derivation of semantic indexes from texts linked to images. The method has been integrated into the Scene of the Crime Information System, a crime management system for storing, indexing and retrieval of crime information.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
R. Alterman. A Dictionary Based on Concept Coherence. Artificial Intelligence, 25:153–186, 1985.
H. Cunningham, D. Maynard, K. Bontcheva, and V. Tablan. GATE: A framework and graphical development environment for robust NLP tools and applications. In Proceedings of the 40th Anniversary Meeting of the Association for Computational Linguistics, 2002.
R. Gaizauskas and K. Humphreys. XI: A Simple Prolog-based Language for Cross-Classification and Inhetotance. In Proceedings of the 7th International Conference in Artificial Intelligence: Methodology, Systems, Applications, pages 86–95, Sozopol, Bulgaria, 1996.
G. Gazdar and C. Mellish. Natural Language Processing in Prolog. Addison-Wesley, Reading, MA, 1989.
E. Guglielmo and N. Rowe. Natural language retrieval of images based on descriptive captions. ACM Transactions on Information Systems, 14(3):237–267, 1996.
M. Hepple. Independence and commitment: Assumptions for rapid training and execution of rule-based POS taggers. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL-2000), Hong Kong, October 2000.
K. Humphreys, R. Gaizauskas, and H. Cunningham. LaSIE Technical Specifications. Technical report, Department of Computer Science, University of Shefield, 2000.
R. May. Criminal Evidence. Sweet and Maxwell Pbl., 1999.
K. Pastra, H. Saggion, and Y. Wilks. Socis: Scene of crime information system. Technical Report CS-01-19, University of Shefield, 2001.
S. Richardson, W. Dollan, and L. Vanderwende. Mindnet: acquiring and structuring semantic information from text. In Proceedings of COLING, 1998.
T. Rose, D. Elworthy, A. Kotche., and A. Clare. ANVIL: a System for Retrieval of Captioned Images using NLP Techniques. In Proceedings of Challenge of Image Retrieval, Brighton, UK, 2000.
C. Sable and V. Hatzivassiloglou. Text-based approaches for the categorization of images. In Proceedings of ECDL, 1999.
H. Saggion, H. Cunningham, K. Bontcheva, D. Maynard, C. Ursu, O. Hamza, and Y. Wilks. Access to Multimedia Information through Multisource and Multilanguage Information Extraction. In 7th Workshop on Applications of Natural Language to Information Systems (NLDB 2002), Stockholm, Sweden, 2002.
R. Schank and R. Abelson. Scripts, Plans, Goals and Understanding. Lawrence Erlbaum Associates, Publishers, 1977.
R.K. Srihari. Automatic Indexing and Content-Based Retrieval of Captioned Images. Computer, 28(9):49–56, September 1995.
R. Veltkamp and M. Tanase. Content-based image retrieval systems: a survey. Technical Report UU-CS-2000-34, Utrecht University, 2000.
Y. Wilks. A Preferential, Pattern-Seeking, Semantics for Natural Language Inference. Artificial Intelligence, 6:53–74, 1975.
Y. Wilks. Making Preferences More Active. Artificial Intelligence, 11:197–223, 1978.
Y. Wilks, L. Guthrie, and B. Slator. Electric Words. The MIT Press, Cambridge, MA, 1996.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Saggion, H., Pastra, K., Wilks, Y. (2003). Using Natural Language Processing for Semantic Indexing of Scene-of-Crime Photographs. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2003. Lecture Notes in Computer Science, vol 2588. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36456-0_56
Download citation
DOI: https://doi.org/10.1007/3-540-36456-0_56
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-00532-2
Online ISBN: 978-3-540-36456-6
eBook Packages: Springer Book Archive