Andrew Salway
ABSTRACT
We present a method being developed to extract information about characters' emotions in films. It is suggested that this information can help describe higher levels of multimedia semantics relating to narrative structures. Our method extracts information from audio description that is provided for the visually-impaired with an increasing number of films. The method is based on a cognitive theory of emotions that links a character's emotional states to the events in their environment. In this paper the method is described along with some preliminary evaluation and discussions about the kinds of novel video retrieval and browsing applications it may support.
- Allen, R. B. and Acheson, J. Browsing the Structure of Multimedia Stories. In Procs. 5th ACM Conference on Digital Libraries, 11--18. ACM Press, New York, 2000. Google Scholar
Digital Library
- Bordwell, D. and Thompson, K. Film Art: An Introduction. McGraw-Hill 5th Edition, New York, 1997.Google Scholar
- Dorai, C. and Venkatesh, S. Computational Media Aesthetics: Finding Meaning Beautiful! IEEE Multimedia 8(4), 10--12, (Oct.-Dec. 2001). Google ScholarDigital Library
- Ortony A., Clore G. L. and Collins A. The Cognitive Structure of Emotions. Cambridge University Press, 1988.Google ScholarCross Ref
- Roth, V. Content-based retrieval from digital video. Image and Vision Computing 17, 531--540 (1999).Google ScholarCross Ref
- Salway, A., Graham, M., Tomadaki, E. and Xu, Y. Integrating Video and Text via Representations of Narrative. In Procs. AAAI Spring Symposium 2003, Intelligent Multimedia Knowledge Management.Google Scholar
- TIWO - Television in Words, EPSRC research project, www.computing.surrey.ac.uk/ckm/tiwo_project/Index.html <http://www.computing.surrey.ac.uk/ckm/tiwo_project/Index.html>Google Scholar
- WordNet - online lexical reference system, <http://www.cogsci.princeton.edu/~wn/>Google Scholar
Index Terms
- Extracting information about emotions in films
Recommendations
Electrical properties of Carbon Nitride thin films: role of morphology and Hydrogen content
The influence of hydrogen content and ambient humidity on the electrical properties of carbon nitride (CNx) films deposited by reactive magnetron sputtering from a graphite target in Ar discharges mixed with N2 and H2 at a substrate temperature of 350°C ...
Sharing emotions: determining films’ evoked emotional experience from their online reviews
AbstractOnline reviews are broadly believed to reflect consumers’ opinions towards the reviewed items. In this work, we postulate that online reviews for experience goods also reflect something very different, the reviewer’s emotions while experiencing ...
Associating characters with events in films
CIVR '07: Proceedings of the 6th ACM international conference on Image and video retrievalThe work presented here combines the analysis of a film's audiovisual features with the analysis of an accompanying audio description. Specifically, we describe a technique for semantic-based indexing of feature films that associates character names ...
Comments