Abstract
An important task for annotation of movies is finding out which characters are playing in a shot. Character identification is based on available information sources from various modalities. Fully automatic character identification is not feasible as the modalities are not semantically synchronized. As manual annotation is too time consuming, an interactive tool assisting the annotator is needed. We propose the WhoIsWho function for our interactive i-Notation system.
WhoIsWho relates visual content to names extracted from movie scripts, working in both ways. We present extensive evaluation of character identification on six hours of movies. Employment of a user model enables evaluation of interactivity in WhoIsWho. Quantitative results show that WhoIsWho is successful in helping annotators identify movie characters.
Funded by NWO and supported by the Multimedia Information Analysis project.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
P. J. Jang and A. G. Hauptmann. Learning to recognize speech by watching television. IEEE Intelligent Systems, 14(5):51–58, September/October 1999.
Y. Rui, T. S. Huang, and S. Mehrotra. Constructing table-of-content for videos. Multimedia Systems, Special section on Video Libraries, 7(5):359–368, 1999.
S. Satoh, Y. Nakamura, and Takeo Kanade. Name-it: Naming and detecting faces in news videos. IEEE Multimedia, 6(1):22–35, 1999.
J. Vendrig and M. Worring. Interactive adaptive movie annotation. Technical Report 2002-05, ISIS Group, University of Amsterdam, 2002.
J. Vendrig and M. Worring. Systematic evaluation of logical story unit segmentation. IEEE Transactions on Multimedia, to appear, June, 2002.
J. S. Wachman and R. W. Picard. Tools for browsing a tv situation comedy based on content specific attributes. Multimedia Tools and Applications, 13(3):255–284, March 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Vendrig, J., Worring, M. (2002). Multimodal Person Identification in Movies. In: Lew, M.S., Sebe, N., Eakins, J.P. (eds) Image and Video Retrieval. CIVR 2002. Lecture Notes in Computer Science, vol 2383. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45479-9_19
Download citation
DOI: https://doi.org/10.1007/3-540-45479-9_19
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43899-1
Online ISBN: 978-3-540-45479-3
eBook Packages: Springer Book Archive