Vilmos Zsombori
Michael Frantzis
Rodrigo Laiola Guimaraes
Pablo Cesar
ABSTRACT
This paper introduces an evaluated approach to the automatic generation of video narratives from user generated content gathered in a shared repository. In the context of social events, end-users record video material with their personal cameras and upload the content to a common repository. Video narrative techniques, implemented using Narrative Structure Language (NSL) and ShapeShifting Media, are employed to automatically generate movies recounting the event. Such movies are personalized according to the preferences expressed by each individual end-user, for each individual viewing. This paper describes our prototype narrative system, MyVideos, deployed as a web application, and reports on its evaluation for one specific use case: assembling stories of a school concert by parents, relatives and friends. The evaluations carried out through focus groups, interviews and field trials, in the Netherlands and UK, provided validating results and further insights into this approach.
- Bulterman, Dick C. A. and Rutledge, Lloyd W. 2009. SMIL 3.0: Flexible Multimedia for Web, Mobile Devices and Daisy Talking Books. Springer Publishing Company, Incorporated, ISBN: 978--3--540--78546-0. Google Scholar
Digital Library
- Bocconi, S., Nack, F. and Hardman, L. 2008. Automatic generation of matter-of-opinion video documentaries. Special Issue on Semantic Multimedia, Journal of Web Semantics (JWS), 6(2), pp. 139 -- 150. DOI=http://doi.acm.org/10.1145/1026633.1026636 Google ScholarDigital Library
- Cesar, P., Bulterman, Dick C. A., Guimarães, R. L. and Kegel, I. 2010. Web-Mediated Communication: in Search of Togetherness. In Proceedings of the Web Science Conference (WebSci10), Raleigh, North Carolina, USA.Google Scholar
- Cavazza, M., Champagnat, R., Leonardi, R. and the IRIS Consortium, 2009. The IRIS Network of Excellence: Future Directions in Interactive Storytelling. In Proceedings of the Second International Conference on Interactive Digital Storytelling (ICIDS 2009), Springer LNCS 5915, pp. 8--13. DOI=http://dx.doi.org/10.1007/978--3--642--10643--9_4 Google ScholarDigital Library
- Ibanez, J., Aylett, R., Delgado-Mata, C. and Molinuevo, E. 2009. On the Implications of the Virtual Storyteller's Point of View. The Knowledge Engineering Review, 23(4):339--367. DOI= http://dx.doi.org/10.1017/S0269888908000039 Google ScholarDigital Library
- Kennedy, L. and Naaman, M. 2009. Less talk, more rock: automated organization of community-contributed collections of concert videos. In Proceedings of the 18th international conference on World wide web (WWW '09). ACM, New York, NY, USA, 311--320. DOI=http://doi.acm.org/10.1145/1526709.1526752 Google ScholarDigital Library
- Korchagin, D., Garner, P. N. and Dines, J. 2010. Automatic Temporal Alignment of AV Data with Confidence Estimation. In Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing, Dallas, USA, 2010Google Scholar
- Obrador, P., de Oliveira, R. and Oliver, N. 2010. Supporting personal photo storytelling for social albums. In Proceedings of the international conference on Multimedia (MM '10). ACM, New York, NY, USA, 561--570. DOI=http://doi.acm.org/10.1145/1873951.1874025 Google ScholarDigital Library
- Porteous, J., Benini S., Canini L., Charles, F., Cavazza, M. and Leonardi, R. 2010. Interactive Storytelling via Video Content Recombination. In Proceedings of the 18th ACM International Conference on Multimedia (Short Papers), Firenze, Italy, October 25--29, 2010. DOI=http://dx.doi.org/10.1145/1873951.1874334 Google ScholarDigital Library
- Riedl, M. and Young, R. M. 2006. From Linear Story Generation to Branching Story Graphs, IEEE Journal of Computer Graphics and Applications, May/June: 23--31. DOI= http://doi.ieeecomputersociety.org/10.1109/MCG.2006.56 Google ScholarDigital Library
- Shamma, D. A., Shaw, R., Shafton, P. L. and Liu, Y. 2007. Watch what I watch: using community activity to understand content. In Proceedings of the international workshop on Workshop on multimedia information retrieval (MIR '07). ACM, New York, NY. DOI=http://doi.acm.org/10.1145/1290082.1290120 Google ScholarDigital Library
- Shamma, D. A., Kennedy, L. and Churchill, E. F. 2009. Tweet the Debates: Understanding Community Annotation of Uncollected Sources. In Proceedings of the first SIGMM Workshop on Social Media, pp. 3--10. DOI= http://doi.acm.org/10.1145/1631144.1631148 Google ScholarDigital Library
- Shrestha, P., de With, P. H. N., Weda, H., Barbieri, M. and Aarts, E. H. L. 2010. Automatic mashup generation from multiple-camera concert recordings. In Proceedings of the international conference on Multimedia (MM '10). ACM, New York, NY, USA, 541--550. DOI=http://doi.acm.org/10.1145/1873951.1874023 Google ScholarDigital Library
- Truong, B. T. and Venkatesh, S. 2007. Video abstraction: A systematic review and classification. ACM Trans. Multimedia Comput. Commun. Appl. 3, 1, Article 3. DOI=http://doi.acm.org/10.1145/1198302.1198305 Google ScholarDigital Library
- Ursu, M. F., Kegel, I., Williams, D., Thomas, M., Mayer, H., Zsombori, V., Tuomola M. L., Larsson, H., and Wyver, J. 2008. ShapeShifting TV -- Interactive Screen Media Narratives. Multimedia Systems Journal, Volume 14, Number 2 / July 2008, ACM/Springer, pages 115--132. DOI=http://dx.doi.org/10.1007/s00530-008-0119-zGoogle ScholarDigital Library
- Ursu, M.F., Thomas, M., Kegel, I., Williams, D., Tuomola, M., Lindstedt, I., Wright, T., Leurdijk, A., Zsombori, V., Sussner, J., Maystream, U., and Hall, N., 2008b, Interactive TV Narratives: Opportunities, Progress and Challenges, ACM Transactions on Multimedia Computing, Communications and Applications, 4 (4) : Article 25, pp. 25:1--25:39. Google ScholarDigital Library
- Ursu, M.F., Zsombori, V., Wyver, J., Conrad, L., Kegel, I., and Williams, D., 2009. Interactive Documentaries: A Golden Age, ACM Computers in Entertainment (CiE), Volume 7, Issue 3, Special Issue: TV and Video Entertainment Environments, Section: Production, Interactivity, and Narrative. September 2009 Google ScholarDigital Library
- Williams, D., Ursu, M. F., Cesar, P., Bergstrom, K., Kegel, I. and Meenowa, J. 2009. An emergent role for TV in social communication. In Proceedings of the seventh european conference on European interactive television conference (EuroITV '09). ACM, New York, NY, USA, 19--28. DOI=http://doi.acm.org/10.1145/1542084.1542088 Google ScholarDigital Library
Index Terms
- Automatic generation of video narratives from shared UGC
Recommendations
Interactive video stories from user generated content: a school concert use case
ICIDS'12: Proceedings of the 5th international conference on Interactive StorytellingThis paper describes a web-based narrative system able to generate video compilations, framed as event stories, from a shared repository of video recordings of the event itself and possibly of related events. For this, it employs narrative techniques ...
Interactive documentaries: A Golden Age
SPECIAL ISSUE: TV and Video Entertainment EnvironmentsThis article is motivated by the opportunity presented by recent advances in information and communication technology—particularly by faster broadband connections and faster digital media processing capabilities—for interactive television to extend and ...
Interactive TV narratives: Opportunities, progress, and challenges
This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...
Comments