Rene Kaiser
ABSTRACT
This thesis investigates several aspects of Virtual Director technology, i.e. software capable of intelligent real-time selection of live media streams. It addresses several research questions in this interdisciplinary field with respect to how a generic Virtual Director framework can be constructed, and how its behavior can be modeled and formalized to realize professional applications with many parallel users within real-time constraints. Prototypes have been built for the applications of group videoconferencing and live event broadcast. The engine executes cinematic principles aiming to enhance the user experience. In group videoconferencing, a Virtual Director aims to support communication goals by selecting from multiple available streams, i.e. automating cuts between shots according to the communication situation. In event broadcast, it enables personalization by framing, animating and cutting virtual camera views as cropping from a high-resolution panorama. While the technical approach and framework has been evaluated in lab experiments, further evaluation involving potential users and cinematic professionals is ongoing.
- F. Chen, D. Delannay, and C. De Vleeschouwer. An autonomous framework to produce and distribute personalized team-sport video summaries: A basketball case study. IEEE Transactions on Multimedia, 13(6):1381--1394, 2011. Google Scholar
Digital Library
- F. Daniyal and A. Cavallaro. Multi-camera scheduling for video production. In In Proceedings of the 9th European Conference on Visual Media Production, pages 11--20, 2011. Google ScholarDigital Library
- O. Etzion and P. Niblett. Event Processing in Action. Number ISBN: 9781935182214. Manning, 2010. Google ScholarDigital Library
- M. Falelakis, M. Groen, M. Frantzis, R. Kaiser, and M. Ursu. Automatic orchestration of video streams to enhance group communication. In SAM'12 Workshop at ACM MM, pages 25--30. ACM, 2012. Google ScholarDigital Library
- M. Falelakis, R. Kaiser, W. Weiss, and M. Ursu. Reasoning for video-mediated group communication. In ICME, 2011. Google ScholarDigital Library
- M. Groen, M. Ursu, S. Michalakopoulos, M. Falelakis, and E. Gasparis. Improving video-mediated communication with orchestration. Computers in Human Behavior, 28(5):1575 -- 1579, 2012. Google ScholarDigital Library
- Y.-G. Jiang, S. Bhattacharya, S.-F. Chang, and M. Shah. High-level event recognition in unconstrained videos. International Journal of Multimedia Information Retrieval, pages 1--29, 2012.Google Scholar
- R. Kaiser, M. Thaler, A. Kriechbaum, H. Fassold, W. Bailer, and J. Rosner. Real-time person tracking in high-resolution panoramic video for automated broadcast production. In CVMP, pages 21--29, London, UK, 2011. Google ScholarDigital Library
- R. Kaiser, C. Wagner, M. Hoeffernig, and H. Mayer. The interaction ontology model: supporting the virtual director orchestrating real-time group interaction. In MMM'11, pages 263--273, Berlin, Heidelberg, 2011. Springer-Verlag. Google ScholarDigital Library
- R. Kaiser, W. Weiss, M. Falelakis, S. Michalakopoulos, and M. F. Ursu. A rule-based virtual director enhancing group communication. ICME'12 Workshops, pages 187--192, 2012. Google ScholarDigital Library
- R. Kaiser, W. Weiss, and G. Kienast. The Fascinate Production Scripting Engine. In MMM'12, pages 682--692, Berlin, Heidelberg, 2012. Springer-Verlag. Google ScholarDigital Library
- A. Maimone, J. Bidwell, K. Peng, and H. Fuchs. Enhanced personal autostereoscopic telepresence system using commodity depth cameras. Computers & Graphics, 36(7):791--807, 2012. Google ScholarDigital Library
- O. A. Niamut, R. Kaiser, G. Kienast, A. Kochale, J. Spille, and O. Schreer. Towards a format-agnostic approach for production, delivery and rendering of immersive media. In ACM MMSys'13, Oslo, Norway, 2013. Google ScholarDigital Library
- C. Patrikakis, N. Papaoulakis, P. Papageorgiou, A. Pnevmatikakis, P. Chippendale, M. Nunes, R. Cruz, S. Poslad, and Z. Wang. Personalized coverage of large athletic events. IEEE MultiMedia, 18(4):18--29, 2011. Google ScholarDigital Library
- L. A. Rowe and V. Casalaina. Capturing conference presentations. IEEE MultiMedia, 13(4):76--84, 2006. Google ScholarDigital Library
- J. Schantl, C. Wagner, R. Kaiser, and M. Strohmaier. The utility of social and topical factors in anticipating repliers in twitter conversations. In WebSci, 2013. Google ScholarDigital Library
- O. Schreer, I. Feldmann, C. Weissig, P. Kauff, and R. Schäfer. Ultrahigh-resolution panoramic imaging for format-agnostic video production. Proceedings of the IEEE, 101(1):99--114, 2013.Google ScholarCross Ref
- M. Ursu, M. Groen, M. Falelakis, M. Frantzis, V. Zsombori, and R. Kaiser. Orchestration: Tv-like mixing grammars applied to video-communication for social groups. In ACM MM'13, New York, NY, USA, 2013. ACM. Google ScholarDigital Library
- M. Ursu, P. Torres, V. Zsombori, M. Franztis, and R. Kaiser. Socialising through orchestrated video communication. In ACM MM'11, pages 981--984, New York, NY, USA, 2011. ACM. Google ScholarDigital Library
- P. N. Y. Wang and M. Kankanhalli. Multi-camera skype: Enhancing the quality of experience of video conferencing. In PCM'11, pages 193--202, 2011.Google Scholar
- B. Yu. MyView: Customizable Automatic Visual Space Management for Multi-Stream Environment. PhD thesis, University of Illinois at Urbana-Champaign, 2006. Google ScholarDigital Library
Index Terms
- Virtual director technology for social video communication and live event broadcast production
Recommendations
XRStudio: A Virtual Production and Live Streaming System for Immersive Instructional Experiences
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsThere is increased interest in using virtual reality in education, but it often remains an isolated experience that is difficult to integrate into current instructional experiences. In this work, we adapt virtual production techniques from filmmaking to ...
ESL Live broadcast teaching service in a university library
APIT '19: Proceedings of the 2019 Asia Pacific Information Technology ConferenceThe application of live broadcasting has caught attention in a wide variety of learning contexts in recent years. In higher education, university plays a very important role in teaching enhancement. Live broadcast media provide a platform for the ...
A Rule-Based Virtual Director Enhancing Group Communication
ICMEW '12: Proceedings of the 2012 IEEE International Conference on Multimedia and Expo WorkshopsAudiovisual group communication systems deal with a large number of video streams, and, unlike less advanced videoconferencing systems, require intelligence for selecting adequate views for each of the connected rooms, in order to convey best what is ...
Comments