Dick C. A. Bulterman
Lynda Hardman
Skip Abstract Section
Abstract
Authoring context sensitive, interactive multimedia presentations is much more complex than authoring either purely audiovisual applications or text. Interactions among media objects need to be described as a set of spatio-temporal relationships that account for synchronous and asynchronous interactions, as well as on-demand linking behavior. This article considers the issues that need to be addressed by an authoring environment. We begin with a partitioning of concerns based on seven classes of authoring problems. We then describe a selection of multimedia authoring environments within four different authoring paradigms: structured, timeline, graph and scripting. We next provide observations and insights into the authoring process and argue that the structured paradigm provides the most useful framework for presentation authoring. We close with an example application of the structured multimedia authoring paradigm in the context of our own structure-based system GRiNS.
- Adobe Systems 2002. Encore 1.5 DVD Editing Software. See: http://www.adobe.com/.Google Scholar
- Baekcer, R., Rosenthal, A. J., Friedlander, N., Smith, E., and cohen, A. 1996. A multimedia system for authoring motion pictures. In Proceedings of the ACM Multimedia '96, (Boston, Mass, Nov), ACM, New York, 31--42. Google Scholar
- Bailey, B., Konstan, J., Cooley, R., and Dejong, M. 1998. Nsync-A toolkit for building interactive multimedia presentations. In Proceedings of the ACM Multimedia '98 (Bristol, UK), ACM, New York, 257--266. Google Scholar
- Buchanan, M. C. and Zellweger, P. T. 2005. Automatic temporal layout mechanisms revisited, ACM Trans. Multimed. Comput. Commun. Appl. 1(1)., 60--88. Google ScholarDigital Library
- Bulterman, D. C. A. 2003. Using SMIL to encode interactive, peer-level multimedia annotations. In Proceedings of the ACM Symposium on Document Engineering 2003 (Grenoble, France, Nov.). ACM, New York, 32--41. Google Scholar
- Bulterman, D. C. A., Hardman, L., Jansen, J., Mullender, K. S., and Rutledge, L. 1997. GRiNS: A graphical interface for SMIL. In Proceedings of WWW-7 (Brisbane, Australia).Google Scholar
- Bulterman, D. C. A., Jansen, J., Kleanthis, K. Blom K., and Benden, D. 2004. The ambulant SMIL 2.0 open source SMIL player. In Proceedings of ACM Multimedia 2004 (New York, N.Y., Oct.). ACM, New York, 492--495. Google Scholar
- Bulterman, D. C. A. and Rutledge, L. 2004. SMIL 2.0: Interactive multimedia for web and mobile devices. Springer-Verlag, Heidelberg, Germany, ISBN: 3-540-20234-X. Google Scholar
- Bulterman, D. C. A., Van Rossum, G., and Van Liere, R., 1991. A structure for transportable, dynamic, multimedia documents. In Proceedings of the Summer USENIX Conference (Nashvile, Tenn.). 137--155.Google Scholar
- Eun, S., No, E. S., Kim, H. C., Yoon, H., and Maeng, S. R. 1994. Eventor: An authoring system for interactive multimedia applications. Multimed. Syst. 2, 129--140. Google ScholarDigital Library
- Falkovych, K., Werner, J., and Nack, F. 2004. Semantic-based support for the semi-atomatic construction of multimedia presentation. Position paper In Proceedings of the 1st International Workshop on Interaction Design and the Semantic Web (New York, N.Y., May).Google Scholar
- Fujikawa, K., Shimojo, S., Matsuura, T., Nishio, S., and Miyahara, H. 1991. Multimedia presentation system ‘harmony’ with temporal and active media. In Proceedings of the Summer 1991 USENIX Conference. (Nashville, Tenn., June). 75--93.Google Scholar
- Hamakawa, R. and Rekimoto, J. 1994. Object composition and playback models for handling multimedia data. Multimed. Syst. 2, 26--35. Google ScholarDigital Library
- Hardman, L. 1998. Modelling and authoring hypermedia documents. Ph.D. dissertation. Univ. Amsterdam. ISBN: 90-74795-93-5. (Available at http://www.cwi.nl/~lynda/thesis/.)Google Scholar
- Hardman, L. and Bulterman, D. C. A. 1995. Authoring support for durable interactive multimedia presentation. In State of the Art Report in Eurographics'95 (Maastricht, The Netherlands, Aug. 29--Sept. 1). (Available at http://ftp.cwi.nl/mmpapers/eg95/pa.gz.)Google Scholar
- Hardman, L., Bulterman, D. C. A., and Van Rossum, G. 1994. The Amsterdam hypermedia model: Adding tune and context to the Dexter model. Commun. ACM 37, 2(Feb.), 50--62. Google ScholarDigital Library
- Hardman, L., Schmitz, P., Van Ossenbruggen, J., Ten Kate, W. R. T., and Rutledge, L. 2000. The link vs. the event: Activating and deactivating elements in time-based hypermedia. In New Rev. Hypermed. Multimed. 6 89--109.Google Scholar
- Hardman, L., Van Rossum G., and Bulterman, D. C. A. 1993. Structured multimedia authoring. In Proceedings of ACM Multimedia '93 (Anaheim, Clif., Aug.). ACM, New York, 283--289. Google Scholar
- Hodges, M. E., Sasnett, R. M., and Ackerman, M. S. 1989. A construction set for multimedia applications. IEEE Soft. (6), 1(Jan.), 37--43. Google Scholar
- Ietf (Internet Engineering Task Force). 1996. Realtime streaming protocol, http://www.cs.columbia.edu/~hgs/rtp/.Google Scholar
- Iso (International Standards Organization). 1999. ISO/IEC 14496:1999 (MPEG-4), Available at: http://wwwam.HHI.DE/mpeg-video/standards/mpeg-4.htm.Google Scholar
- Koegel (Buford), J. F. and Heines, J. M. 1993. Improving visual programming languages for multimedia authoring. In Proceedings of ED-MEDIA '93, World Conference on Educational Multimedia and Hypermedia (Charlottsville, Va, June,) 286--293.Google Scholar
- Koegel (Buford), J. F. (ED.). 1994. Multimedia Systems. Addison-Wesley, New York. ISBN 0-201-53258-1. Google Scholar
- Little, T. D. C. and ghafoor, A. 1990. Multimedia object models for synchronization and databases. In Proceedings of the 6th International Conference on Data Engineering, (Los Angeles, Calif.), pages 20--27. Google Scholar
- Macromedia. 1997. Authorware version 4. Director version 6. See: http://www.macromedia.com/.Google Scholar
- Ogawa, R., Harada, H., and Kaneko, A. 1990. Scenario-based hypermedia: A model and a system. In Proceedings of ECHT '90 (Nov.). INRIA France, 38--51. Google Scholar
- Rubin, B. and Davenport, G. 1989. Structured content modeling for cinematic information. SIGCHI Bull. (Oct.). 21 2, 78--79. Google Scholar
- Siochi, A., Fox, E. A., Hix, D., Schwartz, E. E., Narasimhan, A., and Wake, W. 1991. The integrator: A prototype for flexible development of interactive digital multimedia applications. Interact. Multimed. 2 (3), 5--26.Google Scholar
- Soares, L. F. G., Rodrigues, R., and Muchaluat Saade, D. 2000. Modeling, authoring and formatting hypermedia documents in the HyperProp system, Multimed. Syst. 8 (2). 118--134. Google ScholarDigital Library
- Tien, T. T. and Roisin, C. 2002. A multimedia model based on structured media and sub-elements for complex multimedia authoring and presentation. Internat. J. Softw. Eng. Knowl. Eng. 12 (5), 473--500.Google ScholarCross Ref
- Van Rossum, G. and Drake, F. 2003. A introduction to Python. Network Theory, Ltd. (See also: http://www.python.org/.) Google Scholar
- Van Rossum, G., Jansen, J., Mullender, K. S., and Bulterman, D. C. A. 1993. CMIFed: a presentation environment for portable hypermedia documents. In Proceedings of ACM Multimedia'93 (Anaheim, Calif. Aug.). ACM, New York, 183--188. Google Scholar
- Wam Reasearch Group 2003. The LimSee2 Authoring System for SMIL. See: http://wam.inrialpes.fr/software/limsee2/.Google Scholar
- W3C (World Wide Web Consortium). 2001. Synchronized multimedia integration language, version 2.0.W3C Recommendation. Editors: J. Ayers, D. C. A. Bulterman, A. Cohen, et al., http://www.w3.org/TR/Rec-smil20/.Google Scholar
Index Terms
- Structured multimedia authoring
Recommendations
Beyond Multimedia Authoring: On the Need for Mulsemedia Authoring Tools
The mulsemedia (Multiple Sensorial Media (MulSeMedia)) concept has been explored to provide users with new sensations using other senses beyond sight and hearing. The demand for producing such applications has motivated various studies in the mulsemedia ...
Structured multimedia authoring
MULTIMEDIA '93: Proceedings of the first ACM international conference on MultimediaA collaborative multimedia authoring system based on the conceptual temporal relations
PCM'04: Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part IIWe developed a SMIL-based collaborative multimedia authoring tool supporting a mechanism for conceptually representing the temporal relations between different media. Among the many editors that make up our system, the temporal relation editor provides ...
Comments