Skip to main content
SpringerLink
Log in

Developing Knowledge-Based Intelligent Multimedia Tutoring Systems Using Semantic Content-Based Modelling

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

The complex nature of semantic video and audio content has made multimedia difficult to use within the traditional architecture of a knowledge-based intelligent tutoring system (ITS). This paper investigates how multimedia syntax and semantics may be integrated into the confines of the knowledge-based ITS architecture so as to develop a knowledge-based intelligent multimedia tutoring system (IMTS). The paper contributes a semantic content-based model that can be used for this purpose. Multimedia frames (m-frames) are used as the framework by which the syntactic and semantic information is represented within the model. The paper discusses how IMTSs may be developed using the model, and then demonstrates the use of our approach in the development of ARISTOTLE, an IMTS for teaching young children basic zoology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adah, S., Candan, K.S., Chen, S.-S., Erol, K. & Subrahmanian, V.S. (1996). The Advanced Video Information System: Data Structures and Query Processing. Multimedia Systems (August) 4(4): 172-186.

    Google Scholar 

  • Agius, H.W. & Angelides, M. C. (1997). Integrating Logical Video and Audio Segments with Content-related Information in Instructional Multimedia Systems. Information and Software Technology 39(10): 679-694.

    Google Scholar 

  • Aguierre Smith, T.G. & Davenport, G. (1992). The Stratification System: A Design Environment for Random Access Video. In Proceedings of the Third International Workshop on Network and Operating Systems Support for Digital Audio and Video, 250-261. Springer-Verlag: New York, NY.

    Google Scholar 

  • Aigrain, P., Zhang, H.J. & Petkovic, D. (1996). Content-based Representation and Retrieval of Visual Media: A State-of-the-Art Review. Multimedia Tools and Applications (November) 3(3): 179-202.

    Google Scholar 

  • Angelides, M.C. (1995). Developing Hybrid Intelligent Tutoring and Hypertext Systems. The New Review of Hypermedia and Multimedia 1: 67-106.

    Google Scholar 

  • Angelides, M.C. & Dustdar, S. (1997). Multimedia Information Systems. Kluwer Academic Publishers: Boston, MA.

    Google Scholar 

  • Barber, R., Equitz, W., Faloutsos, C., Flickner, M., Niblack, W., Petkovic, D. & Yanker, P. (1995). Query by Content for Large On-line Image Collections. In Furht, B. & Milenkovic, M. (eds.) A Guided Tour of Multimedia Systems and Applications, 357-378. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • Brand, S. (1988). The Media Lab: Inventing the Future at MIT. Penguin Books: New York, NY.

    Google Scholar 

  • Brink, A., Marcus, S. & Subrahmanian, V.S. (1995). Heterogenous Multimedia Reasoning. Computer (September) 28(9): 33-39.

    Google Scholar 

  • Burrill, V., Kirste, T. & Weiss, J. (1994). Time-varying Sensitive Regions in Dynamic Multimedia Objects: A Pragmatic Approach to Content-based Retrieval from Video. Information and Software Technology (April) 36(4): 213-223.

    Google Scholar 

  • Christel, M., Kanade, T., Mauldin, M., Reddy, R., Sirbu, M., Stevens, S. & Wactlar, H. (1995). Informedia Digital Video Library. Communications of the ACM (April) 38(4): 57-58.

    Google Scholar 

  • Csinger, A., Booth, K.S. & Poole, D. (1995). AI Meets Authoring: User Models for Intelligent Multimedia. Artificial Intelligence Review 8(5/6): 447-468.

    Google Scholar 

  • Davis, M. (1993). Media Streams: An Iconic Visual Language for Video Annotation. In Proceedings of the IEEE Symposium on Visual Languages, Bergen, 196-202. IEEE Computer Society Press: Los Alamitos, CA.

    Google Scholar 

  • Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D. & Yanker, P. (1995). Query by Image and Video Content: The QBIC System. Computer (September) 28(9): 23-32.

    Google Scholar 

  • Goodman, B.A. (1993). Multimedia Explanations for Intelligent Training Systems. In Maybury, M.T. (ed.) Intelligent Multimedia Interfaces, 148-171. The AAAI Press/The MIT Press: Menlo Park, CA.

    Google Scholar 

  • Hirzalla, N., Falchuk, B. & Karmouch, A. (1995). A Temporal Model for Interactive Multimedia Scenarios. IEEE MultiMedia (Fall) 2(3): 24-31.

    Google Scholar 

  • Kanade, T. (1996). Immersion into Visual Media: New Applications of Image Understanding. IEEE Expert (February) 11(1): 73-80.

    Google Scholar 

  • Lee, J.C.-M., Li, Q. & Xiong, W. (1997). VIMS: A Video Information Management System. Multimedia Tools and Applications (January) 4(1): 7-28.

    Google Scholar 

  • Little, T.D.C., Ahanger, G., Chen, H.-J., Folz, R.J., Gibbon, J.F., Krishnamurthy, A., Lumba, P., Ramanathan, M. & Venkatesh, D. (1995). Selection and Dissemination of Digital Video Via the Virtual Video Browser. Multimedia Tools and Applications (June) 1(2): 149-172.

    Google Scholar 

  • Little, T.D.C., Ahanger, G., Folz, R.J., Gibbon, J.F., Reeve, F.W., Shelleng, D.H. & Venkatesh, D. (1993). A Digital Video-on-demand Service Supporting Content-based Queries. In Proceedings of the First ACM International Conference on Multimedia, Anaheim, CA, August, 427-436. ACM Press: New York, NY.

    Google Scholar 

  • Mackay, W.E. (1989). EVA: An Experiment Video Annotator for Symbolic Analysis of Video Data. SIGCHI Bulletin (October) 21(1): 68-71.

    Google Scholar 

  • Mackay, W.E. & Davenport, G. (1989). Virtual Video Editing in Interactive Multimedia Applications. Communications of the ACM (July) 32(7): 802-810.

    Google Scholar 

  • Oomoto, E. & Tanaka, K. (1993). OVID: Design and Implementation of a Video-object Database System. IEEE Transactions on Knowledge and Data Engineering (August) 5(4): 629-643. (Reprinted in: Furht, B. and Milenkovic, M. (eds.) (1995) A Guided Tour of Multimedia Systems and Applications, 323–337. IEEE Computer Society Press: Los Alamitos, CA.)

    Google Scholar 

  • Parkes, A.P. (1988). CLORIS: A Prototype Video-Based Intelligent Computer-assisted Instruction System. In Proceeding of RIAO '88, 24-50.

  • Parkes, A.P. & Self, J.A. (1990). Towards 'Interactive Video': A Video-Based Intelligent Tutoring Environment. In Frasson, C. & Gauthier, G. (eds.) Intelligent Tutoring Systems: At the Crossroad of Artificial Intelligence and Education, 56-82. Ablex Publishing Corporation, Norwood, NJ.

    Google Scholar 

  • Price, R.J. (1991). Multimedia Information Systems. In Waterworth, J.A. (ed.) Multimedia: Technology and Applications, 114-150. Ellis Horwood: New York, NY.

    Google Scholar 

  • Siemer, J. & Angelides, M.C. (1998a). A Comprehensive Method for the Evaluation of Complete Intelligent Tutoring Systems. Decision Support Systems 22(1): 85-102.

    Google Scholar 

  • Siemer, J. & Angelides, M.C. (1998b). Towards an Intelligent Tutoring System Architecture that Supports Remedial Tutoring. Artificial Intelligence Review, forthcoming.

  • Smoliar, S.W. & Zhang, H.J. (1994). Content-based Video Indexing and Retrieval. IEEE MultiMedia (Summer) 1(2): 62-72.

    Google Scholar 

  • Swanberg, D., Shu, C.-F. & Jain, R. (1992). Architecture of a Multimedia Information System for Content-based Retrieval. In Proceedings of the Third International Workshop on Network and Operating Systems Support for Digital Audio and Video, 387-392. Springer-Verlag: Berlin.

    Google Scholar 

  • Tanaka, Y. (1996a). IntelligentPad as Meme Media and its Application to Multimedia Databases. Information and Software Technology (March) 38(3): 201-211.

    Google Scholar 

  • Tanaka, Y. (1996b). Meme Media and a World-wide Meme Pool. In ACM Multimedia '96 Proceedings. Proceedings of the Fourth ACM International Multimedia Conference, Boston, MA, 18–22 November, 175-186. ACM Press/Addison-Wesley: New York, NY.

    Google Scholar 

  • Tonomura, Y., Akutsu, A., Taniguchi, Y. & Suzuki, G. (1994). Structured Video Computing. IEEE MultiMedia (Fall) 1(3): 34-43.

    Google Scholar 

  • Triebwasser, M.A. (1994). Multimedia: Digital Video in the Social Sciences — A Brief Tutorial on an Emerging Technology. Social Science Computer Review (Winter) 12(4): 543-559.

    Google Scholar 

  • Wactlar, H D., Kanade, T., Smith, M.A. & Stevens, S.M. (1996). Intelligent Access to Digital Video: Informedia Project. Computer (May) 29(5): 46-52.

    Google Scholar 

  • Weiss, R., Duda, A. & Gifford, D.K. (1995). Composition and Search with a Video Algebra. IEEE MultiMedia (Spring) 2(1): 12-25.

    Google Scholar 

  • Woolf, B.P. (1996). Intelligent Multimedia Tutoring Systems. Communications of the ACM (April) 39(4): 30-31.

    Google Scholar 

  • Woolf, B.P. & Hall, W. (1995). Multimedia Pedagogues: Interactive Systems for Teaching and Learning. Computer (May) 28(5): 74-80.

    Google Scholar 

  • Yoshitaka, A., Kishida, S., Hirakawa, M. & Ichikawa, T. (1994). Knowledge-assisted Content-based Retrieval for Multimedia Databases. IEEE MultiMedia (Winter) 1(4): 12-21.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Multimedia, School of Computing, Information Systems and Mathematics, South Bank University, 103 Borough Road, London, SE1 0AA, UK

    Harry W. Agius & Marios C. Angelides

Authors
  1. Harry W. Agius
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marios C. Angelides
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Agius, H.W., Angelides, M.C. Developing Knowledge-Based Intelligent Multimedia Tutoring Systems Using Semantic Content-Based Modelling. Artificial Intelligence Review 13, 55–83 (1999). https://doi.org/10.1023/A:1006569626086

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1006569626086

Search

Navigation