Skip to main content
SpringerLink
Log in

Forms and theories of communication: from multimedia to Kansei Mediation

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

In this paper we describe a form of communication that could be used for lifelong learning as contribution to cultural computing. We call it Kansei Mediation. It is a multimedia communication concept that can cope with non-verbal, emotional and Kansei information. We introduce the distinction between the concepts of Kansei Communication and Kansei Media. We then develop a theory of communication (i.e. Kansei Mediation) as a combination of both. Based on recent results from brain research the proposed concept of Kansei Mediation is developed and discussed. The biased preference towards consciousness in established communication theories is critically reviewed and the relationship to pre- and unconscious brain processes explored. There are two tenets of the Kansei Mediation communication theory: (1) communication based on connected unconciousness, and (2) Satori as the ultimate form of experience.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Castells, M.: The Rise of the Network Society. Blackwell, Oxford (1996)

    Google Scholar 

  2. Preece, J.: Online Communities: Designing Usability and Supporting Sociability. Wiley, New York (2000)

    Google Scholar 

  3. Rauterberg, M., Mauch, T., Stebler, R.: The Digital Playing Desk: a case study for augmented reality. In: Proceedings of International Workshop on Robot and Human Communication—ROMAN'96, pp. 410–415. IEEE Press, Piscataway, NJ (1996)

  4. Camurri, A., Ferrentino, P.: Interactive environments for music and multimedia. Multimedia Syst. 7, 32–47 (1999)

    Article  Google Scholar 

  5. Fischer, G.: Lifelong learning and its support with new media. In: Smelser, N.J., Baltes, P.B. (eds.), International Encyclopedia of Social and Behavioral Sciences, vol. 13, pp. 8836–8840. Elsevier, Amsterdam (2001)

    Google Scholar 

  6. Nakatsu, R.: Toward the realization of KANSEI communications. In: Proceedings of the International Conference on Systems, Man, and Cybernetics—IEEE SMC'99, vol. 4, pp. 281–287. Tokyo (1999)

  7. Nagamachi, M.: Kansei Engineering: a new ergonomic consumer-oriented technology for product development. Int. J. Ind. Ergon. 15(1), 311–346 (1995)

    MathSciNet  Google Scholar 

  8. Encarnacao, J.L., Loseries, F., Sifaqui, C.: Human media technology—the human-centered, sustainable technology development. In: Proceedings of the Conference on Computer Graphics International–CGI'98, pp. 132–140. IEEE Computer Society Press, Los Alamitos, CA (1998)

  9. Smith Churchland, P.: Brain-Wise: Studies in Neurophilosophy. MIT Press, Cambridge, MA (2002)

    Google Scholar 

  10. Nakatsu, R.: What is the ultimate form of communication? Artif. Life Robotics 6, 210–214 (2002)

    Article  Google Scholar 

  11. Schulz van Thun, F.: Miteinander Reden: Stoerungen und Klaerungen (Talking with Another: Troubles and Clarifications). Rowohlt, Hamburg (1981)

    Google Scholar 

  12. Inokuchi, S.: Non-verbal interaction for Kansei communication. In: Proceedings of the International Conference on Systems, Man, and Cybernetics–IEEE SMC'99, vol. 4, pp. 311–316. Tokyo (1999)

  13. Tosa, N., Nakatsu, R.: Interactive art for Zen: ‘unconscious flow’. In: Proceedings of International Conference on Information Visualization—IV'00, pp. 535–540. IEEE Computer Society, Los Alamitos, CA (2000)

  14. Salem, B., Rauterberg, M.: Power, death and love: a trilogy for entertainment. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) Entertainment Computing—ICEC 2005. Lect. Notes Comput. Sci. 3711, 279–290 (2005)

  15. Wikipedia (2005) Availabe via http://en.wikipedia.org/wiki/Consciousness

  16. Varela, F.J., Thompson, E., Rosch, E.: The Embodied Mind. MIT Press, Cambridge, MA (1991)

    Google Scholar 

  17. Block, N.: On a confusion about a function of consciousness. Behav. Brain Sci. 18, 269–270 (1995)

    Article  Google Scholar 

  18. Nakatsu, R., Rauterberg, M., Vorderer, P.: A new framework for entertainment computing: from passive to active experience. In: Kishino, F. et al. (eds.) Entertainment Computing—ICEC 2005. Lect. Notes Comput. Sci. 3711, 1–12 (2005)

  19. Maturana, H.R., Varela, F.J.: The Tree of Knowledge. Shambhala, Boston (1992)

    Google Scholar 

  20. Llinas, R.: I of the Vortex: from Neuron to Self. MIT Press, Cambridge, MA (2001)

    Google Scholar 

  21. Baars, B.J.: Treating consciousness as a variable: the fading taboo. In: Baars, B.J., Banks, W.P., Newman, J.B. (eds.) Essential Sources in the Scientific Study of Consciousness. MIT Press, Cambridge, MA (2003)

    Google Scholar 

  22. Rauterberg, M.: Positive effects of entertainment technology on human behaviour. In: Jacquart, R. (ed.) Building the Information Society, pp. 51–58. IFIP, Kluwer Academic Press, Dordrecht, The Netherlands (2004)

    Chapter  Google Scholar 

  23. Rauterberg, M.: Enjoyment and entertainment in East and West. In: Rauterberg, M. (ed.), Entertainment Computing—ICEC 2004. Lect. Notes Comput. Sci. 3166, 176–181 (2004)

  24. Schneider, R.H., Alexander, C.N., Staggers, F., Rainforth, M., Salerno, J.W., Hartz, A., Arndt, S., Barnes, V.A., Nidich, S.I.: Long-term effects of stress reduction on mortality in persons > 55 years of age with systemic hypertension. Am. J. Cardiol. 95(5), 1060–1064 (2005)

    Article  Google Scholar 

  25. Bukkyo Dendo Kyokai: The Teaching of Buddha. BDK, Tokyo (1996)

  26. Blackmore, S.: Consciousness: An Introduction. Hodder & Sloughton, London (2003)

    Google Scholar 

  27. Montaser-Kouhsari, L., Rajimehr, R.: Subliminal attentional modulation in crowding condition. Vision Res. 45(7), 839–844 (2004)

    Article  Google Scholar 

  28. Liddell, B.J., Brown, K.J., Kemp, A.H., Barton, M.J., Das, P., Peduto, A., Gordon, E., Williams, L.M.: A direct brainstem–amygdala–cortical ‘alarm’ system for subliminal signals of fear. Neuroimage 24(1), 235–243 (2005)

    Article  Google Scholar 

  29. Dijksterhuis, A.: I like myself but I don't know why: enhancing implicit self-esteem by subliminal evaluative conditioning. J. Pers. Soc. Psychol. 86(2), 345–355 (2004)

    Article  MathSciNet  Google Scholar 

  30. Epley, N., Savitsky, K., Kachelski, R.A.: What every skeptic should know about subliminal persuasion. Skeptical Inquirer 5, 40–58 (1999)

    Google Scholar 

  31. Merikle, P.M., Smilek, D., Eastwood, J.D.: Perception without awareness: perspectives from cognitive psychology. Cognition 79, 115–134 (2001)

    Article  Google Scholar 

  32. Nolte, J.: The Human Brain: An Introduction to its Functional Anatomy. Mosby, St. Louis, MA (2002)

    Google Scholar 

  33. Rahula, W.S.: What the Buddha Taught. Gordon Fraser, London (1959)

    Google Scholar 

  34. Nakatsu, R., Tosa, N.: Inter communication theatre—towards the realization of interactive movies. In: Proceedings of the International Conference on Multimedia Computing and Systems—ICMCS'97, pp. 519–524. IEEE Computer Society, Los Alamitos, CA (1997)

  35. Nakatsu, R.: Nonverbal information recognition and its application to communications. In: Proceedings of the ACM International Conference on Multimedia: Face/Gesture Recognition and their Applications—MULTIMEDIA'98, pp. 2–9. ACM, New York (1998)

  36. Tosa, N., Matsuoka, S.: Intuitive storytelling interaction: ZENetic computer. In: Rauterberg, M., Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) Proceedings of the INTERACT'03, pp. 997–999. IFIP, IOS Press Amsterdam (The Netherlands) (2003)

  37. Travis, F., Tecce, J., Arenander, A., Wallace, R.K.: Patterns of EEG coherence, power, and contingent negative variation characterize the integration of transcendental and waking states. Biol. Psychol. 61, 293–319 (2002)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Kwansei Gakuin University, 2-1 Gakuen, Sanda, 669-1337, Japan

    Ryohei Nakatsu

  2. Technische Universiteit Eindhoven (TU(e), Den Dolech 2, 5612, Eindhoven, AZ, The Netherlands

    Matthias Rauterberg & Ben Salem

Authors
  1. Ryohei Nakatsu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthias Rauterberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ben Salem
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matthias Rauterberg.

Additional information

Ryohei Nakatsu received the B.S. (1969), M.S. (1971) and Ph.D. (1982) degrees in electronic engineering from Kyoto University. After joining NTT in 1971, he mainly worked on speech recognition technology. He joined ATR (Advanced Telecommunications Research Institute) as the president of ATR Media Integration & Communications Research Laboratories (1994–2002). From the spring of 2002 he is full professor at School of Science and Technology, Kwansei Gakuin University in Sanda (Japan). At the same time he established a venture company, Nirvana Technology Inc., and became the president of the company. In 1978, he received Young Engineer Award from the Institute of Electronics, Information and Communication Engineers Japan (IEICE-J). In 1996, he received the best paper award from the IEEE International Conference on Multimedia. In 1999, 2000 and 2001, he was awarded Telecom System Award from Telecommunication System Foundation and the best paper award from Virtual Reality Society of Japan. In 2000, he got the best paper award from Artificial Intelligence Society of Japan. He is a fellow of the IEEE and the Institute of Electronics, Information and Communication Engineers Japan (IEICE-J), a member of the Acoustical Society of Japan, Information Processing Society of Japan, and Japanese Society for Artificial Intelligence.

Matthias Rauterberg received the B.S. in psychology (1978) at the University of Marburg (Germany), the B.S. in philosophy (1981) and computer science (1983), the M.S. in psychology (1981) and computer science (1985) at the University of Hamburg (Germany), and the Ph.D. in computer science (1995) at the University of Zurich (Switzerland). He was a senior lecturer for ‘usability engineering’ in computer science and industrial engineering at the Swiss Federal Institute of Technology (ETH) in Zurich. He was the head of the Man–Machine Interaction research group (MMI) of the Institute for Hygiene and Applied Physiology (IHA) from the Department of Industrial Engineering at the ETH, Zurich. Since 1998, he is a fulltime professor for ‘human communication technology’ at the Department of Industrial Design at the Technical University Eindhoven (The Netherlands), and also since 2004, he is appointed as a visiting professor at the Kwansei Gakuin University (Japan). He received the German GI-HCI award for the best Ph.D. in 1997 and the Swiss Technology Award together with Martin Bichsel for the BUILD-IT system in 1998. Since 2005, he is elected as a member of the Cream of Science in The Netherlands.

Ben Salem received the Dip.Arch. (1987) at the Ecole Polytechnique d'Architecture et d'Urbanisme EPAU (Algiers), the M.Arch. (1993) at the School of Architectural Studies of the University of Sheffield (UK), and the Ph.D. in electronics (2003) at the Department of Electronic and Electrical Engineering, University of Sheffield (UK). Since 2001, he is director of Polywork Ltd. (UK). Since 2003. he has a PostDoc position at the Department of Industrial Design of the Technical University Eindhoven (The Netherlands).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nakatsu, R., Rauterberg, M. & Salem, B. Forms and theories of communication: from multimedia to Kansei Mediation. Multimedia Systems 11, 304–312 (2006). https://doi.org/10.1007/s00530-005-0006-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-005-0006-9

Keywords

Search

Navigation