Abstract
We explore the expression of personality and adaptivity through the gestures of virtual agents in a storytelling task. We conduct two experiments using four different dialogic stories. We manipulate agent personality on the extraversion scale, whether the agents adapt to one another in their gestural performance and agent gender. Our results show that subjects are able to perceive the intended variation in extraversion between different virtual agents, independently of the story they are telling and the gender of the agent. A second study shows that subjects also prefer adaptive to nonadaptive virtual agents.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Nisbett, R.E.: The trait construct in lay and professional psychology. In: Retrospections on Social Psychology, pp. 109–130 (1980)
Mehl, M.R., Gosling, S.D., Pennebaker, J.W.: Personality in its natural habitat: manifestations and implicit folk theories of personality in daily life. J. Pers. Soc. Psychol. 90, 862–877 (2006)
Norman, W.T.: Toward an adequate taxonomy of personality attributes: replicated factor structure in peer nomination personality rating. J. Abnorm. Soc. Psychol. 66, 574–583 (1963)
Bickmore, T., Schulman, D.: The comforting presence of relational agents. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 550–555. ACM (2006)
Hartmann, B., Mancini, M., Pelachaud, C.: Implementing expressive gesture synthesis for embodied conversational agents. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, pp. 188–199. Springer, Heidelberg (2006)
Kopp, S., Wachsmuth, I.: Synthesizing multimodal utterances for conversational agents. Comput. Anim. Virtual Worlds 15, 39–52 (2004)
Thiebaux, M., Marshall, A., Marsella, S., Kallman, M.: Smartbody: behavior realization for embodied conversational agents. In: Proceedings of 7th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2008), pp. 151–158 (2008)
Heloir, A., Kipp, M.: EMBR – a realtime animation engine for interactive embodied agents. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 393–404. Springer, Heidelberg (2009)
André, E., Klesen, M., Gebhard, P., Allen, S., Rist, T.: Integrating models of personality and emotions into lifelike characters. In: Paiva, A.C.R. (ed.) IWAI 1999. LNCS, vol. 1814, pp. 150–165. Springer, Heidelberg (2000)
Ruttkay, Z., Dormann, C., Noot, H.: Embodied conversational agents on a common ground. In: From Brows to Trust: Evaluating Embodied Conversational Agents, chap. 2, pp. 27–66. Kluwer Academic Publishers, Norwell (2004)
Moon, Y., Nass, C.: How “real” are computer personalities?: Psychological responses to personality types in human-computer interaction. Commun. Res. 23(6), 651–674 (1996)
Endraß, B., André, E., Rehm, M., Nakano, Y.I.: Investigating culture-related aspects of behavior for virtual characters. Auton. Agent. Multi-Agent Syst. 27(2), 277–304 (2013)
Noma, T., Badler, N.I., Zhao, L.: Design of a virtual human presenter. Center for Human Modeling and Simulation, p. 75 (2000)
Tapus, A., Tapus, C., Mataric, M.J.: User robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy. Intel. Serv. Robot. 1(2), 169–183 (2008)
Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., Collins, H.: The politeness effect: pedagogical agents and learning gains. Front. Artif. Intell. Appl. 125, 686–693 (2005)
Mairesse, F., Walker, M.A.: Controlling user perceptions of linguistic style: trainable generation of personality traits. Comput. Linguist. 37(3), 455–488 (2011)
Neff, M., Wang, Y., Abbott, R., Walker, M.: Evaluating the effect of gesture and language on personality perception in conversational agents. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 222–235. Springer, Heidelberg (2010)
Bee, N., Pollock, C., André, E., Walker, M.: Bossy or wimpy: expressing social dominance by combining gaze and linguistic behaviors. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 265–271. Springer, Heidelberg (2010)
Neff, M., Toothman, N., Bowmani, R., Fox Tree, J.E., Walker, M.A.: Don’t scratch! self-adaptors reflect emotional stability. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS, vol. 6895, pp. 398–411. Springer, Heidelberg (2011)
Fox Tree, J.E.: Listening in on monologues and dialogues. Discourse Process. 27, 35–53 (1999)
Parrill, F., Kimbara, I.: Seeing and hearing double: the influence of mimicry in speech and gesture on observers. J. Nonverbal Behav. 30, 157–166 (2006)
Bailenson, J.N., Yee, N.: Digital chameleons: automatic assimilation of nonverbal gestures in immersive virtual environments. Psychol. Sci. 16(10), 814–819 (2005)
Tolins, J., Fox Tree, J.E.: Addressee backchannels steer narrative development. J. Pragmat. 70, 152–164 (2014)
Thorne, A., Korobov, N., Morgan, E.M.: Channeling identity: a study of storytelling in conversations between introverted and extraverted friends. J. Res. Pers. 41(5), 1008–1031 (2007)
Gordon, A., Swanson, R.: Identifying personal stories in millions of weblog entries. In: 3rd International Conference on Weblogs and Social Media, Data Challenge Workshop, San Jose, CA (2009)
Kita, S., van Gijn, I., van der Hulst, H.: Movement phases in signs and co-speech gestures, and their transcription by human coders. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS (LNAI), vol. 1371, p. 23. Springer, Heidelberg (1998)
Wang, Y., Neff, M.: The influence of prosody on the requirements for gesture-text alignment. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 180–188. Springer, Heidelberg (2013)
Tolins, J., Liu, K., Wang, Y., Tree, J.E.F., Walker, M., Neff, M.: Gestural adaptation in extravert-introvert pairs and implications for IVAs. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, p. 484. Springer, Heidelberg (2013)
Luo, P., Kipp, M., Neff, M.: Augmenting gesture animation with motion capture data to provide full-body engagement. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 405–417. Springer, Heidelberg (2009)
Gosling, S.D., Rentfrow, P.J., Swann, W.B.: A very brief measure of the big five personality domains. J. Res. Pers. 37, 504–528 (2003)
Liu, K., Tolins, J., Tree, J.E.F., Walker, M., Neff, M.: Judging IVA personality using an open-ended question. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013. LNCS, vol. 8108, pp. 396–405. Springer, Heidelberg (2013)
Buschmeier, H., Bergmann, K., Kopp, S.: An alignment-capable microplanner for natural language generation. In: Proceedings of the 12th European Workshop on Natural Language Generation, pp. 82–89. ACL (2009)
Hu, Z., Halberg, G., Jimenez, C., Walker, M.: Entrainment in pedestrian direction giving: how many kinds of entrainment? In: IWSDS (2014)
Bergmann, K., Kopp, S.: Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks. In: Proceedings of the 8th International Conference on Autonomous Agents and Multiagent Systems, vol. 1, pp. 361–368 (2009)
André, E., Müller, J., Rist, T.: WiP/PPP: automatic generation of personalized multimedia presentations. In: Proceedings of the Fourth ACM International Conference on Multimedia, pp. 407–408. ACM (1997)
Cassell, J., Vilhjálmsson, H.H., Bickmore, T.: Beat: the behavior expression animation toolkit. In: Prendinger, H., Ishizuka, M. (eds.) Life-Like Characters. Cognitive Technologies, pp. 163–185. Springer, Heidelberg (2004)
Neff, M., Kipp, M., Albrecht, I., Seidel, H.P.: Gesture modeling and animation based on a probabilistic re-creation of speaker style. ACM Trans. Graph. 27(1), 5:1–5:24 (2008). ACM
Gratch, J., Wang, N., Gerten, J., Fast, E., Duffy, R.: Creating rapport with virtual agents. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 125–138. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Hu, C., Walker, M.A., Neff, M., Fox Tree, J.E. (2015). Storytelling Agents with Personality and Adaptivity. In: Brinkman, WP., Broekens, J., Heylen, D. (eds) Intelligent Virtual Agents. IVA 2015. Lecture Notes in Computer Science(), vol 9238. Springer, Cham. https://doi.org/10.1007/978-3-319-21996-7_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-21996-7_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-21995-0
Online ISBN: 978-3-319-21996-7
eBook Packages: Computer ScienceComputer Science (R0)