Marco Scirea
ABSTRACT
We experiment with mood-expressing, procedurally generated music for narrative foreshadowing in videogames, investigating the relationship between music and the player's experience of narrative events in a game. We designed and conducted a user study in which the game's music expresses true foreshadowing in some trials (e.g. foreboding music before a negative event) and false foreshadowing in others (e.g. happy music that does not lead to a positive event). We observed players playing the game, recorded analytics data, and had them complete a survey upon completion of the gameplay. Thirty undergraduate and graduate students participated in the study. Statistical analyses suggest that the use of musical cues for narrative foreshadowing induces a better perceived consistency between music and game narrative. Surprisingly, false foreshadowing was found to enhance the player's enjoyment.
- B.-C. Bae and R. M. Young. A use of flashback and foreshadowing for surprise arousal in narrative using a plan-based approach. In Interactive Storytelling, pages 156--167. Springer, 2008. Google Scholar
Digital Library
- R. Barthes. S/Z. Collins Publishers, 1974.Google Scholar
- C. D. Batson, L. L. Shaw, and K. C. Oleson. Differentiating affect, mood, and emotion: Toward functionally based conceptual distinctions. 1992.Google Scholar
- C. Beedie, P. Terry, and A. Lane. Distinctions between emotion and mood. Cognition & Emotion, 19(6):847--878, 2005.Google ScholarCross Ref
- D. Birchfield. Generative model for the creation of musical emotion, meaning, and form. In Proceedings of the 2003 ACM SIGMM workshop on Experiential telepresence, pages 99--104. ACM, 2003. Google ScholarDigital Library
- M. Boltz, M. Schulkind, and S. Kantra. Effects of background music on the remembering of filmed events. Memory & Cognition, 19(6):593--606, 1991.Google ScholarCross Ref
- C. R. Brewin. Cognitive change processes in psychotherapy. Psychological review, 96(3):379, 1989.Google ScholarCross Ref
- D. Brown. Mezzo: An adaptive, real-time composition program for game soundtracks. In Proceedings of the AIIDE 2012 Workshop on Musical Metacreation, pages 68--72, 2012.Google Scholar
- S. B. Chatman. Story and discourse: Narrative structure in fiction and film. Cornell University Press, 1980.Google Scholar
- A. J. Cohen. Music as a source of emotion in film. Music and emotion: Theory and research, pages 249--272, 2001.Google Scholar
- Double Fine Productions. Broken Age, 2014.Google Scholar
- M. Eladhari, R. Nieuwdorp, and M. Fridenfalk. The soundtrack of your mind: mind music-adaptive audio for game characters. In Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology, page 54. ACM, 2006. Google ScholarDigital Library
- G. Genette and J. E. Lewin. Narrative Discourse: An Essay in Method. Cornell University Press, 1983.Google Scholar
- P. Hayward. Terror Tracks: Music, Sound, and Horror Cinema. Equinox, 2009.Google Scholar
- A. Hitchcock. Psycho, 1960.Google Scholar
- B. Houge. Cell-based music organization in Tom Clancy's EndWar. Demo at the AIIDE 2012 Workshop on Musical Metacreation, 2012.Google Scholar
- H. Katayose, M. Imai, and S. Inokuchi. Sentiment extraction in music. In Proceedings of the 9th International Conference on Pattern Recognition, pages 1083--1087, 1988.Google ScholarCross Ref
- G. Kreutz, U. Ott, D. Teichmann, P. Osawa, and D. Vaitl. Using music to induce emotions: Influences of musical preference and absorption. Psychology of Music, 36(1):101--126, 2008.Google ScholarCross Ref
- R. S. Lazarus. Emotion and Adaptation. Oxford University Press, 1991.Google Scholar
- J. S. Lerner and D. Keltner. Beyond valence: Toward a model of emotion-specific influences on judgement and choice. Cognition & Emotion, 14(4):473--493, 2000.Google ScholarCross Ref
- R. Likert. A technique for the measurement of attitudes. Archives of Psychology, 1932.Google Scholar
- E. Lindström, P. N. Juslin, R. Bresin, and A. Williamon. "Expressivity comes from within your soul": A questionnaire study of music students' perspectives on expressivity. Research Studies in Music Education, 20(1):23--47, 2003.Google ScholarCross Ref
- S. R. Livingstone and A. R. Brown. Dynamic response: Real-time adaptation for music emotion. In Proceedings of the 2nd Australasian Conference on Interactive Entertainment, pages 105--111, 2005. Google ScholarDigital Library
- G. Lucas and S. Spielberg. Indiana Jones franchise, 1981--2008.Google Scholar
- LucasArts. The Secret of Monkey Island, 1990.Google Scholar
- LucasArts. Grim Fandango, 1998.Google Scholar
- B. A. Martin. The influence of gender on mood effects in advertising. Psychology & Marketing, 20(3):249--273, 2003.Google ScholarCross Ref
- Maxis. Spore, 2008.Google Scholar
- Nintendo. The legend of zelda: Ocarina of time, 1998.Google Scholar
- F. Peinado and P. Gervás. Minstrel Reloaded: From the magic of Lisp to the formal semantics of OWL. In Technologies for Interactive Digital Storytelling and Entertainment, pages 93--97. Springer, 2006. Google ScholarDigital Library
- E. M. Pryzby and A. Thomas. Audio foreshadowing in a wagering game machine. 2005.Google Scholar
- A. Rollings and E. Adams. Fundamentals of game design. New Challenges for Character-Based AI for Games. Chapter 20: Artificial Life and Puzzle Games. Prentice Hall, pages 573--590, 2006.Google Scholar
- J. A. Russell. A circumplex model of affect. Journal of Personality and Social Psychology, 39(6):1161--1178, 1980.Google ScholarCross Ref
- M. Scirea. Mood dependent music generator. Advances in Computer Entertainment, pages 626--629, 2013.Google ScholarCross Ref
- M. Scirea, Y.-G. Cheong, and B.-C. Bae. Mood expression in real-time computer generated music using Pure Data. In Proceedings of the 13th International Conference on Music Perception and Cognition, 2014. (To appear).Google Scholar
- N. Shaker, J. Togelius, and M. J. Nelson. Procedural Content Generation in Games: A Textbook and an Overview of Current Research. Springer, 2014. (To appear).Google Scholar
- B. D. Smith and G. E. Garnett. Improvising musical structure with hierarchical neural nets. In Proceedings of the AIIDE 2012 Workshop on Musical Metacreation, pages 63--67, 2012.Google Scholar
- Telltale Games. The Walking Dead, 2012.Google Scholar
- R. E. Thayer. The Biopsychology of Mood and Arousal. Oxford University Press, 1989.Google Scholar
- R. Wooller, A. R. Brown, E. Miranda, J. Diederich, and R. Berry. A framework for comparison of process in algorithmic music systems. In Generative Arts Practice 2005 --- A Creativity & Cognition Symposium, 2005.Google Scholar
Index Terms
- Evaluating musical foreshadowing of videogame narrative experiences
Recommendations
A Use of Flashback and Foreshadowing for Surprise Arousal in Narrative Using a Plan-Based Approach
Interactive StorytellingAbstractThis paper describes work currently in progress to develop a computational method for generating flashback and foreshadowing, specifically targeted at the evocation of surprise in the reader’s mind. Flashback provides a backstory to explain what ...
Stimulating Psychological Attachments in Narrative Games: Engaging Players With Game Characters
Aim. This article aims to help game creators discover ways to make players feel involved, and engage with game characters. It outlines how players can have rich playing experiences with multi-faceted, dynamic, and interactive characters.
Background. We ...
Interactive Narrative design for geolocated experiences
Interacción '16: Proceedings of the XVII International Conference on Human Computer InteractionCurrent computation paradigms allow us to interact with the technology through several devices at the same time. Virtual tools and interfaces belong to the real world. This is the reason why the number of pervasive and geolocated games has been ...
Comments