Skip to main content
SpringerLink
Log in

Shake and Create: Reappropriating Video Game Technologies for the Enactive Learning of Music

  • Chapter
  • First Online:
Serious Games and Edutainment Applications

Abstract

This chapter explores the culture of hacking and its role in supporting engaging and meaningful educational experiences for diverse groups of learners. The discussion focuses around two case study examples. The first, KIDI, is an interactive museum exhibit that is located at a Fenton House in London, a National Trust property, and which repurposes interactive audio routines and hacked force-feedback controllers to facilitate engagement with a collection of keyboard instruments, the Benton Fletcher Collection, thus enabling visitors to learn about their sound and playing characteristics through play. The second, BitBox!, is an interactive gestural digital musical interface, which is designed to deconstruct and explain the underlying technical frameworks that support adaptive video game soundtracks and which draws upon a vocabulary of spatial and gestural controls from both video gaming and music performance. Both case studies highlight the importance of play as a vehicle for learning, harnessing both the physical and conceptual aspects of play to test and explore the limits of our skills and understanding.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • 2001: A Space Odyssey: [film] Stanely Kubrick (1968)

    Google Scholar 

  • Bangerter, A., Heath, C.: The Mozart effect: Tracking the evolution of a scientific legend. Br. J. Soc. Psychol. 43, 605–623 (2004). doi:10.1348/0144666042565353

    Article  Google Scholar 

  • Coffman, D.D.: Music and quality of life in older adults. Psychomusicology: A J. Res. Music Cognition. 18(1–2), 76–88 (2002). doi:10.1037/h0094050.

    Article  Google Scholar 

  • Coleman, E.: Coding Freedom: The Ethics and Aesthetics of Hacking. Princeton University Press, Princeton (2013)

    Google Scholar 

  • Dance Dance Revolution: [Arcade Cabinet]. Tokyo: Konami (1998)

    Google Scholar 

  • Dear Esther: [Computer Software]. Portsmouth: The Chinese Room (2012)

    Google Scholar 

  • DeBono, E.: New Think: The Use of Lateral Thinking in the Generation of New Ideas. Simon and Schuster, New York (1968)

    Google Scholar 

  • Digibarn.com: DigiBarn Weird Stuff: Sheet music (8080 assembler listing) for Fool on the Hill (played on Altair, 1975) (2016). [online] Available at: http://www.digibarn.com/collections/weirdstuff/altair-sheetmusic/index.html. Accessed 11 Aug 2016

  • Dompier, S.: Music of a Sort. Dr. Dobb’s J. Comput. Calisthenics Orthodontia. 1(2): 6–7 (1976)

    Google Scholar 

  • Doornbusch, P.: A chronology of computer music and related events. In: Dean, R. (ed.) The Oxford Handbook of Computer Music, pp. 554–582. Oxford University Press, Oxford (2009)

    Google Scholar 

  • Everybody’s Gone to the Rapture: [Computer Software]. Portsmouth: The Chinese Room (2015)

    Google Scholar 

  • Felicia, P.: Game-based Learning. Cambridge Scholars, Newcastle upon Tyne (2014)

    Google Scholar 

  • Gillespie, R.B.: Haptic Display of Systems with Changing Kinematic Constraints: The Virtual Piano Action. Dissertation, Stanford University (1996)

    Google Scholar 

  • Glinsky, A.: Theremin: Ether Music and Espionage. University of Illinois Press, Chicago (2000)

    Google Scholar 

  • Goldstein, M.: Gestural coherence and musical interaction design. Proceedings of the 1998 IEEE International Conference on Systems, Man and Cybernetics (SMC’98), pp. 1076–1079 (1998)

    Google Scholar 

  • Graetz, J.M.: The origin of Spacewar. Creat. Computing. 18, 56–67 (1981)

    Google Scholar 

  • Guitar Hero: [Computer software]. Mountain View: RedOctane (2005)

    Google Scholar 

  • Heron, M.J., Belford, P.H.: All of your co-workers are gone: Story, substance, and the empathic puzzler. J. Games Criticism. 2(1), 1–29 (2015)

    Google Scholar 

  • Hubbard, F.: Three Centuries of Harpsichord Making. Harvard University Press, Cambridge, MA (1967)

    Google Scholar 

  • Jenkin, M.: Play in education: The role and importance of creative learning. The Guardian, February 27, 2013 (2013)

    Google Scholar 

  • Jindal-Snape, D., Baird, L., Miller, K.: A longitudinal study to investigate the effec- tiveness of the Guitar Hero project in supporting transition from P7–S1. Dundee: Report for Learning and Teaching Scotland (2011)

    Google Scholar 

  • Jonze, T.: Beats and geeks at Music Hack Day. [online] The Guardian (2009). Available at: http://www.theguardian.com/music/musicblog/2009/jul/13/beats-geeks-music-hack-day. Accessed 18 Mar 2016

  • Klimmt, C. (2009). Serious games and social change: Why they (should) work. In Serious Games: Mechanisms and Effects, ed. Ute Ritterfeld, Michael Cody, Peter Vorderer, New York: Routledge, pp. 248 – 270.

    Google Scholar 

  • Leighton, D.: Challenging the Traditional Culture Vulture: Experiential Marketing in the Cultural Tourism Sector. ATLAS Annual Conference: Mass tourism vs Niche tourism, November 3–5, 2010, Limassol, Cyprus (2010)

    Google Scholar 

  • Levy, S.: Hackers: Heroes of the Computer Revolution – 25th Anniversary Edition. Sebastopol: O’Reilly Media, Inc. (2010)

    Google Scholar 

  • Massa, D.P.: Choosing an ultrasonic sensor for proximity or distance measurement part 1: Acoustic considerations. Sensors. 16(2):3 (1999). http://www.sensorsmag.com/sensors/acoustic-ultrasound/choosing-ultrasonic-sensor-proximity-or-distance-measurement-825. Accessed 29 June 2015

  • Mathema, C.: Multi-Touch All-Point Touchscreens: The Future of User Interface Design. [online] Mobile Dev and Design (2014). Available at: http://mobiledevdesign.com/learning-resources/multi-touch-all-point-touchscreens-future-user-interface-design. Accessed 18 Mar 2016

  • McAlpine, K.: Clement Matchett’s Virginals Book: Music from the Panmure Collection. Abertay University Press, Dundee (2005a)

    Google Scholar 

  • McAlpine, K.: Digital Kirckman Harpsichord. Mémoire de patrimoine. De la plume au pixel. Le Grand Hornu, Mons, Belgium, May 1–August 28, 2005 (2005b)

    Google Scholar 

  • McAlpine, K.: Interview with Ben Daglish (2015)

    Google Scholar 

  • McPherson, G.E., Zimmerman, B.J.: Self-regulation of musical learning: A social cognitive perspective. In: Colwell, R., Richardson, C. (eds.) The New Handbook of Research on Music Teaching and Learning, pp. 327–347. Oxford University Press, New York (2002)

    Google Scholar 

  • Natanson, J.: Learning Through play. Ward Lock, London (1997)

    Google Scholar 

  • National Library of Scotland: The Panmure Music Manuscripts. MSS.9447-9476

    Google Scholar 

  • Norman, D.A.: Natural User Interfaces Are Not Natural. Interactions: 6–10 (2010)

    Google Scholar 

  • Qin, Y.: A Study of Wii/Kinect Controller as Musical Controllers. Music Technology Area of Schulich Music School, McGill University (2012)

    Google Scholar 

  • Richmond, J.: Introduction. In: Colwell, R., Richardson, C. (eds.) The New Handbook of Research on Music Teaching and Learning, p. 3. Oxford University Press, New York (2002)

    Google Scholar 

  • Robbins, M.: Foreword. In: Building the Future of Education: Museums and the Learning Ecosystem, pp. 5–6. American Alliance of Museums, Washington, DC (2014)

    Google Scholar 

  • Robertson, P.: Police Dilemmas of Interpretation and Action : The ‘Shoot/no- shoot Dilemma’. PhD. University of Abertay Dundee (2011)

    Google Scholar 

  • Rovan, J., Hayward, V.: Typology of tactile sounds and their synthesis in gesture-driven computer music performance. In: Wanderley, M., Battier, M. (eds.) Trends in Gestural Control of Music. Editions IRCAM, Paris (2000)

    Google Scholar 

  • Ryan, M.: The interactive onion: Layers of user participation in digital narrative texts. In: Page, R., Thomas, B. (eds.) New Narrative. Stories and Storytelling in the Digital Age. p. 35 (2011)

    Google Scholar 

  • Surf Champ: [Computer software] London: New Concepts, Ltd. (1985)

    Google Scholar 

  • Sweet, M.: Writing Interactive Music for Computer Games. Addison Wesley, Boston (2014)

    Google Scholar 

  • Tobin, S.: Portable Play in Everyday Life: The Nintendo DS. Palgrave MacMillan, New York (2013)

    Book  Google Scholar 

  • Waitzman, M.: Early Keyboard Instruments: The Benton Fletcher Collection at Fenton House. National Trust Books, London (2003)

    Google Scholar 

  • Warren, S.J., Jones, J.: Yokoi’s theory of lateral innovation: Applications for learning game design [Special Issue on Educational Games]. i-manager’s. Aust. J. Educ. Technol. 5(2), 32–43 (2008)

    Google Scholar 

  • Williams, D.: Bridging the methodological divide in game research. Simul. Games. 36(4), 447–463 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Arts, Media and Computer Games, University of Abertay, Bell Street, Dundee, DD1 1HG, Scotland, UK

    Kenneth B. McAlpine

Authors
  1. Kenneth B. McAlpine
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kenneth B. McAlpine .

Editor information

Editors and Affiliations

  1. School of Art, Design and Architecture, University of Huddersfield, Huddersfield, United Kingdom

    Minhua Ma

  2. College of Science and Technology, Nottingham Trent University, Nottingham, United Kingdom

    Andreas Oikonomou

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

McAlpine, K.B. (2017). Shake and Create: Reappropriating Video Game Technologies for the Enactive Learning of Music. In: Ma, M., Oikonomou, A. (eds) Serious Games and Edutainment Applications . Springer, Cham. https://doi.org/10.1007/978-3-319-51645-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-51645-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-51643-1

  • Online ISBN: 978-3-319-51645-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation