Abstract
How well do cochlear implant (CI) users perceive music? The short answer is: not very well, at least for the average CI recipient. This chapter reviews much of the published evidence about the perception of musical sounds by CI users, discusses both the design of sound processors and the psychophysical findings that may explain the generally poor perception of music experienced with today’s CI systems, and finally presents some suggestions about how music perception may be improved in future.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arnoldner, C., Riss, D., Brunner, M., Durisin, M., Baumgartner, W.-D., & Hamzavi, J.-S. (2007). Speech and music perception with the new fine structure speech coding strategy: preliminary results. Acta Oto-Laryngologica 127(12), 1298–1303.
Briggs, R. J. S., Tykocinski, M., Xu, J., Risi, F., Svehla, M., Cowan, R. S. C., Stover, T., Erfurt, P., & Lenarz, T. (2006). Comparison of round window and cochleostomy approaches with a prototype hearing preservation electrode. Audiology & Neurotology, 11(S1), 42–48.
Brockmeier, S. J., Grasmeder, M., Passow, S., Mawmann, D., Vischer, M., Jappel, A., Baumgartner, W. D., Stark, T., Muller, J. M., Brill, S., Steffens, T., Strutz, J., Keifer, J., Baumann, U., & Arnold, W. (2007). Comparison of musical activities of cochlear implant users with different speech-coding strategies. Ear and Hearing, 28(S2), 49S–51S.
Carlyon, R. P. (2008). Temporal pitch processing by cochlear implant users. Journal of the Acoustical Society of America, 123(5), 3054.
Ching, T. Y., van Wanrooy, E., & Dillon, H. (2007). Binaural-bimodal fitting or bilateral implantation for managing severe to profound deafness: A review. Trends in Amplification, 11(3), 161–192.
Donaldson, G. S., Kreft, H. A., & Litvak, L. (2005). Place-pitch discrimination of single- versus dual-electrode stimuli by cochlear implant users. Journal of the Acoustical Society of America, 118(2), 623–626.
Donnelly, P. J., Guo, B. Z., & Limb, C. J. (2009). Perceptual fusion of polyphonic pitch in cochlear implant users. The Journal of the Acoustical Society of America, 126(5), EL128–EL133.
Dorman, M. F., Gifford, R. H., Spahr, A. J., & McKarns, S. A. (2008). The benefits of combining acoustic and electric stimulation for the recognition of speech, voice and melodies. Audiology & Neurotology, 13(2), 105.
El Fata, F., James, C. J., Laborde, M.-L., & Fraysse, B. (2009). How much residual hearing is ‘useful’ for music perception with cochlear implants? Audiology & Neurotology, 14(Suppl. 1), 14–21.
Firszt, J. B., Reeder, R. M., & Skinner, M. W. (2008). Restoring hearing symmetry with two cochlear implants or one cochlear implant and a contralateral hearing aid. Journal of Rehabilitation Research and Development, 45(5), 749–767.
Firszt, J. B., Holden, L. K., Reeder, R. M., & Skinner, M. W. (2009). Speech recognition in cochlear implant recipients: comparison of standard HiRes and HiRes 120 sound processing. Otology & Neurotology, 30, 146–152.
Galvin, J. J., 3 rd, Fu, Q. J., & Nogaki, G. (2007). Melodic contour identification by cochlear implant listeners. Ear and Hearing, 28(3), 302–318.
Gantz, B. J., & Turner, C. (2004). Combining acoustic and electrical speech processing: Iowa/Nucleus hybrid implant. Acta Oto-Laryngologica, 124(4), 344–347.
Gantz, B. J., Turner, C. W., & Gfeller, K. E. (2006). Acoustic plus electric speech processing: preliminary results of a multicenter clinical trial of the Iowa/Nucleus Hybrid implant. Audiology & Neurotology, 11(S1), 63–68.
Geurts, L., & Wouters, J. (2004). Better place-coding of the fundamental frequency in cochlear implants. Journal of the Acoustical Society of America, 115(2), 844–852.
Gfeller, K. E., Witt, S. A., Spencer, L. J., Stordahl, J., & Tomblin, B. (1998). Musical involvement and enjoyment of children who use cochlear implants. The Volta Review, 100(4), 213–233.
Gfeller, K. E., Christ, A., Knutson, J. F., Witt, S. A., Murray, K. T., & Tyler, R. S. (2000a). Musical backgrounds, listening habits, and aesthetic enjoyment of adult cochlear implant recipients. Journal of the American Academy of Audiology, 11(7), 390–406.
Gfeller, K. E., Witt, S. A., Stordahl, J., Mehr, M. A., & Woodworth, G. G. (2000b). The effects of training on melody recognition and appraisal by adult cochlear implant recipients. Journal of the Academy of Rehabilitative Audiology, 33, 115–138.
Gfeller, K. E., Turner, C. W., Mehr, M. A., Woodworth, G. G., Fearn, R., Knutson, J. F., Witt, S. A., & Stordahl, J. (2002a). Recognition of familiar melodies by adult cochlear implant recipients and normal-hearing adults. Cochlear Implants International, 3(1), 29–53.
Gfeller, K. E., Witt, S. A., Woodworth, G. G., Mehr, M. A., & Knutson, J. F. (2002b). Effects of frequency, instrumental family, and cochlear implant type on timbre recognition and appraisal. Annals of Otology, Rhinology & Laryngology, 111(4), 349–356.
Gfeller, K. E., Christ, A., Knutson, J. F., Witt, S. A., & Mehr, M. A. (2003). The effects of familiarity and complexity on appraisal of complex songs by cochlear implant recipients and normal hearing adults. Journal of Music Therapy, 40(2), 78–112.
Gfeller, K. E., Turner, C. W., Oleson, J., Zhang, X., Gantz, B. J., Froman, R., & Olszewski, C. (2007). Accuracy of cochlear implant recipients on pitch perception, melody recognition, and speech reception in noise. Ear and Hearing, 28(3), 412–423.
Gordon, E. E. (1979). Manual for the primary measures of music audiation and the intermediate measures of music audiation. Music aptitude tests for kindergarten, first, second, third and fourth grade children. Chicago, IL: GIA Publications, Inc.
Gstoettner, W. K., Helbig, S., Maier, N., Kiefer, J., Radeloff, A., & Adunka, O. F. (2006). Ipsilateral electric acoustic stimulation of the auditory system: results of long-term hearing preservation. Audiology & Neurotology, 11(Suppl. 1), 49–56.
Helms, J., Weichbold, V., Baumann, U., von Specht, H., Schon, F., Muller, J., Esser, B., Zieze, M., Anderson, I., & D’’Haese, P. (2004). Analysis of ceiling effects occurring with speech recognition tests in adult cochlear-implanted patients. Journal for Oto-Rhino-Laryngology, 66(3), 130–135.
Hochmair, I., Nopp, P., Jolly, C., Schmidt, M., Schosser, H., Garnham, C., & Anderson, I. (2006). MED-EL cochlear implants: state of the art and a glimpse into the future. Trends in Amplification, 10(4), 201–219.
Hsiao, F. (2008). Mandarin melody recognition by pediatric cochlear implant recipients. Journal of Music Therapy, 45(4), 390–404.
Kang, R., Nimmons, G. L., Drennan, W., Longnion, J., Ruffin, C., Nie, K., Won, J. H., Worman, T., Yueh, B., & Rubinstein, J. (2009). Development and validation of the University of Washington Clinical Assessment of Music Perception test. Ear and Hearing, 30(4), 411–418.
Kiefer, J., Pok, S. M., Adunka, O. F., Sturzebecher, E., Baumgartner, W. D., Schmidt, M., Tillein, J., Ye, Q., & Gstoettner, W. K. (2005). Combined electric and acoustic stimulation of the auditory system: Results of a clinical study. Audiology & Neurotology, 10, 134–144.
Kim, H. N., Shim, Y. J., Chung, M. H., & Lee, Y. H. (2000). Benefit of ACE compared to CIS and SPEAK coding strategies. Advances in Oto-Rhino-Laryngology, 57, 408–411.
Kong, Y. Y., Cruz, R. J., Jones, J. A., & Zeng, F. G. (2004). Music perception with temporal cues in acoustic and electric hearing. Ear and Hearing, 25(2), 173–185.
Kong, Y. Y., Stickney, G. S., & Zeng, F. G. (2005). Speech and melody recognition in binaurally combined acoustic and electric hearing. Journal of the Acoustical Society of America, 117(3, Pt. 1), 1351–1361.
Kwon, B. J., & van den Honert, C. (2006). Dual-electrode pitch discrimination with sequential interleaved stimulation by cochlear implant users. Journal of the Acoustical Society of America, 120(1), EL1–EL6.
Laneau, J., Wouters, J., & Moonen, M. (2006). Improved music perception with explicit pitch coding in cochlear implants. Audiology & Neurotology, 11, 38–52.
Leal, M. C., Shin, Y. J., Laborde, M. L., Calmels, M. N., Verges, S., Lugardon, S., Andrieu, S., Deguine, O., & Fraysse, B. (2003). Music perception in adult cochlear implant recipients. Acta Oto-Laryngologica, 123(7), 826–835.
Lenarz, T., Stover, T., Buechner, A., Paasche, G., Briggs, R. J. S., Risi, F., Pesch, J., & Battmer, R. D. (2006). Temporal bone results and hearing preservation with a new straight electrode. Audiology & Neurotology, 11(S1), 34–41.
Loeb, G. E., White, M. W., & Merzenich, M. M. (1983). Spatial cross-correlation. Biological Cybernetics, 47(3), 149–163.
Loizou, P. C. (1998). Mimicking the human ear: an overview of signal-processing strategies for converting sound into electrical signals in cochlear implants. IEEE Signal Processing Magazine September, 101–130.
Looi, V., McDermott, H. J., McKay, C. M., & Hickson, L. (2004). Pitch discrimination and melody recognition by cochlear implant users. In VIII International Cochlear Implant Conference (Vol. 1273C, pp. 197–200). Indianapolis, IN: Elsevier.
Looi, V., McDermott, H. J., McKay, C. M., & Hickson, L. (2007). Comparisons of quality ratings for music by cochlear implant and hearing aid users. Ear and Hearing, 28(S2), 59S–61S.
Looi, V., McDermott, H., McKay, C., & Hickson, L. (2008a). The effect of cochlear implantation on music perception by adults with usable pre-operative acoustic hearing. International Journal of Audiology, 47(5), 257–268.
Looi, V., McDermott, H., McKay, C., & Hickson, L. (2008b). Music perception of cochlear implant users compared with that of hearing aid users. Ear and Hearing, 29(3), 421–434.
MacLeod, P., Chouard, C.-H., & Weber, J. P. (1985). French device. In R. A. Schindler & M. M. Merzenich (Eds.), Cochlear implants (pp. 111–120). New York: Raven Press.
McDermott, H. J. (2004). Music perception with cochlear implants: a review. Trends in Amplification, 8(2), 49–82.
McDermott, H. J. (2009). Cochlear implants and music. In M. Chasin (Ed.), Hearing loss in musicians, prevention and management (pp. 117–127). San Diego, CA: Plural Publishing.
McDermott, H. J., & McKay, C. M. (1994). Pitch ranking with nonsimultaneous dual-electrode electrical stimulation of the cochlea. Journal of the Acoustical Society of America, 96(1), 155–162.
McDermott, H. J., & McKay, C. M. (1997). Musical pitch perception with electrical stimulation of the cochlea. Journal of the Acoustical Society of America, 101(3), 1622–1631.
McDermott, H. J., & Looi, V. (2004). Perception of complex signals, including musical sounds, with cochlear implants. In VIII International Cochlear Implant Conference (Vol. 1273C, pp. 201–204). Indianapolis, Indiana: Elsevier.
McDermott, H. J., McKay, C. M., & Vandali, A. E. (1992). A new portable sound processor for the University of Melbourne/Nucleus Limited multielectrode cochlear implant. Journal of the Acoustical Society of America, 91(6), 3367–3371.
McKay, C. M. (2004). Psychophysics and electrical stimulation. In F. G. Zeng, A. N. Popper, & R. R. Fay (Eds.), Springer Handbook of Auditory Research: auditory prostheses (pp. 286–333). New York: Springer-Verlag.
McKay, C. M., & McDermott, H. J. (1996). The perception of temporal patterns for electrical stimulation presented at one or two intracochlear sites. Journal of the Acoustical Society of America, 100(2, Pt. 1), 1081–1092.
McKay, C. M., McDermott, H. J., Vandali, A. E., & Clark, G. M. (1991). Preliminary results with a six spectral maxima sound processor for the University of Melbourne/Nucleus multiple-electrode cochlear implant. Australian Journal of Oto-Laryngology, 6(5), 354–359.
McKay, C. M., McDermott, H. J., & Clark, G. M. (1994). Pitch percepts associated with amplitude-modulated current pulse trains in cochlear implantees. Journal of the Acoustical Society of America, 96(5, Pt. 1), 2664–2673.
McKay, C. M., McDermott, H. J., & Clark, G. M. (1995). Pitch matching of amplitude-modulated current pulse trains by cochlear implantees: The effect of modulation depth. Journal of the Acoustical Society of America, 97(3), 1777–1785.
Mirza, S., Douglas, S. A., Lindsey, P., Hildreth, T., & Hawthorne, M. (2003). Appreciation of music in adult patients with cochlear implants: a patient questionnaire. Cochlear Implants International, 4(2), 85–95.
Mitani, C., Nakata, T., Trehub, S. E., Kanda, Y., Kumagami, H., Takasaki, K., Miyamoto, I., & Takahashi, H. (2007). Music recognition, music listening, and word recognition by deaf children with cochlear implants. Ear and Hearing, 28(S2), 29 S–33 S.
Moore, B. C. J., & Glasberg, B. R. (1996). A revision of Zwicker’s loudness model. Acustica-Acta Acustica, 82(2), 335–345.
Moore, B. C. J., & Glasberg, B. R. (1997). A model of loudness perception applied to cochlear hearing loss. Auditory Neuroscience, 3, 289–311.
Moore, B. C. J., & Carlyon, R. P. (2005). Perception of pitch by people with cochlear hearing loss and by cochlear implant users. In C. J. Plack, R. R. Fay, A. J. Oxenham, & A. N. Popper (Eds.), Springer Handbook of Auditory Research: pitch perception (Vol. 24, pp. 234–277). New York: Springer-Verlag.
Nakata, T., Trehub, S. E., Mitani, C., & Kanda, Y. (2006). Pitch and timing in the songs of deaf children with cochlear implants. Music Perception, 24(2), 147–154.
Nelson, D. A., van Tasell, D. J., Schroder, A. C., Soli, S. D., & Levine, S. (1995). Electrode ranking of “place pitch” and speech recognition in electrical hearing. Journal of the Acoustical Society of America, 98(4), 1987–1999.
Nimmons, G. L., Kang, R. S., Drennan, W. R., Longnion, J., Ruffin, C., Worman, T., Yueh, B., & Rubinstein, J. T. (2008). Clinical assessment of music perception in cochlear implant listeners. Otology & Neurotology, 29(2), 149–155.
O’Leary, S. J., Richardson, R. R., & McDermott, H. J. (2009). Principles of design and biological approaches for improving the selectivity of cochlear implant electrodes. Journal of Neural Engineering, 6(5), 055002.
Olson, A. D., & Shinn, J. B. (2008). A systematic review to determine the effectiveness of using amplification in conjunction with cochlear implantation. Journal of the American Academy of Audiology, 19(9), 657–671.
Olszewski, C., Gfeller, K. E., Froman, R., Stordahl, J., & Tomblin, B. (2005). Familiar melody recognition by children and adults using cochlear implants and normal hearing children. Cochlear Implants International, 6(3), 123–140.
Patrick, J. F., Busby, P. A., & Gibson, P. J. (2006). The development of the Nucleus® FreedomTM cochlear implant system. Trends in Amplification, 10(4), 175–200.
Pijl, S., & Schwarz, D. W. (1995). Melody recognition and musical interval perception by deaf subjects stimulated with electrical pulse trains through single cochlear implant electrodes. Journal of the Acoustical Society of America, 98(2, Pt. 1), 886–895.
Plack, C. J., & Oxenham, A. J. (2005). The psychophysics of pitch. In R. R. Fay & A. N. Popper (Eds.), Springer Handbook of Auditory Research: pitch (Vol. 24, pp. 7–55). New York: Springer.
Riess Jones, M., Fay, R. R., & Popper, A. N. (Eds.). (2010). Music perception (Vol. 36). New York: Springer.
Schafer, E. C., Amlani, A. M., Seibold, A., & Shattuck, P. L. (2007). A meta-analytic comparison of binaural benefits between bilateral cochlear implants and bimodal stimulation. Journal of the American Academy of Audiology, 18(9), 760–776.
Shamma, S., & Klein, D. (2000). The case of the missing pitch templates: how harmonic templates emerge in the early auditory system. Journal of the Acoustical Society of America, 107(5, Pt. 1), 2631–2644.
Simpson, A., McDermott, H. J., Dowell, R. C., Sucher, C., & Briggs, R. J. S. (2009). Comparison of two frequency-to-electrode maps for acoustic-electric stimulation. International Journal of Audiology, 48(2), 63–73.
Singh, S., Kong, Y., & Zeng, F. (2009). Cochlear implant melody recognition as a function of melody frequency range, harmonicity, and number of electrodes. Ear and Hearing, 30(2), 160–168.
Skinner, M. W., Holden, L. K., Whitford, L. A., Plant, K. L., Psarros, C., & Holden, T. A. (2002). Speech recognition with the Nucleus 24 SPEAK, ACE, and CIS speechcoding strategies in newly implanted adults. Ear and Hearing, 23(3), 207–223.
Stordahl, J. (2002). Song recognition and appraisal: a comparison of children who use cochlear implants and normally hearing children. Journal of Music Therapy, 39(1), 2–19.
Sucher, C. M. (2007). Music perception of children who use cochlear implants (Unpublished Master’s thesis). The University of Melbourne, Australia.
Sucher, C. M., & McDermott, H. J. (2007). Pitch ranking of complex tones by normally hearing subjects and cochlear implant users. Hearing Research, 230, 80–87.
Sucher, C. M., & McDermott, H. J. (2009). Bimodal stimulation: benefits for music perception and sound quality. Cochlear Implants International, 10(S1), 96–99.
Swanson, B. (2008). Pitch perception with cochlear implants (Unpublished doctoral thesis). The University of Melbourne, Australia.
Tong, Y. C., Clark, G. M., Blamey, P. J., Busby, P. A., & Dowell, R. C. (1982). Psychophysical studies for two multiple-channel cochlear implant patients. Journal of the Acoustical Society of America, 71(1), 153–160.
Townshend, B., Cotter, N., Compernolle, D. V., & White, R. L. (1987). Pitch perception by cochlear implant subjects. Journal of the Acoustical Society of America, 82(1), 106–115.
van den Honert, C., & Kelsall, D. C. (2007). Focused intracochlear electric stimulation with phased array channels. Journal of the Acoustical Society of America, 121(6), 3703–3716.
Vandali, A. E., Sucher, C. M., Tsang, D. J., McKay, C. M., Chew, J. W., & McDermott, H. J. (2005). Pitch ranking ability of cochlear implant recipients: A comparison of sound-processing strategies. Journal of the Acoustical Society of America, 117(5), 3126–3138.
Veekmans, K., Ressel, L., Mueller, J., Vischer, M., & Brockmeier, S. J. (2009). Comparison of music perception in bilateral and unilateral cochlear implant users and normal-hearing subjects. Audiology & Neurotology, 14(5), 315–326.
Vongpaisal, T., Trehub, S. E., & Schellenberg, E. G. (2006). Song recognition by children and adolescents with cochlear implants. Journal of Speech, Language, and Hearing Research, 49, 1091–1103.
Vongpaisal, T., Trehub, S. E., & Schellenberg, E. G. (2009). Identification of TV tunes by children with cochlear implants. Music Perception, 27(1), 17–24.
Wilson, B. S., Finley, C. C., Lawson, D. T., Wolford, R. D., Eddington, D. K., & Rabinowitz, W. M. (1991). Better speech recognition with cochlear implants. Nature, 352(6332), 236–238.
Xu, L., Zhou, N., Chen, X., Li, Y., Schultz, H., Zhao, X., & Han, D. (2009). Vocal singing by prelingually-deafened children with cochlear implants. Hearing Research, 255(1–2), 129–134.
Zwolan, T. A., Collins, L. M., & Wakefield, G. H. (1997). Electrode discrimination and speech recognition in postlingually deafened adult cochlear implant subjects. Journal of the Acoustical Society of America, 102(6), 3673–3685.
Acknowledgments
Many colleagues have contributed to the preparation of this chapter, including Brett Swanson, Cathy Sucher, Valerie Looi, Colette McKay, and David MacFarlane. Financial support for some of the reported research was provided by the Garnett Passe and Rodney Williams Memorial Foundation. The Bionics Institute acknowledges the support it receives from the Victorian Government through its Operational Infrastructure Support Program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
McDermott, H. (2011). Music Perception. In: Zeng, FG., Popper, A., Fay, R. (eds) Auditory Prostheses. Springer Handbook of Auditory Research, vol 39. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-9434-9_13
Download citation
DOI: https://doi.org/10.1007/978-1-4419-9434-9_13
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-9433-2
Online ISBN: 978-1-4419-9434-9
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)