Skip to main content
SpringerLink
Log in

Musical Sense-Making and the Concept of Affordance: An Ecosemiotic and Experiential Approach

  • Original Paper
  • Published:
Biosemiotics Aims and scope Submit manuscript

Abstract

This article is interdisciplinary in its claims. Evolving around the ecological concept of affordance, it brings together pragmatics and ecological psychology. Starting from the theoretical writings of Peirce, Dewey and James, the biosemiotic claims of von Uexküll, Gibson’s ecological approach to perception and some empirical evidence from recent neurobiological research, it elaborates on the concepts of experiential and enactive cognition as applied to music. In order to provide an operational description of this approach, it introduces some conceptual tools from the domain of cybernetics with a major focus on the concept of circularity, which links perception to action in a continuous process of sense-making and interaction with the environment. As such, it is closely related to some pragmatic, biosemiotic and ecosemiotic claims which can be subsumed under the general notion of functional significance. An attempt is made to apply this conceptual framework to the process of musical sense-making which involves the realisation of systemic cognition in the context of epistemic interactions that are grounded in our biology and possibilities for adaptive control. Central in this approach is the concept of coping with the environment, or, in musical terms, to perceive the sounding music in terms of what it affords for the consummation of musical behaviour.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Anderson, M. (2003). Embodied cognition: A field guide. Artificial Intelligence, 149, 91–130.

    Article  Google Scholar 

  • Angell, J. R. (1907). The province of functional psychology. Psychological Review, 12(2), 61–91.

    Article  Google Scholar 

  • Annett, J. (1995). Motor imagery: Perception of action? Neuropsychologia, 33(11), 1395–1417.

    Article  PubMed  CAS  Google Scholar 

  • Annett, J. (1996). On knowing how to do things: A theory of motor imagery. Cognitive Brain Research, 3, 65–69.

    Article  PubMed  CAS  Google Scholar 

  • Arbib, M. (1981). Perceptual structures and distributed motor control. In V. Brooks (Ed.), Handbook of physiology, section 1, the nervous system, vol. 2, motor control, V (pp. 1449–1480). Bethesda: American Physiological Society.

    Google Scholar 

  • Bateson, G. (1978 [1973]). Steps to an ecology of mind. London: Paladin.

  • Beck, B. (1987). Metaphors, cognition, and artificial intelligence. In R. Haskell (Ed.), Cognition and symbolic structures: The psychology of metaphoric transformation (pp. 9–30). Norwood: Ablex Publishing Corporation.

    Google Scholar 

  • Berthoz, A. (1996). The role of inhibition in the hierarchical gating of executed and imagined movements. Cognitive Brain Research, 3, 101–113.

    Article  PubMed  CAS  Google Scholar 

  • Berthoz, A. (1997). Le sens du mouvement. Paris: Odile Jacob.

    Google Scholar 

  • Blacking, J. (1995). Music, culture and experience. London: University of Chicago Press.

    Google Scholar 

  • Brier, S. (1999). Biosemiotics and the foundations of cybersemiotics. Semiotica, 127(1/4), 169–198.

    Google Scholar 

  • Cariani, P. (1998). Life’s journey through the semiosphere. Semiotica, 120(3/4), 243–257.

    Google Scholar 

  • Cariani, P. (2001). Symbols and dynamics in the brain. Biosystems, 60(1–3), 59–83.

    Article  PubMed  CAS  Google Scholar 

  • Cariani, P. (2003). Cybernetic systems and the semiotics of translation. In S. Petrilli (Ed.), Translation translation (pp. 349–367). Amsterdam: Rodopi.

    Google Scholar 

  • Chemero, A. (2003). An outline of a theory of affordances. Ecological Psychology, 15, 181–195.

    Article  Google Scholar 

  • Chemero, A., & Turvey, M. (2007a). Gibsonian affordances for roboticists. Adaptive Behavior, 15(4), 473–480.

    Article  Google Scholar 

  • Chemero, A., & Turvey, M. (2007b). Hypersets, complexity, and the ecological approach to perception-action. Biological Theory, 2, 23–36.

    Article  Google Scholar 

  • Clarke, E. (2005). Ways of listening. An ecological approach to the perception of musical meaning. Oxford: Oxford University Press.

    Google Scholar 

  • Clynes, M. (1977). Sentics: The touch of emotion. London: Souvenir.

    Google Scholar 

  • Costall, A. (1991). Phenomenal causality. In G. Thinès, A. Costall, & G. Butterworth (Eds.), Michotte’s experimental phenomenology of perception (pp. 51–64). Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • Cutsuridis, V., Hussain, A., & Taylor, J. (Eds.). (2011). Perception-action cycle. New York: Springer.

    Google Scholar 

  • Decety, J. (1996). Do imagined actions share the same neural substrate? Cognitive Brain Research, 3, 87–93.

    Article  PubMed  CAS  Google Scholar 

  • Deecke, L. (1996). Planning, preparation, execution, and imagery of volitional action. Cognitive Brain Research, 3, 59–64.

    Article  PubMed  CAS  Google Scholar 

  • Deely, J. (2004). Semiotics and Jakob von Uexkull’s concept of Umwelt. Sign Systems Studies, 32(1/2), 11–34.

    Google Scholar 

  • Dewey, J. (1958 [1934]). Art as experience. New York: Capricorn Books.

  • Di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., & Rizzolati, G. (1992). Understanding motor events: A neurophysiological study. Experimental Brain Research, 19, 176–180.

    Google Scholar 

  • Dubois, D. (1991). Catégorisation et cognition: “10 ans après”, une évaluation des concepts de Rosch. In D. Dubois (Ed.), Sémantique et cognition. Catégories, prototypes, typicalité (pp. 34–54). Paris: Editions du CNRS.

    Google Scholar 

  • Fuster, J. (1990). Prefrontal cortex and the bridging of temporal gaps in the perception-action cycle. Annals of the New York Academy of Sciences, 608, 318–336.

    Article  PubMed  CAS  Google Scholar 

  • Fuster, J. (2004). Upper processing stages of the perception–action cycle. Trends in Cognitive Sciences, 8(4), 143–145.

    Article  PubMed  Google Scholar 

  • Gabrielsson, A. (Ed.). (1987). Action and perception in rhythm and music. Papers given at a symposium in the third international conference on event perception and action. Stockholm: Royal Swedish Academy of Music.

    Google Scholar 

  • Gaser, Ch, & Schlaug, G. (2003). Brain structures differ between musicians and non-musicians. The Journal of Neuroscience, 23(27), 9240–9245.

    PubMed  CAS  Google Scholar 

  • Gaver, W. W. (1993a). How do we hear in the world? explorations of ecological acoustics. Ecological Psychology, 5(4), 285–313.

    Article  Google Scholar 

  • Gaver, W. W. (1993b). What in the world do we hear? an ecological approach to auditory event perception. Ecological Psychology, 5(1), 1–29.

    Article  Google Scholar 

  • Gibson, J. (1966). The senses considered as perceptual systems. London: Allen & Unwin.

    Google Scholar 

  • Gibson, J. (1977). The theory of affordances. In R. Shaw & J. Bransford (Eds.), Perceiving, acting, and knowing: Toward an ecological psychology (pp. 67–82). Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • Gibson, J. (1979). The ecological approach to visual perception. Boston: Houghton Mifflin Company.

    Google Scholar 

  • Godøy, R. I. (2001). Imagined action, excitation, and resonance. In R. I. Godøy & H. Jørgenen (Eds.), Musical imagery (pp. 237–250). Lisse: Swets & Zeitlinger.

    Google Scholar 

  • Gromko, J., & Poorman, A. (1998). Developmental trends and relationships in children’s aural perception and symbol use. Journal of Research in Music Education, 46(1), 16–23.

    Article  Google Scholar 

  • Haeckel, E. (1988 [1866]). Generelle Morphologie des Organismus, Bd. 2: Allgemeine Entwicklungsgeschichte. Berlin: de Gruyter.

  • Heft, H. (2001). Ecological psychology in context: James Gibson, Roger Barker, and the legacy of William James’s radical empiricism. Mahwah: Lawrence Erlbaum Associates.

    Google Scholar 

  • Hoffmeyer, J. (1997a). Biosemiotics: Towards a new synhesis in biology. European Journal for Semiotic Studies, 9(2), 2355–2376.

    Google Scholar 

  • Hoffmeyer, J. (1997b). Signs of meaning in the universe. Bloomington: Indiana University Press.

    Google Scholar 

  • James, W. (1911a). Percept and concept—the abuse of concepts. In J. McDermott (Ed) (1968), The writings of William James. A comprehensive edition (pp. 243–252). New York: Random House.

  • James, W. (1911b). Percept and concept—the import of concepts. In J. McDermott (Ed) (1968), The writings of William James. A comprehensive edition (pp. 232–243). New York: Random House.

  • James, W. (1976 [1912]). Essays in radical empiricism. Cambridge: Harvard University Press.

  • Jeannerod, M. (1994). The representing brain: Neural correlates of motor intention and imagery. Behavioural Brain Sciences, 17, 187–202.

    Article  Google Scholar 

  • Johnson, M. (1987). The body in the mind. The bodily basis of meaning, imagination, and reason. Chicago: The University of Chicago Press.

    Google Scholar 

  • Juslin, P. N., & Sloboda, J. (Eds.). (2001). Music and emotion: Theory and research. Oxford: Oxford University Press.

    Google Scholar 

  • Kramer, J. (1988). The time of music. New meanings, new temporalities, new listening strategies. New York: Schirmer Books.

    Google Scholar 

  • Krueger, J. (2009). Enacting musical experience. Journal of Consciousness Studies, 16(2–3), 98–123.

    Google Scholar 

  • Krueger, J. (2011). Doing things with music. Phenomenology and the Cognitive Sciences, 10(1), 1–22.

    Article  Google Scholar 

  • Kull, K. (1998). Semiotic ecology: Different natures in the semiosphere. Sign System Studies, 26, 344–371.

    Google Scholar 

  • Lakoff, G. (1987). Women, fire, and dangerous things: What categories reveal about the mind. Chicago: University of Chicago.

    Google Scholar 

  • Lakoff, G., & Johnson, M. (1980). Metaphors we live by. Chicago: University of Chicago Press.

    Google Scholar 

  • Lakoff, G., & Johnson, M. (1999). Philosophy in the flesh: The embodied mind and its challenge to Western thought. New York: Basic Books.

    Google Scholar 

  • Lyons, J. (2011). Circularity, reliability, and the cognitive penetrability of perception. Philosophical Issues, 21, 289–311.

    Article  Google Scholar 

  • Määttänen, P. (1993). Action and experience. A naturalistic approach to cognition. Helsinki: Academia Scientiarum Fennica.

    Google Scholar 

  • Mahon, B. (2008). Action recognition: Is it a motor process? Current Biology, 18(22), R1068–R1069.

    Article  PubMed  CAS  Google Scholar 

  • Martindale, C., & Moore, K. (1989). Relationship of musical preference to collative, ecological, and psychophysical variables. Music Perception, 6(4), 431–446.

    Article  Google Scholar 

  • Maser, S. (1977). Arten der Superzeichenbildung. In R. Posner & H.-P. Reinecke (Eds.), Zeichenprozesse. Semiotische Forschung in den Einzelwissenschaften (pp. 83–107). Wiesbaden: Athenaion.

    Google Scholar 

  • Maturana, H. (1978). Biology of language: The epistemology of reality. In G. Miller & E. Lenneberg (Eds.), Psychology and biology of language and thought (pp. 27–46). New York: Academic.

    Google Scholar 

  • Maturana, H. (1988). Ontology of observing: The biological foundations of self consciousness and the physical domain of existence. Washington: American Society for Cybernetics.

    Google Scholar 

  • Maturana, H., & Varela, F. (1980). Autopoiesis and cognition: The realization of the living. London: Reidel.

    Book  Google Scholar 

  • Maturana, H., & Varela, F. (1986). Tree of knowledge: Biological roots of human understanding. London: Shambhala Publishers.

    Google Scholar 

  • Mazet, C. (1991). Fonctionnalité dans l’organisation catégorielle. In D. Dubois (Ed.), Sémantique et cognition. Catégories, prototypes, typicalité (pp. 89–100). Paris: Editions du CNRS.

    Google Scholar 

  • McAdams, S. (1993). Recognition of sound sources and events. In S. McAdams & E. Bigand (Eds.), Thinking in sound. The cognitive psychology of human audition (pp. 146–198). Oxford: Clarendon.

    Chapter  Google Scholar 

  • McCulloch, R. (1989). Collected works of Warren McCulloch, vols. 1–4. Salinas: Intersystems Publications.

    Google Scholar 

  • Mead, G. (1936). Movements of thought in the nineteenth century. Chicago: University of Chicago Press.

    Google Scholar 

  • Meystel, A. (1998). Multiresolutional Umwelt: Towards a semiotics of neurocontrol. Semiotica, 120(3/4), 343–380.

    Google Scholar 

  • Michaels, C., & Carello, C. (1981). Direct perception. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Mikumo, M. (1994). Motor encoding strategy for pitches of melodies. Music Perception, 12(2), 175–197.

    Article  Google Scholar 

  • Morris, C. (1964). Signification and significance. A study of the relations of signs and values. Cambridge: MIT.

    Google Scholar 

  • Morris, C. (1975 [1938]). Foundations of the theory of signs. Vol. 1, nr. 2. Chicago: University of Chicago Press.

  • Neisser, U. (1967). Cognitive psychology. New York: Appleton-Century Crofts.

    Google Scholar 

  • Noë, A. (2004). Action in perception. Cambridge: MIT.

    Google Scholar 

  • Paillard, J. (1994a). La conscience. In M. Richelle, J. Requin, & M. Robert (Eds.), Traité de psychologie expérimentale. 2 (pp. 639–684). Paris: Presses Universitaires de France.

    Google Scholar 

  • Paillard, J. (1994b). L’intégration sensori-motrice et idéo-motrice. In M. Richelle, J. Requin, & M. Robert (Eds.), Traité de psychologie expérimentale. 1 (pp. 925–961). Paris: Presses Universitaires de France.

    Google Scholar 

  • Pask, G. (1961). An approach to cybernetics. Science today series. New York: Harper & Brothers.

    Google Scholar 

  • Pask, G. (1992). Different kinds of cybernetics. In G. van de Vijver (Ed.), New perspectives on cybernetics: Self-organization, autonomy and connectionism (pp. 11–31). Dordrecht: Kluwer.

    Google Scholar 

  • Peirce, Ch. (1905). The issues of pragmaticism. The Monist, 15(4), 481–499.

    Google Scholar 

  • Peirce, Ch. (1958). In A. Burks (Ed.), Collected papers of Charles Sanders Peirce. Volume VIII. Reviews, correspondence, and bibliography. Cambridge: Harvard University, Press.

    Google Scholar 

  • Peirce, Ch. (1960). In C. Hartshorne & P. Weiss (Eds.), Collected papers of Charles Sanders Peirce. Volume 2. Elements of logic (pp. 138–139). Cambridge: Harvard University Press.

    Google Scholar 

  • Peirce, Ch. (1965). In C. Hartshorne & P. Weiss (Eds.), Collected papers of Charles Sanders Peirce. Volume V. Pragmatics and pragmaticism, and volume VI. scientific metaphysics. Cambridge: Harvard University Press.

    Google Scholar 

  • Peretz, I., & Zatorre, R. (Eds.). (2003). The cognitive neuroscience of music. Oxford: Oxford University Press.

    Google Scholar 

  • Piaget, J. (1937). La construction du réel chez l’enfant. Geneva: Delachaux et Niestlé.

    Google Scholar 

  • Piaget, J. (1945). La formation du symbole chez l’enfant. Neuchâtel: Delachaux et Niestlé.

    Google Scholar 

  • Piaget, J. (1967). Biologie et connaissance. Essai sur les relations entre les régulations organiques et les processus cognitifs. Paris: Gallimard.

    Google Scholar 

  • Pickering, J. (2007). Affordances are signs. Triple C, 5(2), 64–74.

    Google Scholar 

  • Prinz, W., & Bridgeman, B. (1996). Handbook of perception and action. volume 1: Perception. London: Academic.

    Google Scholar 

  • Repp, B., & Knoblich, G. (2007). Action can affect auditory perception. Psychological Science, 18(1), 6–7.

    Article  PubMed  Google Scholar 

  • Reybrouck, M. (2001a). Biological roots of musical epistemology: Functional cycles, Umwelt, and enactive listening. Semiotica, 134(1–4), 599–633.

    Google Scholar 

  • Reybrouck, M. (2001b). Musical imagery between sensory processing and ideomotor simulation. In R. I. Godøy & H. Jörgensen (Eds.), Musical imagery (pp. 117–136). Lisse: Swets & Zeitlinger.

    Google Scholar 

  • Reybrouck, M. (2004). Music cognition, semiotics and the experience of time. Ontosemantical and epistemological claims. Journal of New Music Research, 33(4), 411–428.

    Article  Google Scholar 

  • Reybrouck, M. (2005a). A biosemiotic and ecological approach to music cognition: Event perception between auditory listening and cognitive economy. Axiomathes. An International Journal in Ontology and Cognitive Systems, 15(2), 229–266.

    Google Scholar 

  • Reybrouck, M. (2005b). Body, mind and music: Musical semantics between experiential cognition and cognitive economy. Trans. Transcultural Music Review, 9. Retrieved from: http://www.sibetrans.com/trans/trans9/reybrouck.htm

  • Reybrouck, M. (2006a). Musical creativity between symbolic modelling and perceptual constraints: The role of adaptive behaviour and epistemic autonomy. In I. Deliège & G. Wiggins (Eds.), Musical creativity: Multidisciplinary research in theory and practice (pp. 42–59). Oxford: Psychology Press.

    Google Scholar 

  • Reybrouck, M. (2006b). Music cognition and the bodily approach: Musical instruments as tools for musical semantics. Contemporary Music Review, 25(1/2), 59–68.

    Article  Google Scholar 

  • Reybrouck, M. (2009). Similarity perception as a cognitive tool for musical sense-making: Deictic and ecological claims. Musicae Scientiae. Discussion Forum 4B, 99–11.

  • Reybrouck, M. (2010). Music cognition and real-time listening: Denotation, cue abstraction, route description and cognitive maps. Musicae Scientiae (special issue 2010), 187–202.

  • Sebeok, T., & Umiker-Sebeok, J. (Eds.). (1992). Biosemiotics. Berlin: Mouton de Gruyter.

    Google Scholar 

  • Sharov, A. (2001). Umwelt theory and pragmatism. Semiotica, 134, 211–228.

    Google Scholar 

  • Shaw, R. E., & Turvey, M. T. (1999). Ecological foundations of cognition: II. degrees of freedom and conserved quantities in animal-environment systems. Journal of Consciousness Studies, 6, 111–123.

    Google Scholar 

  • Shepard, R. N. (1984). Ecological constraints on internal representation: Resonant kinematics of perceiving, imagining, thinking, and dreaming. Psychological Review, 91(4), 417–447.

    Article  PubMed  CAS  Google Scholar 

  • Shook, J. (2003). Pragmatic naturalism and realism. Prometheus Books.

  • Stemmer, B. (2000). Neuropragmatics in the 21st century. Brain and Language, 71(1), 233–236.

    Article  PubMed  CAS  Google Scholar 

  • Todd, P. (1999). Motion in music: A neurobiological perspective. Music Perception, 17(1), 115–126.

    Article  Google Scholar 

  • Varela, F., Thompson, E., & Rosch, E. (1991). The embodied mind. Cognitive science and human experience. Cambridge: MIT.

    Google Scholar 

  • von Foerster, H. (Ed.). (1974). Cybernetics of cybernetics. Illinois: University of Illinois.

    Google Scholar 

  • von Foerster, H. (1984). Observing systems. Seaside: Intersystems.

    Google Scholar 

  • von Glasersfeld, E. (1995). Radical constructivism: A way of knowing and learning. London: The Falmer.

    Book  Google Scholar 

  • von Uexküll, J. (1957 [1934]). A stroll through the worlds of animals and men. A picture book of invisible worlds. In C. Schiller (Ed.), Instinctive behavior. The development of a modern concept (pp. 5–80). New York: International Universities Press.

  • von Uexküll, J. (1982 [1940]). The theory of meaning. Semiotica, 42, 25–82.

  • von Uexküll, T. (1982b). Introduction: Meaning and science in Jakob von Uexküll’s concept of biology. Semiotica, 42, 1–24.

    Article  Google Scholar 

  • von Uexküll, T. (1986). From index to icon. A semiotic attempt at interpreting Piaget’s developmental theory. In P. Bouissac, M. Herzfeld, & R. Posner (Eds.), Iconicity. Essays on the nature of culture. Festschrift für Th. A.Sebeok (pp. 119–140). Tübingen: Stauffenburg Verlag.

    Google Scholar 

  • Wagman, J., & Miller, D. (2003). Nested reciprocities: The organism–environment system in perception–action and development. Developmental Psychobiology, 42, 317–334.

    Article  PubMed  Google Scholar 

  • Wallin, N. (1991). Biomusicology. Neurophysiological and evolutionary perspectives on the origins and purposes of music. New York: Pendragon.

    Google Scholar 

  • Wallin, N., Merker, B., & Brown, S. (Eds.). (2000). The origins of music. Cambridge: The MIT.

    Google Scholar 

  • Warren, W. (2006). The dynamics of perception and action. Psychological Review, 11(2), 358–389.

    Article  Google Scholar 

  • Westerlund, H. (2002). Bridging experience, action, and culture in music education. Studia Musica 16. Helsinki: Sibelius Academy.

    Google Scholar 

  • Windsor, W. L. (2004). An ecological approach to semiotics. Journal of the Theory of Social Behaviour, 34(2), 179–198.

    Article  Google Scholar 

  • Zatorre, R., & Peretz, I. (Eds.). (2001). The biological foundations of music. New York: The New York Academy of Sciences.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Leuven, Leuven, Belgium

    Mark Reybrouck

Authors
  1. Mark Reybrouck
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mark Reybrouck.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Reybrouck, M. Musical Sense-Making and the Concept of Affordance: An Ecosemiotic and Experiential Approach. Biosemiotics 5, 391–409 (2012). https://doi.org/10.1007/s12304-012-9144-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12304-012-9144-6

Keywords

Search

Navigation