Abstract
Several studies have shown that the direction in which a visual apparent motion stream moves can influence the perceived direction of an auditory apparent motion stream (an effect known as crossmodal dynamic capture). However, little is known about the role that intramodal perceptual grouping processes play in the multisensory integration of motion information. The present study was designed to investigate the time course of any modulation of the cross-modal dynamic capture effect by the nature of the perceptual grouping taking place within vision. Participants were required to judge the direction of an auditory apparent motion stream while trying to ignore visual apparent motion streams presented in a variety of different configurations. Our results demonstrate that the cross-modal dynamic capture effect was influenced more by visual perceptual grouping when the conditions for intramodal perceptual grouping were set up prior to the presentation of the audiovisual apparent motion stimuli. However, no such modulation occurred when the visual perceptual grouping manipulation was established at the same time as or after the presentation of the audiovisual stimuli. These results highlight the importance of the unimodal perceptual organization of sensory information to the manifestation of multisensory integration.
Article PDF
Similar content being viewed by others
References
Allen, P., & Kolers, P. (1981). Sensory specificity of apparent motion. Journal of Experimental Psychology, 7, 1318–1326.
Beck, D. M., & Palmer, S. E. (2002). Top-down influences on perceptual grouping. Journal of Experimental Psychology: Human Perception & Performance, 28, 1071–1084.
Bertelson, P., & de Gelder, B. (2004). The psychology of multimodal perception. In C. Spence & J. Driver (Eds.), Crossmodal space and crossmodal attention (pp. 141–179). Oxford: Oxford University Press.
Calvert, G. A., Spence, C., & Stein, B. E. (Eds.), (2004). The handbook of multisensory processes. Cambridge, MA: MIT Press.
Driver, J., & Spence, C. (2000). Multisensory perception: Beyond modularity and convergence. Current Biology, 10, 311–331.
Ehrenstein, W. H., & Reinhardt-Rutland, A. H. (1996). A crossmodal aftereffect: Auditory displacement following adaptation to visual motion. Perceptual & Motor Skills, 82, 23–26.
Francis, G., & Grossberg, S. (1996). Cortical dynamics of form and motion integration: Persistence, apparent motion, and illusory contours. Vision Research, 36, 149–173.
Geldard, F. A. (1976). The saltatory effect in vision. Sensory Processes, 1, 77–86.
Hagen, M. C., Franzen, O., McGlone, F., Essick, G., Dancer, C., & Pardo, J. V. (2002). Tactile motion activates the human middle temporal (MT/V5) complex. European Journal of Neuroscience, 16, 957–964.
Howard, L. P., & Templeton, W. B. (1966). Human spatial orientation. New York: Wiley.
Kilgard, M. P., & Merzenich, M. M. (1995). Anticipated stimuli across skin. Nature, 373, 663.
Koffka, K. (1935). Principles of Gestalt psychology. New York: Harcourt Brace.
Kubovy, M., & Van Valkenburg, D. (2001). Auditory and visual objects. Cognition, 80, 97–126.
Lockhead, G. R., Johnson, R. C., & Gold, F. M. (1980). Saltation through the blind spot. Perception & Psychophysics, 27, 545–549.
Mateeff, S., Hohnsbein, J., & Noack, T. (1985). Dynamic visual capture: Apparent auditory motion induced by a moving visual target. Perception, 14, 721–727.
Niemi, P., & Näätänen, R. (1981). Foreperiod and simple reaction time. Psychological Bulletin, 89, 133–162.
Palmer, S. T. (2002). Perceptual grouping: It’s later than you think. Current Directions in Psychological Science, 11, 101–106.
Palmer, S. T., Brooks, J. L., & Nelson, R. (2003). When does grouping happen? Acta Psychologica, 114, 311–330.
Phillips, D. P., & Hall, S. E. (2001). Spatial and temporal factors in auditory saltation. Journal of the Acoustical Society of America, 110, 1539–1547.
Posner, M. I. (1978). Chronometric explorations of mind. Hillsdale, NJ: Erlbaum.
Sanabria, D., Soto-Faraco, S, Chan, J., & Spence, C. (2003). Intramodal perceptual grouping modulates multisensory integration: Evidence from the crossmodal dynamic capture task. Manuscript submitted for publication.
Shore, D. I., Hall, S. E., & Klein, R. M. (1998). Auditory saltation: A new measure for an old illusion. Journal of the Acoustical Society of America, 103, 3730–3733.
Soto-Faraco, S., & Kingstone, A. (2004). Multisensory integration of dynamic information. In G. Calvert, C. Spence & B. E. Stein (Eds.), The handbook of multisensory processes (pp. 49–69). Cambridge, MA: MIT Press.
Soto-Faraco, S., Kingstone, A., & Spence, C. (2003). Multisensory contributions to the perception of motion. Neuropsychologia, 41, 1847–1862.
Soto-Faraco, S., Lyons, J., Gazzaniga, M., Spence, C., & Kingstone, A. (2002). The ventriloquist in motion: Illusory capture of dynamic information across sensory modalities. Cognitive Brain Research, 14, 139–146.
Soto-Faraco, S., Spence, C., & Kingstone, A. (2004). Cross-modal dynamic capture: Congruency effects of motion perception across sensory modalities. Journal of Experimental Psychology: Human Perception & Performance, 30, 330–345.
Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59, 1–22.
Staal, H. E., & Donderi, D. C. (1983). The effect of sound on visual apparent movement. American Journal of Psychology, 96, 95–105.
Stein, B. E., & Meredith, M. A. (1993). The merging of the senses. Cambridge, MA: MIT Press.
Vroomen. J., & de Gelder, B. (2000). Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception & Performance, 26, 1583–1590.
Watanabe, K., & Shimojo, S. (2001). When sound affects vision: Effects of auditory grouping on visual perception. Psychological Science, 12, 109–116.
Wertheimer, M. (1950). Laws of organization in perceptual forms. In W. D. Ellis (Ed.), A sourcebook of Gestalt psychology (pp. 71–81). New York: Humanities Press. [Original work published 1923]
Wuerger, S. M., Hofbauer, M., & Meyer, G. F. (2003). The integration of auditory and visual motion signals at threshold. Perception & Psychophysics, 65, 1188–1196.
Zapparoli, G. C., & Reatto, L. L. (1969). The apparent movement between visual and acoustic stimulus and the problem of intermodal relations. Acta Psychologica, 29, 256–267.
Author information
Authors and Affiliations
Corresponding author
Additional information
This study was supported by a Network Grant from the McDonnell-Pew Centre for Cognitive Neuroscience in Oxford to S.S.-F. and C.S. Department of Experimental Psychology, South Parks Road, Oxford
Rights and permissions
About this article
Cite this article
Sanabria, D., Soto-Faraco, S., Chan, J.S. et al. When does visual perceptual grouping affect multisensory integration?. Cognitive, Affective, & Behavioral Neuroscience 4, 218–229 (2004). https://doi.org/10.3758/CABN.4.2.218
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/CABN.4.2.218