Elsevier

Cortex

Volume 80, July 2016, Pages 196-205
Cortex

Special issue: Viewpoint
Selecting appropriate designs and comparison conditions in repetition paradigms

https://doi.org/10.1016/j.cortex.2015.10.022Get rights and content

Abstract

The studies described by Vogels (this issue) demonstrate the complexity of repetition effects in the visual processing stream. In addition to signal suppression, findings of inherited effects from earlier processing, and discrepancies between the stimulus selectivity of cells before and after repetition, have informed the inferences that can be drawn from measures over larger scales such as functional magnetic resonance imaging (fMRI) or electroencephalography (EEG). This work also demonstrates that integration of evidence across recording methods is vital for understanding repetition effects in the brain. It is however difficult to integrate evidence across different recording methods and repetition paradigms. At the crux of this difficulty is the selection of comparison or unrepeated stimulus conditions within paradigms, which influence the observed strength, selectivity and even direction of repetition effects. This viewpoint highlights prevalent methodological issues with regard to repeated-unrepeated stimulus comparisons: inherited adaptation, stimulus specific expectations, concurrent memory retrieval, stimulus novelty and familiarity, attention, and changes in neuronal selectivity with repetition. The extent to which current conflicting and uncertain findings are due to selection of unrepeated stimulus conditions is unknown, but needs to be addressed to develop models of repetition spanning recording methods and repetition paradigms.

Introduction

Repetition of a stimulus leads to prior exposure-dependent changes in response properties of cortical neurons, widely known as repetition suppression (Desimone, 1996, Ringo, 1996) or adaptation (Kohn, 2007). Repetition suppression is defined as a stimulus-specific reduction in neuronal activity (e.g., neuronal firing rate, functional magnetic resonance imaging (fMRI) blood-oxygen-level dependent (BOLD) signal or scalp-recorded potential) to repeated compared to unrepeated stimuli (Grill-Spector, Henson, & Martin, 2006; depicted in Fig. 1a). In a small number of cases stimulus repetition can also lead to an increase in a measure of neuronal activity, termed repetition enhancement (Henson et al., 2000, James et al., 2000, Segaert et al., 2013). Adaptation occurs with stimulus repetition but indexes a more diverse array of effects than repetition suppression, including changes in response magnitude and the shape and width of tuning curves to stimulus features (Kohn, 2007, Wissig and Kohn, 2012). These adaptation effects can vary over the time course of a neuron's response, and the time window of analysis can be crucial to delineate adaptation effects in the initial part of the response (e.g., Kaliukhovich and Vogels, 2012, Liu et al., 2009) from later effects of adaptation on intracortical interactions (Patterson, Wissig, & Kohn, 2013) or prediction-related suppression of neuronal activity (Grotheer and Kovács, 2015, Summerfield et al., 2011, Todorovic and de Lange, 2012).

The studies summarized in Vogels (2016) have greatly influenced our understanding of the complex array of repetition effects in the visual system. Several key experiments (De Baene and Vogels, 2010, Sawamura et al., 2006) have found not only increases or decreases in neuronal activity with repetition, but also inherited effects from earlier visual processing and changes in the stimulus-selectivity of neurons. These results have provided valuable information about the inferences that can be drawn from repetition effects observed using fMRI BOLD or electroencephalography (EEG)/magnetoencephalography (MEG). They also demonstrate that careful integration of evidence across recording methods is necessary to understand repetition effects, given the differential sensitivity of each recording method to different aspects of neuronal activity (Logothetis, 2008). In this sense, each recording method provides a “piece of the puzzle”, in which suppression in one measure may even co-occur with enhancement in another (De Baene and Vogels, 2010, Stopfer and Laurent, 1999).

These studies also remind us that repetition-induced suppression or enhancement is a change measure and therefore inherently relies on a comparison condition: the response to an equivalent unrepeated stimulus. The unrepeated stimulus condition dictates the detection of repetition-specific suppression/enhancement separate from other phenomena such as changes in attention and expectation (Kovács & Vogels, 2014). A significant challenge in harmonizing evidence across studies and measures of neuronal activity stems from the different paradigms, featuring different unrepeated stimulus conditions, which are used to define repetition effects. The choice of unrepeated stimulus condition guides the interpretability, strength, specificity and possibly even direction of the effect.

This viewpoint focuses on factors relevant to repeated-unrepeated stimulus comparisons in adaptation and repetition paradigms. Firstly, general issues relating to repeated-unrepeated stimulus comparisons in repetition paradigms are identified. Following this, the basic versions of major paradigms in the field are evaluated according to advantages and disadvantages of the unrepeated stimulus condition choice. This viewpoint concludes with a discussion of how confounding factors differ across paradigms, and ways to investigate the influences of confounding factors on existing reports of repetition-specific effects.

Section snippets

Inherited adaptation from earlier stages

Repetition effects occur in multiple levels of the visual system, and there is strong evidence of changes in high-level visual areas as a result of altered input from upstream regions such as early visual cortex (Kohn and Movshon, 2003, Larsson and Harrison, 2015, Solomon et al., 2004, Tolias et al., 2005). Isolating high-level repetition effects is especially difficult because repeated stimuli typically share low-level visual features such as local orientation or curvature information, in

Within-trial repetition designs

Within-trial repetition designs present trials of two consecutive stimuli (adapter and test) separated by an interstimulus interval, displayed in Fig. 1. These designs allow event-related fMRI analyses to estimate the time-course of the BOLD response, at the cost of decreased detection power compared to blocked designs (Liu, Frank, Wong, & Buxton, 2001). In these cases it is important to balance the trial order across conditions, for example using M-sequences (Buračas & Boynton, 2002).

Integrating evidence across paradigms

From the evaluation of the above paradigms it appears that there is no optimal repeated-unrepeated stimulus comparison for all purposes. Within-trial, blocked and oddball designs can be affected by inherited adaptation effects and imbalances in stimulus-specific expectations between the repeated and unrepeated stimuli, both of which may have contributed to observed repetition effects in many previous experiments. Across-trial and delayed match-to-sample designs provide some control over these

Conclusions

The issues related to repeated-unrepeated stimulus comparisons described in this viewpoint can affect the magnitude, detectability, stimulus-selectivity and even direction of observed repetition effects. In order to develop quantitative models of repetition effects across recording methods, these unrepeated stimulus-related confounds should be further investigated to estimate the magnitude of their effects and specificity to different measures of neuronal activity. Existing designs (Grotheer

Acknowledgements

D.F. thanks Hannah A.D. Keage for her insightful commentary on earlier drafts, and Alina Peter, whose discussions with the author formed the basis of this paper.

References (96)

  • B.Y. Hayden et al.

    Combined effects of spatial and feature-based attention on responses of V4 neurons

    Vision Research

    (2009)
  • R.N. Henson

    Neuroimaging studies of priming

    Progress in Neurobiology

    (2003)
  • R.N. Henson et al.

    Stimulus-response bindings in priming

    Trends in Cognitive Science

    (2014)
  • R.N. Henson et al.

    The effect of repetition lag on electrophysiological and haemodynamic correlates of visual object priming

    NeuroImage

    (2004)
  • A.J. Horner et al.

    Priming, response learning and repetition suppression

    Neuropsychologia

    (2008)
  • A.C. Huk et al.

    Neuronal basis of the motion aftereffect reconsidered

    Neuron

    (2001)
  • T.W. James et al.

    The effects of visual object priming on brain activation before and after recognition

    Current Biology

    (2000)
  • A. Kohn et al.

    Neuronal adaptation to visual motion in area MT of the macaque

    Neuron

    (2003)
  • W. Koutstaal et al.

    Perceptual specificity in visual object priming: functional magnetic resonance imaging evidence for a laterality difference in fusiform cortex

    Neuropsychologia

    (2001)
  • G. Kovács et al.

    Position-specific and position-invariant face aftereffects reflect the adaptation of different cortical areas

    NeuroImage

    (2008)
  • G. Kovács et al.

    Stimulus repetition probability effects on repetition suppression are position invariant for faces

    NeuroImage

    (2012)
  • B. Krekelberg et al.

    Adaptation: from single cells to BOLD signals

    Trends in Neurosciences

    (2006)
  • T.T. Liu et al.

    Detection power, estimation efficiency, and predictability in event-related fMRI

    NeuroImage

    (2001)
  • C.A. Patterson et al.

    Adaptation disrupts motion integration in the primate dorsal stream

    Neuron

    (2014)
  • J.L. Ringo

    Stimulus specific adaptation in inferior temporal and medial temporal cortex of the monkey

    Behavioural Brain Research

    (1996)
  • H. Sawamura et al.

    Selectivity of neuronal adaptation does not match response selectivity: a single-cell study of the FMRI adaptation paradigm

    Neuron

    (2006)
  • K. Segaert et al.

    The suppression of repetition enhancement: a review of fMRI studies

    Neuropsychologia

    (2013)
  • S.G. Solomon et al.

    Profound contrast adaptation early in the visual pathway

    Neuron

    (2004)
  • S. Suzuki

    Attention-dependent brief adaptation to contour orientation: a high-level aftereffect for convexity?

    Vision Research

    (2001)
  • R. Vogels

    Sources of adaptation of inferior temporal cortical responses

    Cortex

    (2016)
  • J.Z. Xiang et al.

    Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe

    Neuropharmacology

    (1998)
  • A. Alink et al.

    Stimulus predictability reduces responses in primary visual cortex

    Journal of Neuroscience

    (2010)
  • G.C. Baylis et al.

    Responses of neurons in the inferior temporal cortex in short term and serial recognition memory tasks

    Experimental Brain Research

    (1987)
  • A.B. Bonds

    Temporal dynamics of contrast gain in single cells of the cat striate cortex

    Visual Neuroscience

    (1991)
  • C.W. Clifford et al.

    Fitting the mind to the world: Adaptation and after-effects in high-level vision

    (2005)
  • M. Corbetta et al.

    Attentional modulation of neural processing of shape, color, and velocity in humans

    Science

    (1990)
  • W. De Baene et al.

    Effects of adaptation on the stimulus selectivity of macaque inferior temporal spiking activity and local field potentials

    Cerebral Cortex

    (2010)
  • R. Desimone

    Neural mechanisms for visual memory and their role in attention

    Proceedings of the National Academy of Sciences of the United States of America

    (1996)
  • I.G. Dobbins et al.

    Cortical activity reductions during repetition priming can result from rapid response learning

    Nature

    (2004)
  • M. Dzhelyova et al.

    The effect of parametric stimulus size variation on individual face discrimination indexed by fast periodic visual stimulation

    BMC Neuroscience

    (2014)
  • T. Egner et al.

    Expectation and surprise determine neural population responses in the ventral visual stream

    Journal of Neuroscience

    (2010)
  • R.A. Epstein et al.

    Two kinds of FMRI repetition suppression? Evidence for dissociable neural mechanisms

    Journal of Neurophysiology

    (2008)
  • F.L. Fahy et al.

    Neuronal activity related to visual recognition memory: long-term memory and the encoding of recency and familiarity information in the primate anterior and medial inferior temporal and rhinal cortex

    Experimental Brain Research

    (1993)
  • F. Fang et al.

    Duration-dependent FMRI adaptation and distributed viewer-centered face representation in human visual cortex

    Cerebral Cortex

    (2007)
  • F. Fang et al.

    Orientation-tuned FMRI adaptation in human visual cortex

    Journal of Neurophysiology

    (2005)
  • B.J. Farley et al.

    Stimulus-specific adaptation in auditory cortex is an NMDA-independent process distinct from the sensory novelty encoded by the mismatch negativity

    Journal of Neuroscience

    (2010)
  • Y.I. Fishman et al.

    Searching for the mismatch negativity in primary auditory cortex of the awake monkey: deviance detection or stimulus specific adaptation?

    Journal of Neuroscience

    (2012)
  • K. Friston

    A theory of cortical responses

    Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences

    (2005)
  • Cited by (17)

    • Evaluating the evidence for expectation suppression in the visual system

      2021, Neuroscience and Biobehavioral Reviews
      Citation Excerpt :

      Any co-occurring differences with respect to other factors may potentially inflate or mimic effects of ES. In fact, this is also a central concern in relation to how other response modulations, such as RS, are measured (reviewed in Feuerriegel, 2016). Recently, the designs of many past experiments that tested for ES have been called into question.

    • Visual mismatch responses index surprise signalling but not expectation suppression

      2021, Cortex
      Citation Excerpt :

      For example, Javitt et al. (1998) presented auditory deviants at probabilities ranging between .56% and 15%, and found progressively more negative-going mismatch response amplitudes in smaller deviant probability blocks (see also Pincze et al., 2002). Experiments presenting stimuli at very low probabilities should include a familiarisation period to avoid potential confounding effects of stimulus novelty that may differ between expected and surprising stimuli (reviewed in Schomaker & Meeter, 2015; Feuerriegel, 2016). We also note that other phenomena than those identified here are likely to influence VMR magnitudes, and may operate over a broad range of timescales (see Maheu et al., 2019; Sawamura et al., 2006; Ulanovsky et al., 2004).

    • A proportionally suppressed and prolonged LPP acts as a neurophysiological correlate of face identity aftereffect

      2020, Brain Research
      Citation Excerpt :

      However, there are still limitations of this study. First, it is noteworthy that there might be still possible influences brought by inherited effects from earlier visual processing and changes in the stimulus-selectivity of neurons (Feuerriegel, 2016; Larsson et al., 2016), although we have tried to minimize this part of effect by changing the sizes of successive images. Second, we used Caucasian faces stimuli for Chinese participants in this study.

    • Measures of repetition suppression in the fusiform face area are inflated by co-occurring effects of statistically learned visual associations

      2020, Cortex
      Citation Excerpt :

      When interpreting these findings, it is important to differentiate the neural mechanisms of RS from how RS is measured within an experiment (typically as a difference between a comparable repeated and unrepeated stimulus condition). In such experiments, any effect that will influence repeated and unrepeated stimulus-evoked responses in different ways will also contribute to the measured magnitude of RS, even if that effect is unrelated to the underlying processes responsible for RS (reviewed in Feuerriegel, 2016). In Summerfield et al. (2008) and similar experiments, participants could learn to expect stimulus repetitions in the 75% repetition blocks, whereby in the same block unrepeated stimulus trials were relatively rare and surprising.

    View all citing articles on Scopus
    View full text