ReviewDopamine modulates neural networks involved in effort-based decision-making
Introduction
All animals continuously face decision-making circumstances in which they must choose between two or more options. Making apt decisions is vital as it has a significant impact on key evolutionary outcomes such as survival and reproduction (Gibson and Langen, 1996, Krebs, 1978, Mulder, 1990). Decision-making is a complex process and involves different variables. Recent studies have started to shed light on the neurobiology of decision-making. However, such studies vary widely and include investigations conducted across different species from rats to humans, with investigative methods ranging from the behavioral through to the neural and molecular levels. The aim of the present article is to review the previous findings, using a common framework and terminology. We focus specifically on the decisions that are made to solve a current problem and not on those that are aimed at long-term outcomes. The review also focuses on the decisions that are made to exploit the available options to greatest benefit, rather than those that are adventurous and explore novel alternatives. We provide evidence that decision-making is related to a brain network centered on the dorsal anterior cingulate cortex (dACC) and its related subcortical structures. We also consider how the dopamine system modulates this network at multiple levels to facilitate an optimal decision.
Section snippets
Neural network of decision-making
There are considerable connections between the anterior cingulate cortex (ACC) and the striatum including the nucleus accumbens (NAc) across mammalian species. Reciprocal connections between these brain regions were described in humans more than two decades ago (Alexander et al., 1986); the ACC projects to the NAc, which projects back to the ACC via the mediodorsal (Ongur and Price, 2000, Ray and Price, 1993, Yeterian and Pandya, 1988) and anteroventral nuclei of the thalamus (Xiaob and Barbas,
Molecular basis of decision-making
Assuming that the dACC-striatum-thalamus circuit and its dopamine system are involved in decision-making, the next question is how dopamine modulates this circuit to facilitate an optimal decision. Below, we first review different cortico-basal ganglia models to illustrate an overall view of how the dopamine system modulates the network. Then, we review dopamine studies to provide clues on how this system can facilitate progression of different aspects of decision-making at the molecular level.
Conclusions and implications
Decision-making requires processing of a variety of different variables. These variables can be categorized under two broad processes of evaluation and execution. The former consists of outcome appraisal and cost–benefit analysis and aims to determine the best possible option while the latter consists of motivation and action sequencing and aims to attain the preferred option. Recent animal and human studies suggest that the dACC and its related subcortical structures are at the center of a
Acknowledgements
Dr Yücel is supported by a NH&MRC Clinical Career Development Award (ID: 509345). Prof Pantelis's research is supported by NHMRC Program Grant (ID: 350241). The authors thank Dr. Alex Fornito for his helpful comments on the manuscript.
References (169)
- et al.
The somatodendritic release of dopamine in the ventral tegmental area and its regulation by afferent transmitter systems
Neuroscience and Biobehavioral Reviews
(2004) - et al.
Information processing, dimensionality reduction and reinforcement learning in the basal ganglia
Progress in Neurobiology
(2003) - et al.
Physiological aspects of information processing in the basal ganglia of normal and Parkinsonian primates
Trends in Neurosciences
(1998) - et al.
What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?
Brain Research Brain Research Reviews
(1998) - et al.
Conflict monitoring and anterior cingulate cortex: an update
Trends in Cognitive Sciences
(2004) - et al.
Cognitive and emotional influences in anterior cingulate cortex
Trends in Cognitive Sciences
(2000) - et al.
Dopamine-mediated regulation of corticostriatal synaptic plasticity
Trends in Neurosciences
(2007) - et al.
Is dopamine required for natural reward?
Physiology and Behavior
(2004) - et al.
Individual differences in extraversion and dopamine genetics predict neural reward responses
Brain Research Cognitive Brain Research
(2005) - et al.
Predatory hunting and exposure to a live predator induce opposite patterns of Fos immunoreactivity in the PAG
Behavioural Brain Research
(2003)
Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task
Behavioural Brain Research
Anterior cingulate activity during error and autonomic response
Neuroimage
Relation between methamphetamine-induced monoamine depletions in the striatum and sequential motor learning
Pharmacology, Biochemistry and Behavior
Effects of antipsychotic and antidepressant drugs on action monitoring in healthy volunteers
Brain Research
Primate models of movement disorders of basal ganglia origin
Trends in Neurosciences
A core system for the implementation of task sets
Neuron
Choice selection and reward anticipation: an fMRI study
Neuropsychologia
Neural substrates of choice selection in adults and adolescents: development of the ventrolateral prefrontal and anterior cingulate cortices
Neuropsychologia
How do animals choose their mates?
Trends in Ecology & Evolution
D(1) receptors in prefrontal cells and circuits
Brain Research. Brain Research Reviews
Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia
Neuroscience
Regulation of firing of dopaminergic neurons and control of goal-directed behaviors
Trends in Neurosciences
The basal ganglia: learning new tricks and loving it
Current Opinion in Neurobiology
D1 and D2 dopamine receptor mRNA expression in whole hemisphere sections of the human brain
Journal of Chemical Neuroanatomy
Risk-sensitivity: crossroads for theories of decision making
Trends in Cognitive Sciences
Parallel circuits mediating distinct emotional coping reactions to different types of stress
Neuroscience and Biobehavioral Reviews
Role of the orbital prefrontal cortex in choice between delayed and uncertain reinforcers: a quantitative analysis
Behavioural Processes
Amphetamine modulates human incentive processing
Neuron
FMRI visualization of brain activity during a monetary incentive delay task
Neuroimage
Site and behavioral specificity of periaqueductal gray lesions on postpartum sexual, maternal, and aggressive behaviors in rats
Brain Research
Response options and expectations of reward in decision-making: the differential roles of dorsal and rostral anterior cingulate cortex
Neuroimage
The basal ganglia: focused selection and inhibition of competing motor programs
Progress in Neurobiology
Convergence of limbic input to the cingulate motor cortex in the rhesus monkey
Brain Research Bulletin
D1 or D2 antagonism in nucleus accumbens core or dorsomedial shell suppresses lever pressing for food but leads to compensatory increases in chow consumption
Pharmacology, Biochemistry and Behavior
Parallel organization of functionally segregated circuits linking basal ganglia and cortex
Annual Review of Neuroscience
Anterior cingulate error-related activity is modulated by predicted reward
European Journal of Neuroscience
Prefrontal cortical projections to longitudinal columns in the midbrain periaqueductal gray in macaque monkeys
Journal of Comparative Neurology
The duality of the cingulate gyrus in monkey. Neuroanatomical study and functional hypothesis
Brain
Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories
Nature
Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making
Journal of Neuroscience
Characterization of the decision-making deficit of patients with ventromedial prefrontal cortex lesions
Brain
A computational model of how the basal ganglia produce sequences
Journal of Cognitive Neuroscience
Integration of target and effector information in the human brain during reach planning
Journal of Neurophysiology
Effects of quinolinic acid-induced lesions of the nucleus accumbens core on inter-temporal choice: a quantitative analysis
Psychopharmacology
Choosing the lesser of two evils, the better of two goods: specifying the roles of ventromedial prefrontal cortex and dorsal anterior cingulate in object choice
Journal of Neuroscience
The catechol-O-methyltransferase polymorphism: relations to the tonic-phasic dopamine hypothesis and neuropsychiatric phenotypes
Neuropsychopharmacology
Effect of a single dose of levodopa on sexual response in men and women
Neuropsychopharmacology
Conflict monitoring versus selection-for-action in anterior cingulate cortex
Nature
Learned predictions of error likelihood in the anterior cingulate cortex
Science
Dorsal anterior cingulate cortex: a role in reward-based decision making
Proceedings of the National Academy of Sciences of the United States of America
Cited by (105)
Brain evolution and the meaning of catatonia - An update
2024, Schizophrenia ResearchGeneral cognitive ability and pericortical contrast
2022, IntelligenceThe neural basis of effort valuation: A meta-analysis of functional magnetic resonance imaging studies
2021, Neuroscience and Biobehavioral ReviewsEarly childhood stress is associated with blunted development of ventral tegmental area functional connectivity
2021, Developmental Cognitive NeuroscienceUsing pharmacological manipulations to study the role of dopamine in human reward functioning: A review of studies in healthy adults
2021, Neuroscience and Biobehavioral Reviews