Dopaminergic Modulation of Risk-Based Decision Making

Author(s): Jennifer R. St. Onge and Stan B. Floresco
Department of Psychology and Brain Research Center, University of British Columbia, Vancouver, BC, Canada
 

Abstract

Psychopharmacological studies have implicated the mesolimbic dopamine (DA) system in the mediation of cost/benefit evaluations about delay or effort-related costs associated with larger rewards. However, the role of DA in risk-based decision making remains relatively unexplored. The present study investigated the effects of systemic manipulations of DA transmission on risky choice using a probabilistic discounting task. Over discrete trials, rats chose between two levers; a press on the 'small/certain' lever always delivered one reward pellet, whereas a press on the other, 'large/risky' lever delivered four pellets, but the probability of receiving reward decreased across the four trial blocks (100, 50, 25, 12.5%). In separate groups of well-trained rats we assessed the effects of the DA releaser amphetamine, as well as receptor selective agonists and antagonists. Amphetamine consistently increased preference for the large/risky lever; an effect that was blocked or attenuated by co-administration of either D1 (SCH23390) or D2 (eticlopride) receptor antagonists. Blockade of either of these receptors alone induced risk aversion. Conversely, stimulation of D1 (SKF81297) or D2 (bromocriptine) receptors also increased risky choice. In contrast, activation of D3 receptors with PD128,907 reduced choice of the large/risky lever. Likewise, D3 antagonism with nafadotride potentiated the amphetamine-induced increase in risky choice. Blockade or stimulation of D4 receptors did not reliably alter behavior. These findings indicate that DA has a critical role in mediating risk-based decision making, with increased activation of D1 and D2 receptors biasing choice toward larger, probabilistic rewards, whereas D3 receptors appear to exert opposing effects on this form of decision making.

Commentary

by Stan B. Floresco, Ph.D., corresponding author

In this study, we systematically assessed how pharmacological manipulations of dopamine transmission in rodents may alter cost/benefit decision making about risks and rewards using a probabilistic discounting task. Previous studies in humans and animals have indirectly implicated the dopamine system in these processes. For example, treatment with dopamine agonist therapy leads to the emergence of pathological gambling tendencies in some individuals. In this study, rats chose between two options, one that delivered a small/certain food reward, and another that larger yet probabilistic ("risky") reward. Under normal conditions, rats discount larger/risky rewards more often as the odds of obtaining them decrease within a session. We observed that increasing dopamine transmission with amphetamine, or selective D1 or D2 receptor agonists induce a marked increase in risky choice, whereas blocking these receptors induced risk aversion. In contrast, manipulations of D3 receptor activity induced effects opposite to those induced by D2 receptor agents.  Our findings indicate that increases or decreases in the fine balance of dopamine transmission can directly affect decisions about certain versus uncertain rewards.  We believe these findings provide novel insight into the perturbations in decision making observed in a number of neuropsychiatric disorders where disruptions in dopamine transmission is though to be a contributing factor.

Thanks for your comments Bill. Your point about 5-HT contribution to risk discounting is well taken. Although we have yet to conduct any studies using 5-HT agents, my suspicion is that they would not have an effect decision making using these procedures. The main reason is that in this discounting task, there are no explicit punishments per se; the “risk” the animal takes on each trial is a lost opportunity to obtain reward. It may be that the 5-HT system may have a greater role in mediating the effect that aversive consequences exert over decision making, rather than adjusting behavior in response to changes in reward probability. In this regard, a study by Mobini et al (2000) showed that central 5-HT depletion did not affect probabilistic discounting (although it did alter delay discounting). An intriguing hypothesis arising from these findings is that dopamine may bias choice towards higher cost but higher value rewards, whereas 5-HT may bias choice away from aversive options.
Stan Floresco
Posted: Sep 15, 2009 3:03 PM
Stan, this is really interesting work. Recent work by Zeeb and Winstanley (also posted on this blog) raises the possibility that 5HT systems are also involved in these types of decision-making processes. Would you be willing/able to share any insights on what a 5HT uptake blocker or other serotonergic drugs might do in this procedure? Thank you, Bill
Bill Carlezon
Posted: Sep 09, 2009 3:40 PM

* indicates a required fieldAdd a Comment

Name *
Email *
Your email address will not be published.

Enter Code Above:
Comment *