Illuminating the Neural Circuitry Underlying Context-dependent Reward-seeking
By: Julia Yu
(Supervisor: Dr. Jonathan Britt)
Our memory of a painful or pleasurable experience is defined by the surrounding context. Contexts provide structure and meaning to our experiences and affect how we interpret environmental cues. Considering that a given environment may be associated with both positive and negative events and that the emotional significance attached to a context can change over time, how do we judge when a stimulus might be relevant for signalling reward or danger? The ability to use contextual cues to respond flexibly across different situations is critical for a creature’s survival, and a major goal in neuroscience is to understand how the brain acquires and uses these associations to generate adaptive behaviours.
Many mental illnesses involve deficits in the contextual regulation of behaviour, including drug addiction, schizophrenia, and post-traumatic stress disorder1. These diagnoses are often concurrent and are a leading cause of disability in Canada2. A compelling explanation for the high degree of comorbidity between substance use and psychiatric disorders is that they may share a common brain mechanism. One well-studied brain area that has been linked to a number of psychiatric conditions is the nucleus accumbens (NAc), which integrates contextual, emotional, and motivational cues to coordinate goal-directed behaviour3, 4. A predominant excitatory projection to the NAc comes from the ventral subiculum (vSub), the main output region of the hippocampus5. Neurons in the ventral hippocampus and NAc encode information about spatial contexts6, 7 and are excited by both positively- and negatively-valenced stimuli such as food and foot shock8-10. While much is known about how these regions function independently, it is unclear how they interact to govern motivated behaviours, such as when to seek out rewards or avoid danger.
Here, we used a method called optogenetics to determine whether hippocampal inputs to the nucleus accumbens are necessary for regulating motivated behaviours depending on the emotional valence of a context. By using lasers to activate light-sensitive proteins (opsins) expressed in specific cell types, optogenetics allows researchers to switch neurons on or off with millisecond precision in awake, behaving mammals11. We sought to address this question by silencing hippocampal projections to the NAc while rats engaged in reward-seeking behaviour measured by the number of lever presses made to obtain a food reward. Prior to behavioural training, I injected a virus in the vSub that drove expression of a light-activated, inhibitory proton pump under a promoter expressed by excitatory glutamatergic neurons (AAV9-CaMKIIα-ArchT-GFP). I next implanted optical fibres above the shell subregion of the NAc to enable light-induced inhibition of vSub axon terminals (Fig. 1a). Rats were then trained to lever press for food before undergoing auditory fear conditioning, in which a neutral tone is associated with an aversive outcome through repeated pairings with a mildly painful foot shock (Fig. 1b). Each animal was tested 24 and 48 hours later with and without optogenetic inhibition. If the hippocampus-to-accumbens pathway is responsible for activating contextually relevant behaviours under bivalent conditions, then blocking vSub inputs in a context exclusively associated with the availability of food reward should reduce reward-seeking behaviour. Likewise, inactivating vSub terminals in a context associated with an aversive experience should block fearful behaviour and increase reward-seeking. We also asked if this pathway is involved in context-related fear learning by inhibiting during fear conditioning. If vSub-to-NAc afferents ‘re-wire’ to dampen reward-seeking after an aversive event, then animals with these axons inhibited during fear conditioning should show less fear and lever-press more when tested without perturbation of this pathway.
We observed a significant decrease in reward-seeking when vSub-to-NAc projections were silenced before tone-shock exposure (Fig. 1c), raising the possibility that activity in this pathway may be required to initiate and sustain motivated responding in reward-predictive contexts. Interestingly, inhibiting these projections during fear conditioning did not disinhibit later reward-seeking when animals were tested without light, suggesting that plasticity between hippocampus-to-accumbens connections is not required for learning about the status of a context as a predictor of reward or pain (Fig. 1d). Lastly, vSub-to-NAc projections do not appear to be necessary for controlling motivated behaviours under aversive conditions, as inhibition did not affect lever-pressing after a shift in the emotional valence of a context from positive to negative (Fig.1e). Together, our results indicate that hippocampal inputs to the nucleus accumbens may be essential for activating goal-directed behaviours in appetitive, but not aversive, contexts.
How might the hippocampus-to-accumbens pathway be important for promoting reward-seeking? The actions of dopamine and glutamate release in the NAc are necessary for sustaining motivated behaviour, and disrupting glutamatergic signalling by silencing hippocampal inputs may be enough to suppress motivated responding. This is consistent with the idea that aberrant processing of glutamatergic afferents to the nucleus accumbens from the hippocampus as well as the amygdala and prefrontal cortex may play a role in psychiatric disease states characterized by a dysregulation of dopamine12-14.
In order to resolve the underlying pathophysiology of psychiatric disorders, we must first understand the neural circuits that regulate basic processes such as motivation and reinforcement learning. Many questions remain about how connections between brain regions that process bivalent stimuli such as the hippocampus and accumbens communicate to drive goal-directed action across diverse contexts. The powerful genetic tools available to today’s neuroscientists are making it possible to start investigating these questions with unprecedented precision. Insights gained from a neural circuit-mapping approach carry far-reaching implications for the development of more specific therapeutic interventions to ultimately improve the lives of patients afflicted by mental illness.
Click image for larger version.
(a) Pathway-specific targeting of hippocampal afferents to the nucleus accumbens using optogenetics: virally-mediated expression of the light-sensitive inhibitory proton pump ArchT in the ventral subiculum of the hippocampus (vSub) with optic fibre implantation above the nucleus accumbens shell (NAcSh).
(b) Rats learned to lever-press for food before receiving repeated tone-foot shock pairings in the same chamber (fear conditioning). Reward-seeking behaviour was measured in two subsequent test sessions; each subject received one light-on session.
(c-e) Mean lever presses before and after tone-shock exposure, expressed as a percentage of the session immediately before fear conditioning (baseline). Coloured bars correspond to the session in which rats received light inhibition. (c) Inhibiting vSub-to-NAcSh terminals reduced reward-seeking in photostimulated rats (On) relative to light-off controls (Off). (d) Rats that received light inhibition during fear conditioning did not differ from controls in the number of lever-presses made when tested without light. (e) Inhibiting this pathway did not affect motivated responding when tested after shifting the emotional valence of a context from appetitive to aversive.
N.s., not significant. *p < .05. Error bars, s.e.m. Schematic images in (b), modified from 15, 16.
References
1. Maren, S., Phan, K. L., & Liberzon, I. (2013). The contextual brain: implications for fear conditioning, extinction and psychopathology. Nature Reviews Neuroscience, 14(6), 417-428.
2. Canadian Centre on Substance Abuse. (2009). Substance Abuse in Canada: Concurrent Disorders. Retrieved from .
3. Russo, S. J., & Nestler, E. J. (2013). The brain reward circuitry in mood disorders. Nature Reviews Neuroscience, 14(9), 609-625.
4. Sesack, S. R., & Grace, A. A. (2010). Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology, 35(1), 27-47.
5. Britt, J. P., Benaliouad, F., McDevitt, R. A., Stuber, G. D., Wise, R. A., & Bonci, A. (2012). Synaptic and behavioral profile of multiple glutamatergic inputs to the nucleus accumbens. Neuron, 76(4), 790-803.
6. Kjelstrup, K. B., Solstad, T., Brun, V. H., Hafting, T., Leutgeb, S., Witter, M. P., ... & Moser, M. B. (2008). Finite scale of spatial representation in the hippocampus. Science, 321(5885), 140-143.
7. Lavoie, A. M., & Mizumori, S. J. Y. (1994). Spatial, movement-and reward-sensitive discharge by medial ventral striatum neurons of rats. Brain Research, 638(1), 157- 168.
8. Keinath, A. T., Wang, M. E., Wann, E. G., Yuan, R. K., Dudman, J. T., & Muzzio, I. A. (2014). Precise spatial coding is preserved along the longitudinal hippocampal axis. Hippocampus, 24(12), 1533-1548.
9. Moita, M. A., Rosis, S., Zhou, Y., LeDoux, J. E., & Blair, H. T. (2004). Putting fear in its place: remapping of hippocampal place cells during fear conditioning. The Journal of Neuroscience, 24(31), 7015-7023.
10. Roitman, M. F., Wheeler, R. A., & Carelli, R. M. (2005). Nucleus accumbens neurons are innately tuned for rewarding and aversive taste stimuli, encode their predictors, and are linked to motor output. Neuron, 45(4), 587-597.
11. Yizhar, O., Fenno, L. E., Davidson, T. J., Mogri, M., & Deisseroth, K. (2011). Optogenetics in neural systems. Neuron, 71(1), 9-34.
12. Nestler, E. J., Barrot, M., DiLeone, R. J., Eisch, A. J., Gold, S. J., & Monteggia, L. M. (2002). Neurobiology of depression. Neuron, 34(1), 13-25.
13. Lodge, D. J., & Grace, A. A. (2007). Aberrant hippocampal activity underlies the dopamine dysregulation in an animal model of schizophrenia. The Journal of Neuroscience, 27(42), 11424-11430.
14. McCollum, L. A., Walker, C. K., Roche, J. K., & Roberts, R. C. (2015). Elevated Excitatory Input to the Nucleus Accumbens in Schizophrenia: A Postmortem Ultrastructural Study. Schizophrenia Bulletin, sbv030.
15. Solinas, M., Panlilio, L. V., Justinova, Z., Yasar, S., & Goldberg, S. R. (2006). Using drug discrimination techniques to study the abuse-related effects of psychoactive drugs in rats. Nature Protocols, 1(3), 1194-1206.
16. Namburi, P., Beyeler, A., Yorozu, S., Calhoon, G. G., Halbert, S. A., Wichmann, R., … & Tye, K. M. (2015). A circuit mechanism for differentiating positive and negative associations. Nature, 520(7549), 675-678.