Citation Relationships

Legends: Link to a Model Reference cited by multiple papers


Gurney KN, Humphries MD, Redgrave P (2015) A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS Biol 13:e1002034 [PubMed]

   Cortico-striatal plasticity in medium spiny neurons (Gurney et al 2015)

References and models cited by this paper

References and models that cite this paper

Abbott LF, Nelson SB (2000) Synaptic plasticity: taming the beast. Nat Neurosci 3 Suppl:1178-83 [Journal] [PubMed]
Alexander GE, Crutcher MD (1990) Functional architecture of basal ganglia circuits: neural substrates of parallel processing. Trends Neurosci 13:266-71 [PubMed]
Alexander GE, DeLong MR (1985) Microstimulation of the primate neostriatum. II. Somatotopic organization of striatal microexcitable zones and their relation to neuronal response properties. J Neurophysiol 53:1417-30 [Journal] [PubMed]
Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-81 [Journal] [PubMed]
Barnes TD, Kubota Y, Hu D, Jin DZ, Graybiel AM (2005) Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437:1158-61 [Journal] [PubMed]
Bauswein E, Fromm C, Preuss A (1989) Corticostriatal cells in comparison with pyramidal tract neurons: contrasting properties in the behaving monkey. Brain Res 493:198-203 [PubMed]
Bayer HM, Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47:129-41 [Journal] [PubMed]
Bayer HM, Lau B, Glimcher PW (2007) Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol 98:1428-39 [Journal] [PubMed]
Berke JD, Hyman SE (2000) Addiction, dopamine, and the molecular mechanisms of memory. Neuron 25:515-32 [PubMed]
Bienenstock EL, Cooper LN, Munro PW (1982) Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex. J Neurosci 2:32-48 [PubMed]
Bolado-Gomez R, Gurney K (2013) A biologically plausible embodied model of action discovery. Front Neurorobot 7:4 [Journal] [PubMed]
Bornstein AM, Daw ND (2011) Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 21:374-80 [Journal] [PubMed]
Bouton ME (2004) Context and behavioral processes in extinction. Learn Mem 11:485-94 [Journal] [PubMed]
Bouton ME, Todd TP, Vurbic D, Winterbauer NE (2011) Renewal after the extinction of free operant behavior. Learn Behav 39:57-67 [Journal] [PubMed]
Brown LL, Sharp FR (1995) Metabolic mapping of rat striatum: somatotopic organization of sensorimotor activity. Brain Res 686:207-22 [PubMed]
Calabresi P, Picconi B, Tozzi A, Di Filippo M (2007) Dopamine-mediated regulation of corticostriatal synaptic plasticity. Trends Neurosci 30:211-9 [Journal] [PubMed]
Centonze D, Picconi B, Gubellini P, Bernardi G, Calabresi P (2001) Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur J Neurosci 13:1071-7 [PubMed]
Cragg SJ, Rice ME (2004) DAncing past the DAT at a DA synapse. Trends Neurosci 27:270-7 [Journal] [PubMed]
Crombag HS, Shaham Y (2002) Renewal of drug seeking by contextual cues after prolonged extinction in rats. Behav Neurosci 116:169-73 [PubMed]
Cui G, Jun SB, Jin X, Pham MD, Vogel SS, Lovinger DM, Costa RM (2013) Concurrent activation of striatal direct and indirect pathways during action initiation. Nature 494:238-42 [Journal] [PubMed]
Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-11 [Journal] [PubMed]
De Leonibus E, Costantini VJ, Massaro A, Mandolesi G, Vanni V, Luvisetto S, Pavone F, Oliverio A, Mele A (2011) Cognitive and neural determinants of response strategy in the dual-solution plus-maze task. Learn Mem 18:241-4 [Journal] [PubMed]
Dickinson A (1985) Actions and habits: The development of behavioural autonomy Phil Trans Royal Soc London B 308:67-78
Elsner B, Hommel B (2004) Contiguity and contingency in action-effect learning. Psychol Res 68:138-54 [Journal] [PubMed]
Evans RC, Maniar YM, Blackwell KT (2013) Dynamic modulation of spike timing-dependent calcium influx during corticostriatal upstates. J Neurophysiol 110:1631-45 [Journal] [PubMed]
   Calcium influx during striatal upstates (Evans et al. 2013) [Model]
Fan D, Rossi MA, Yin HH (2012) Mechanisms of action selection and timing in substantia nigra neurons. J Neurosci 32:5534-48 [Journal] [PubMed]
Faure A, Haberland U, Condé F, El Massioui N (2005) Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation. J Neurosci 25:2771-80 [Journal] [PubMed]
Fee MS (2012) Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions. Front Neural Circuits 6:38 [Journal] [PubMed]
Fino E, Glowinski J, Venance L (2005) Bidirectional activity-dependent plasticity at corticostriatal synapses. J Neurosci 25:11279-87 [Journal] [PubMed]
Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 17:51-72 [Journal] [PubMed]
   Dynamic dopamine modulation in the basal ganglia: Learning in Parkinson (Frank et al 2004,2005) [Model]
Freeze BS, Kravitz AV, Hammack N, Berke JD, Kreitzer AC (2013) Control of basal ganglia output by direct and indirect pathway projection neurons. J Neurosci 33:18531-9 [Journal] [PubMed]
Gremel CM, Costa RM (2013) Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat Commun 4:2264 [Journal] [PubMed]
Gurney K, Prescott TJ, Redgrave P (2001) A computational model of action selection in the basal ganglia. II. Analysis and simulation of behaviour. Biol Cybern 84:411-23 [Journal] [PubMed]
   A contracting model of the basal ganglia (Girard et al. 2008) [Model]
   Population-level model of the basal ganglia and action selection (Gurney et al 2001, 2004) [Model]
Gurney K, Prescott TJ, Redgrave P (2001) A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol Cybern 84:401-10 [Journal] [PubMed]
   Population-level model of the basal ganglia and action selection (Gurney et al 2001, 2004) [Model]
Gurney K,Lepora N,Shah A,Koene A,Redgrave P (2013) Action discovery and intrinsic motivation: a biologically constrained formalisation Intrinsically motivated learning in natural and artificial systems., Baldassarre G:Mirolli M, ed. pp.151
Haber SN, Fudge JL, McFarland NR (2000) Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20:2369-82 [PubMed]
Hart AS, Rutledge RB, Glimcher PW, Phillips PE (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34:698-704 [Journal] [PubMed]
Hikosaka O, Takikawa Y, Kawagoe R (2000) Role of the basal ganglia in the control of purposive saccadic eye movements. Physiol Rev 80:953-78 [Journal] [PubMed]
Houk JC, Adams JL, Barto AGA (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models Of Information Processing In The Basal Ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.249
Humphries MD, Lepora N, Wood R, Gurney K (2009) Capturing dopaminergic modulation and bimodal membrane behaviour of striatal medium spiny neurons in accurate, reduced models. Front Comput Neurosci 3:26 [Journal] [PubMed]
   Dopamine-modulated medium spiny neuron, reduced model (Humphries et al. 2009) [Model]
Humphries MD, Prescott TJ (2010) The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward. Prog Neurobiol 90:385-417 [Journal] [PubMed]
Humphries MD, Stewart RD, Gurney KN (2006) A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J Neurosci 26:12921-42 [Journal] [PubMed]
   Spiking neuron model of the basal ganglia (Humphries et al 2006) [Model]
Ilango A, Kesner AJ, Keller KL, Stuber GD, Bonci A, Ikemoto S (2014) Similar roles of substantia nigra and ventral tegmental dopamine neurons in reward and aversion. J Neurosci 34:817-22 [Journal] [PubMed]
Izhikevich EM (2003) Simple model of spiking neurons. IEEE Trans Neural Netw 14:1569-72 [Journal] [PubMed]
   Artificial neuron model (Izhikevich 2003, 2004, 2007) [Model]
Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17:2443-52 [Journal] [PubMed]
   Linking STDP and Dopamine action to solve the distal reward problem (Izhikevich 2007) [Model]
Izhikevich EM (2007) Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting [Journal]
   Artificial neuron model (Izhikevich 2003, 2004, 2007) [Model]
Jahr CE, Stevens CF (1990) Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics. J Neurosci 10:3178-82 [PubMed]
Joel D, Weiner I (2000) The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96:451-74 [PubMed]
Khamassi M, Humphries MD (2012) Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. Front Behav Neurosci 6:79 [Journal] [PubMed]
Kim B, Hawes SL, Gillani F, Wallace LJ, Blackwell KT (2013) Signaling pathways involved in striatal synaptic plasticity are sensitive to temporal pattern and exhibit spatial specificity. PLoS Comput Biol 9:e1002953 [Journal] [PubMed]
   Gq coupled signaling pathways involved in striatal synaptic plasticity (Kim et al. 2013) [Model]
Kimchi EY, Laubach M (2009) The dorsomedial striatum reflects response bias during learning. J Neurosci 29:14891-902 [Journal] [PubMed]
Kimchi EY, Torregrossa MM, Taylor JR, Laubach M (2009) Neuronal correlates of instrumental learning in the dorsal striatum. J Neurophysiol 102:475-89 [Journal] [PubMed]
Kravitz AV, Freeze BS, Parker PR, Kay K, Thwin MT, Deisseroth K, Kreitzer AC (2010) Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature 466:622-6 [Journal] [PubMed]
Kravitz AV, Tye LD, Kreitzer AC (2012) Distinct roles for direct and indirect pathway striatal neurons in reinforcement. Nat Neurosci 15:816-8 [Journal] [PubMed]
Kreitzer AC, Berke JD (2011) Investigating striatal function through cell-type-specific manipulations. Neuroscience 198:19-26 [Journal] [PubMed]
Lak A, Stauffer WR, Schultz W (2014) Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc Natl Acad Sci U S A 111:2343-8 [Journal] [PubMed]
Laurent PA (2008) The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural Netw 21:1493-9 [Journal] [PubMed]
Lindskog M, Kim M, Wikström MA, Blackwell KT, Kotaleski JH (2006) Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation. PLoS Comput Biol 2:e119 [Journal] [PubMed]
   Model of DARPP-32 phosphorylation in striatal medium spiny neurons (Lindskog et al. 2006) [Model]
Mahon S, Deniau JM, Charpier S, Delord B (2000) Role of a striatal slowly inactivating potassium current in short-term facilitation of corticostriatal inputs: a computer simulation study. Learn Mem 7:357-62 [PubMed]
   Striatal Output Neuron (Mahon, Deniau, Charpier, Delord 2000) [Model]
Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459:837-41 [Journal] [PubMed]
Maurin Y, Banrezes B, Menetrey A, Mailly P, Deniau JM (1999) Three-dimensional distribution of nigrostriatal neurons in the rat: relation to the topography of striatonigral projections. Neuroscience 91:891-909 [PubMed]
McGeorge AJ, Faull RL (1989) The organization of the projection from the cerebral cortex to the striatum in the rat. Neuroscience 29:503-37 [PubMed]
Middleton FA, Strick PL (2000) Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Brain Res Rev 31:236-50 [PubMed]
Mink JW, Thach WT (1993) Basal ganglia intrinsic circuits and their role in behavior. Curr Opin Neurobiol 3:950-7 [PubMed]
Mogenson GJ, Jones DL, Yim CY (1980) From motivation to action: functional interface between the limbic system and the motor system. Prog Neurobiol 14:69-97 [PubMed]
Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]
Moyer JT, Wolf JA, Finkel LH (2007) Effects of dopaminergic modulation on the integrative properties of the ventral striatal medium spiny neuron. J Neurophysiol 98:3731-48 [Journal] [PubMed]
Nakajima S,Tanaka S,Urushihara K,Imada H (2000) Renewal of extinguished lever-press responses upon return to the training context Learn Motiv 31:416-431
Nakano T, Doi T, Yoshimoto J, Doya K (2010) A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. PLoS Comput Biol 6:e1000670 [Journal] [PubMed]
   A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity (Nakano et al. 2010) [Model]
Ostlund SB, Balline BW (2007) Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome. Learn Behav 35:43-52 [PubMed]
Paille V, Fino E, Du K, Morera-Herreras T, Perez S, Kotaleski JH, Venance L (2013) GABAergic circuits control spike-timing-dependent plasticity. J Neurosci 33:9353-63 [Journal] [PubMed]
Pan WX, Brown J, Dudman JT (2013) Neural signals of extinction in the inhibitory microcircuit of the ventral midbrain. Nat Neurosci 16:71-8 [Journal] [PubMed]
Pawlak V, Kerr JN (2008) Dopamine receptor activation is required for corticostriatal spike-timing-dependent plasticity. J Neurosci 28:2435-46 [Journal] [PubMed]
Pfister JP, Gerstner W (2006) Triplets of spikes in a model of spike timing-dependent plasticity. J Neurosci 26:9673-82 [Journal] [PubMed]
Ponzi A, Wickens JR (2013) Optimal balance of the striatal medium spiny neuron network. PLoS Comput Biol 9:e1002954 [Journal] [PubMed]
Redgrave P (2013) Action discovery and intrinsic motivation: a biologically constrained formalisation Intrinsically motivated learning in natural and artificial systems, Baldassarre G:Mirolli M, ed. pp.151
Redgrave P, Gurney K (2006) The short-latency dopamine signal: a role in discovering novel actions? Nat Rev Neurosci 7:967-75 [Journal] [PubMed]
Redgrave P, Gurney K, Reynolds J (2008) What is reinforced by phasic dopamine signals? Brain Res Rev 58:322-39 [Journal] [PubMed]
Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89:1009-23 [PubMed]
Redish AD, Jensen S, Johnson A, Kurth-Nelson Z (2007) Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol Rev 114:784-805 [Journal] [PubMed]
Reynolds JN, Hyland BI, Wickens JR (2001) A cellular mechanism of reward-related learning. Nature 413:67-70 [Journal] [PubMed]
Reynolds JN, Wickens JR (2002) Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw 15:507-21 [PubMed]
Romanelli P, Esposito V, Schaal DW, Heit G (2005) Somatotopy in the basal ganglia: experimental and clinical evidence for segregated sensorimotor channels. Brain Res Brain Res Rev 48:112-28 [Journal] [PubMed]
Samson RD, Frank MJ, Fellous JM (2010) Computational models of reinforcement learning: the role of dopamine as a reward signal. Cogn Neurodyn 4:91-105 [Journal] [PubMed]
Schilman EA, Uylings HB, Galis-de Graaf Y, Joel D, Groenewegen HJ (2008) The orbital cortex in rats topographically projects to central parts of the caudate-putamen complex. Neurosci Lett 432:40-5 [Journal] [PubMed]
Schoenbaum G, Roesch MR, Stalnaker TA, Takahashi YK (2009) A new perspective on the role of the orbitofrontal cortex in adaptive behaviour. Nat Rev Neurosci 10:885-92 [Journal] [PubMed]
Schultz W (2010) Dopamine signals for reward value and risk: basic and recent data. Behav Brain Funct 6:24 [Journal] [PubMed]
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]
Shan Q, Ge M, Christie MJ, Balleine BW (2014) The acquisition of goal-directed actions generates opposing plasticity in direct and indirect pathways in dorsomedial striatum. J Neurosci 34:9196-201 [Journal] [PubMed]
Shen W, Flajolet M, Greengard P, Surmeier DJ (2008) Dichotomous dopaminergic control of striatal synaptic plasticity. Science 321:848-51 [Journal] [PubMed]
Shiflett MW, Balleine BW (2011) Molecular substrates of action control in cortico-striatal circuits. Prog Neurobiol 95:1-13 [Journal] [PubMed]
Shiflett MW, Brown RA, Balleine BW (2010) Acquisition and performance of goal-directed instrumental actions depends on ERK signaling in distinct regions of dorsal striatum in rats. J Neurosci 30:2951-9 [Journal] [PubMed]
Shinomoto S, Shima K, Tanji J (2003) Differences in spiking patterns among cortical neurons. Neural Comput 15:2823-42 [Journal] [PubMed]
Smith R, Musleh W, Akopian G, Buckwalter G, Walsh JP (2001) Regional differences in the expression of corticostriatal synaptic plasticity. Neuroscience 106:95-101 [PubMed]
Sul JH, Kim H, Huh N, Lee D, Jung MW (2010) Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron 66:449-60 [Journal] [PubMed]
Surmeier DJ, Ding J, Day M, Wang Z, Shen W (2007) D1 and D2 dopamine-receptor modulation of striatal glutamatergic signaling in striatal medium spiny neurons. Trends Neurosci 30:228-35 [Journal] [PubMed]
Tang C, Pawlak AP, Prokopenko V, West MO (2007) Changes in activity of the striatum during formation of a motor habit. Eur J Neurosci 25:1212-27 [Journal] [PubMed]
Tecuapetla F, Matias S, Dugue GP, Mainen ZF, Costa RM (2014) Balanced activity in basal ganglia projection pathways is critical for contraversive movements. Nat Commun 5:4315 [Journal] [PubMed]
Thorn CA, Atallah H, Howe M, Graybiel AM (2010) Differential dynamics of activity changes in dorsolateral and dorsomedial striatal loops during learning. Neuron 66:781-95 [Journal] [PubMed]
Thorn CA, Graybiel AM (2014) Differential entrainment and learning-related dynamics of spike and local field potential activity in the sensorimotor and associative striatum. J Neurosci 34:2845-59 [Journal] [PubMed]
Threlfell S, Lalic T, Platt NJ, Jennings KA, Deisseroth K, Cragg SJ (2012) Striatal dopamine release is triggered by synchronized activity in cholinergic interneurons. Neuron 75:58-64 [Journal] [PubMed]
Todd TP, Winterbauer NE, Bouton ME (2012) Contextual control of appetite. Renewal of inhibited food-seeking behavior in sated rats after extinction. Appetite 58:484-9 [Journal] [PubMed]
Tsai HC, Zhang F, Adamantidis A, Stuber GD, Bonci A, de Lecea L, Deisseroth K (2009) Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science 324:1080-4 [Journal] [PubMed]
van Rossum MC, Bi GQ, Turrigiano GG (2000) Stable Hebbian learning from spike timing-dependent plasticity. J Neurosci 20:8812-21 [PubMed]
Wang LP, Li F, Wang D, Xie K, Wang D, Shen X, Tsien JZ (2011) NMDA receptors in dopaminergic neurons are crucial for habit learning. Neuron 72:1055-66 [Journal] [PubMed]
Wang Z, Kai L, Day M, Ronesi J, Yin HH, Ding J, Tkatch T, Lovinger DM, Surmeier DJ (2006) Dopaminergic control of corticostriatal long-term synaptic depression in medium spiny neurons is mediated by cholinergic interneurons. Neuron 50:443-52 [Journal] [PubMed]
Wickens JR, Budd CS, Hyland BI, Arbuthnott GW (2007) Striatal contributions to reward and decision making: making sense of regional variations in a reiterated processing matrix. Ann N Y Acad Sci 1104:192-212 [Journal] [PubMed]
Wörgötter F, Porr B (2005) Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput 17:245-319 [Journal] [PubMed]
Yin HH, Knowlton BJ (2006) The role of the basal ganglia in habit formation. Nat Rev Neurosci 7:464-76 [Journal] [PubMed]
Yin HH, Knowlton BJ, Balleine BW (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19:181-9 [PubMed]
Yin HH, Mulcare SP, Hilário MR, Clouse E, Holloway T, Davis MI, Hansson AC, Lovinger DM, Costa RM (2009) Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nat Neurosci 12:333-41 [Journal] [PubMed]
Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22:513-23 [Journal] [PubMed]
Znamenskiy P, Zador AM (2013) Corticostriatal neurons in auditory cortex drive decisions during auditory discrimination. Nature 497:482-5 [Journal] [PubMed]
Fountas Z, Shanahan M (2017) The role of cortical oscillations in a spiking neural network model of the basal ganglia. PLoS One 12:e0189109 [Journal] [PubMed]
   Cortical oscillations and the basal ganglia (Fountas & Shanahan 2017) [Model]
(115 refs)