Citation Relationships



Frank MJ, Seeberger LC, O'reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-3 [PubMed]

   Dynamic dopamine modulation in the basal ganglia: Learning in Parkinson (Frank et al 2004,2005)

References and models cited by this paper

References and models that cite this paper

Ashby FG, Alfonso-Reese LA, Turken AU, Waldron EM (1998) A neuropsychological theory of multiple systems in category learning. Psychol Rev 105:442-81 [PubMed]

Aubert I, Ghorayeb I, Normand E, Bloch B (2000) Phenotypical characterization of the neurons expressing the D1 and D2 dopamine receptors in the monkey striatum. J Comp Neurol 418:22-32 [PubMed]

Centonze D, Picconi B, Gubellini P, Bernardi G, Calabresi P (2001) Dopaminergic control of synaptic plasticity in the dorsal striatum. Eur J Neurosci 13:1071-7 [PubMed]

Chevalier G, Deniau JM (1990) Disinhibition as a basic process in the expression of striatal functions. Trends Neurosci 13:277-80 [PubMed]

Cools R, Barker RA, Sahakian BJ, Robbins TW (2001) Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands. Cereb Cortex 11:1136-43 [PubMed]

Delgado MR, Locke HM, Stenger VA, Fiez JA (2003) Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations. Cogn Affect Behav Neurosci 3:27-38 [PubMed]

Delius JD, Siemann M (1998) Transitive responding in animals and humans: Exaptation rather than adaptation? Behav Processes 42:107-37 [PubMed]

Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 17:51-72 [Journal] [PubMed]

   Dynamic dopamine modulation in the basal ganglia: Learning in Parkinson (Frank et al 2004,2005) [Model]

Frank MJ, Loughry B, O'Reilly RC (2001) Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1:137-60 [PubMed]

Frank MJ, Rudy JW, Levy WB, O'Reilly RC (2005) When logic fails: implicit transitive inference in humans. Mem Cognit 33:742-50 [PubMed]

Frank MJ, Rudy JW, O'Reilly RC (2003) Transitivity, flexibility, conjunctive representations, and the hippocampus. II. A computational analysis. Hippocampus 13:341-54 [Journal] [PubMed]

Gerfen CR (1992) The neostriatal mosaic: multiple levels of compartmental organization in the basal ganglia. Annu Rev Neurosci 15:285-320 [Journal] [PubMed]

Hernández-López S, Bargas J, Surmeier DJ, Reyes A, Galarraga E (1997) D1 receptor activation enhances evoked discharge in neostriatal medium spiny neurons by modulating an L-type Ca2+ conductance. J Neurosci 17:3334-42 [PubMed]

Hernandez-Lopez S, Tkatch T, Perez-Garci E, Galarraga E, Bargas J, Hamm H, Surmeier DJ (2000) D2 dopamine receptors in striatal medium spiny neurons reduce L-type Ca2+ currents and excitability via a novel PLC[beta]1-IP3-calcineurin-signaling cascade. J Neurosci 20:8987-95 [PubMed]

Holroyd CB, Coles MGH (2002) The neural basis of human error processing: reinforcement learning, dopamine, and the error-related negativity. Psychol Rev 109:679-709 [Journal] [PubMed]

Kaasinen V, Nurmi E, Bergman J, Eskola O, Solin O, Sonninen P, Rinne JO (2001) Personality traits and brain dopaminergic function in Parkinson's disease. Proc Natl Acad Sci U S A 98:13272-7 [Journal] [PubMed]

Kish SJ, Shannak K, Hornykiewicz O (1988) Uneven pattern of dopamine loss in the striatum of patients with idiopathic Parkinson's disease. Pathophysiologic and clinical implications. N Engl J Med 318:876-80 [Journal] [PubMed]

Knowlton BJ, Mangels JA, Squire LR (1996) A neostriatal habit learning system in humans. Science 273:1399-402 [PubMed]

Mink JW (1996) The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50:381-425 [PubMed]

Nishi A, Snyder GL, Greengard P (1997) Bidirectional regulation of DARPP-32 phosphorylation by dopamine. J Neurosci 17:8147-55 [PubMed]

Oreilly RC, Frank MJ (2003) Making working memory work: A computational model of learning in the frontal cortex and basal ganglia ICS Tech. Rep. 03-03, revised 8-04

Satoh T, Nakai S, Sato T, Kimura M (2003) Correlated coding of motivation and outcome of decision by dopamine neurons. J Neurosci 23:9913-23 [PubMed]

Schultz W (2002) Getting formal with dopamine and reward. Neuron 36:241-63 [PubMed]

Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]

Shohamy D, Myers CE, Grossman S, Sage J, Gluck MA, Poldrack RA (2004) Cortico-striatal contributions to feedback-based learning: converging data from neuroimaging and neuropsychology. Brain 127:851-9 [Journal] [PubMed]

Swainson R, Rogers RD, Sahakian BJ, Summers BA, Polkey CE, Robbins TW (2000) Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: possible adverse effects of dopaminergic medication. Neuropsychologia 38:596-612 [PubMed]

Tomer R, Aharon-Peretz J (2004) Novelty seeking and harm avoidance in Parkinson's disease: effects of asymmetric dopamine deficiency. J Neurol Neurosurg Psychiatry 75:972-5 [PubMed]

Ungless MA, Magill PJ, Bolam JP (2004) Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303:2040-2 [Journal] [PubMed]

Von_fersen L, Wynne CDL, Delius JD, Staddon JER (1991) Transitive inference formation in pigeons J Exp Psychol Anim Behav Process 17:334-341

Wickens J (1997) Basal ganglia: Structure and computations Network: Computation in Neural Systems 8:R77-109

Wise RA, Rompre PP (1989) Brain dopamine and reward. Annu Rev Psychol 40:191-225 [Journal] [PubMed]

Wynne C (1995) Reinforcement accounts for transitive inference performance Anim Learn Behav 23:207-217

Zald DH, Boileau I, El-Dearedy W, Gunn R, McGlone F, Dichter GS, Dagher A (2004) Dopamine transmission in the human striatum during monetary reward tasks. J Neurosci 24:4105-12 [Journal] [PubMed]

Zink CF, Pagnoni G, Martin-Skurski ME, Chappelow JC, Berns GS (2004) Human striatal responses to monetary reward depend on saliency. Neuron 42:509-17 [PubMed]

Bogacz R, Gurney K (2007) The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 19:442-77 [Journal] [PubMed]

Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW (2012) Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex. PLoS One 7:e47251 [Journal] [PubMed]

   Reinforcement learning of targeted movement (Chadderdon et al. 2012) [Model]

Frank MJ (2006) Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw 19:1120-36 [Journal] [PubMed]

   Roles of subthalamic nucleus and DBS in reinforcement conflict-based decision making (Frank 2006) [Model]

Frank MJ, Samanta J, Moustafa AA, Sherman SJ (2007) Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318:1309-12 [Journal] [PubMed]

   Roles of subthalamic nucleus and DBS in reinforcement conflict-based decision making (Frank 2006) [Model]

Frank MJ, Scheres A, Sherman SJ (2007) Understanding decision-making deficits in neurological conditions: insights from models of natural action selection. Philos Trans R Soc Lond B Biol Sci 362:1641-54 [Journal] [PubMed]

Hazy TE, Frank MJ, O'reilly RC (2007) Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos Trans R Soc Lond B Biol Sci 362:1601-13 [Journal] [PubMed]

Humphries MD, Stewart RD, Gurney KN (2006) A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J Neurosci 26:12921-42 [Journal] [PubMed]

   Spiking neuron model of the basal ganglia (Humphries et al 2006) [Model]

Moustafa AA, Cohen MX, Sherman SJ, Frank MJ (2008) A role for dopamine in temporal decision making and reward maximization in parkinsonism. J Neurosci 28:12294-304 [Journal] [PubMed]

Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW (2013) Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural Comput 25:3263-93 [Journal] [PubMed]

   Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013) [Model]

O'Reilly RC, Frank MJ (2005) Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia Neural Comput 18:283-328

O'Reilly RC, Frank MJ (2006) Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18:283-328 [Journal] [PubMed]

Salimi-Badr A, Ebadzadeh MM, Darlot C (2017) A possible correlation between the basal ganglia motor function and the inverse kinematics calculation. J Comput Neurosci 43:295-318 [Journal] [PubMed]

   Basal ganglia motor function and the inverse kinematics calculation (Salimi-Badr et al 2017) [Model]

Salimi-Badr A, Ebadzadeh MM, Darlot C (2018) A system-level mathematical model of Basal Ganglia motor-circuit for kinematic planning of arm movements. Comput Biol Med 92:78-89 [Journal] [PubMed]

   Basal Ganglia motor-circuit for kinematic planning of arm movements (Salimi-Badr et al 2017) [Model]

(47 refs)