Citation Relationships



Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9[PubMed]

References and models cited by this paper

References and models that cite this paper

Amos A (2000) A computational model of information processing in the frontal cortex and basal ganglia. J Cogn Neurosci 12:505-19 [PubMed]

Bogacz R, Gurney K (2007) The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput 19:442-77 [PubMed]

Brzosko Z, Zannone S, Schultz W, Clopath C, Paulsen O (2017) Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. Elife [Journal] [PubMed]

   Sequential neuromodulation of Hebbian plasticity in reward-based navigation (Brzosko et al 2017) [Model]

Clopath C, Ziegler L, Vasilaki E, Busing L, Gerstner W (2008) Tag-trigger-consolidation: a model of early and late long-term-potentiation and depression. PLoS Comput Biol 4:e1000248 [Journal] [PubMed]

   Tag Trigger Consolidation (Clopath and Ziegler et al. 2008) [Model]

Daw ND, Courville AC, Tourtezky DS (2006) Representation and Timing in Theories of the Dopamine System Neural Comput 18:1637-1677

Durstewitz D (2006) A few important points about dopamine's role in neural network dynamics. Pharmacopsychiatry 39 Suppl 1:S72-5 [PubMed]

Esposito U, Giugliano M, Vasilaki E (2015) Adaptation of short-term plasticity parameters via error-driven learning may explain the correlation between activity-dependent synaptic properties, connectivity motifs and target specificity. Front Comput Neurosci 8:175 [Journal] [PubMed]

   Adaptation of Short-Term Plasticity parameters (Esposito et al. 2015) [Model]

Fleischer JG, Gally JA, Edelman GM, Krichmar JL (2007) Retrospective and prospective responses arising in a modeled hippocampus during maze navigation by a brain-based device. Proc Natl Acad Sci U S A 104:3556-61 [PubMed]

Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 17:51-72 [Journal] [PubMed]

   Dynamic dopamine modulation in the basal ganglia: Learning in Parkinson (Frank et al 2004,2005) [Model]

Frank MJ (2006) Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural Netw 19:1120-36 [Journal] [PubMed]

   Roles of subthalamic nucleus and DBS in reinforcement conflict-based decision making (Frank 2006) [Model]

Frank MJ, Seeberger LC, O`Reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-3 [Journal] [PubMed]

   Dynamic dopamine modulation in the basal ganglia: Learning in Parkinson (Frank et al 2004,2005) [Model]

Gluck MA, Myers C, Meeter M (2005) Cortico-hippocampal interaction and adaptive stimulus representation: a neurocomputational theory of associative learning and memory. Neural Netw 18:1265-79 [PubMed]

Gurney KN, Humphries MD, Redgrave P (2015) A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS Biol 13:e1002034 [Journal] [PubMed]

   Cortico-striatal plasticity in medium spiny neurons (Gurney et al 2015) [Model]

Hasselmo ME (2005) A model of prefrontal cortical mechanisms for goal-directed behavior. J Cogn Neurosci 17:1115-29 [PubMed]

   Prefrontal cortical mechanisms for goal-directed behavior (Hasselmo 2005) [Model]

Izhikevich EM (2007) Solving the Distal Reward Problem through Linkage of STDP and Dopamine Signaling. Cereb Cortex 17(10):2443-2452 [Journal] [PubMed]

   Linking STDP and Dopamine action to solve the distal reward problem (Izhikevich 2007) [Model]

Kato A, Morita K (2016) Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation. PLoS Comput Biol 12:e1005145 [Journal] [PubMed]

   Reinforcement Learning with Forgetting: Linking Sustained Dopamine to Motivation (Kato Morita 2016) [Model]

Krasne FB, Fanselow MS, Zelikowsky M (2011) Design of a neurally plausible model of fear learning. Front Behav Neurosci 5:41 [Journal] [PubMed]

   FRAT: An amygdala-centered model of fear conditioning (Krasne et al. 2011) [Model]

Morita K, Kato A (2014) Striatal dopamine ramping may indicate flexible reinforcement learning with forgetting in the cortico-basal ganglia circuits Front. Neural Circuits 8:36 [Journal]

   Striatal dopamine ramping: an explanation by reinforcement learning with decay (Morita & Kato, 2014) [Model]

Moustafa AA, Cohen MX, Sherman SJ, Frank MJ (2008) A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism J. Neurosci. 28(47):12294-12304 [Journal]

Moustafa AA, Gluck MA (2011) A neurocomputational model of dopamine and prefrontal-striatal interactions during multicue category learning by Parkinson patients. J Cogn Neurosci 23(1):151-67 [Journal]

   Prefrontal–striatal Parkinsons comp. model of multicue category learning (Moustafa and Gluck 2011) [Model]

Moustafa AA, Myers CE, Gluck MA (2009) A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning. Brain Res 1276:180-95 [Journal] [PubMed]

   A neurocomputational model of classical conditioning phenomena (Moustafa et al. 2009) [Model]

Nakano T, Doi T, Yoshimoto J, Doya K (2010) A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. PLoS Comput Biol 6:e1000670 [Journal] [PubMed]

   A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity (Nakano et al. 2010) [Model]

Nakano T, Otsuka M, Yoshimoto J, Doya K (2015) A spiking neural network model of model-free reinforcement learning with high-dimensional sensory input and perceptual ambiguity. PLoS One 10:e0115620 [Journal] [PubMed]

   A spiking neural network model of model-free reinforcement learning (Nakano et al 2015) [Model]

O'Reilly RC, Frank MJ (2005) Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia Neural Comput 18:283-328

O'Reilly RC, Frank MJ (2006) Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput 18:283-328

Porr B, Worgotter F (2006) Strongly Improved Stability and Faster Convergence of Temporal Sequence Learning by Using Input Correlations Only Neural Comput 18:1380-1412

Porr B, Worgotter F (2007) Learning with "relevance": using a third factor to stabilize Hebbian learning. Neural Comput 19:2694-719 [Journal] [PubMed]

Prescott TJ, Montes Gonzalez FM, Gurney K, Humphries MD, Redgrave P (2006) A robot model of the basal ganglia: behavior and intrinsic processing. Neural Netw 19:31-61 [Journal] [PubMed]

   A contracting model of the basal ganglia (Girard et al. 2008) [Model]

Rivest F, Kalaska JF, Bengio Y (2010) Alternative time representation in dopamine models. Journal of Computational Neuroscience 28:107-30 [Journal] [PubMed]

   Alternative time representation in dopamine models (Rivest et al. 2009) [Model]

Roelfsema PR, van Ooyen A (2005) Attention-gated reinforcement learning of internal representations for classification. Neural Comput 17:2176-214 [PubMed]

Rubchinsky LL, Kopell N, Sigvardt KA (2003) Modeling facilitation and inhibition of competing motor programs in basal ganglia subthalamic nucleus-pallidal circuits. Proc Natl Acad Sci U S A 100:14427-32 [PubMed]

Sakai Y, Fukai T (2008) The actor-critic learning is behind the matching law: matching versus optimal behaviors. Neural Comput 20:227-51 [PubMed]

Sejnowski TJ, Destexhe A (2000) Why do we sleep? Brain Res 886:208-223 [PubMed]

Smith AJ, Becker S, Kapur S (2005) A computational model of the functional role of the ventral-striatal D2 receptor in the expression of previously acquired behaviors. Neural Comput 17:361-95 [PubMed]

Swinehart CD, Abbott LF (2005) Supervised learning through neuronal response modulation. Neural Comput 17:609-31 [PubMed]

Szita I, Lorincz A (2004) Kalman filter control embedded into the reinforcement learning framework. Neural Comput 16:491-9 [PubMed]

Tarfa RA, Evans RC, Khaliq ZM (2017) Enhanced sensitivity to hyperpolarizing inhibition in mesoaccumbal relative to nigrostriatal dopamine neuron subpopulations. J Neurosci [Journal] [PubMed]

   VTA dopamine neuron (Tarfa, Evans, and Khaliq 2017) [Model]

Toyoizumi T, Pfister JP, Aihara K, Gerstner W (2007) Optimality model of unsupervised spike-timing-dependent plasticity: synaptic memory and weight distribution. Neural Comput 19:639-71 [PubMed]

Worgotter F, Porr B (2005) Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput 17:245-319 [PubMed]

(39 refs)