Citation Relationships

Legends: Link to a Model Reference cited by multiple papers


Kato A, Morita K (2016) Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation. PLoS Comput Biol 12:e1005145 [PubMed]

   Reinforcement Learning with Forgetting: Linking Sustained Dopamine to Motivation (Kato Morita 2016)

References and models cited by this paper

References and models that cite this paper

Akaishi R, Umeda K, Nagase A, Sakai K (2014) Autonomous mechanism of internal choice estimate underlies decision inertia. Neuron 81:195-206 [Journal] [PubMed]
Angulo-Garcia D, Berke JD, Torcini A (2016) Cell Assembly Dynamics of Sparsely-Connected Inhibitory Networks: A Simple Model for the Collective Activity of Striatal Projection Neurons. PLoS Comput Biol 12:e1004778 [Journal] [PubMed]
Bahuguna J, Aertsen A, Kumar A (2015) Existence and control of Go/No-Go decision transition threshold in the striatum. PLoS Comput Biol 11:e1004233 [Journal] [PubMed]
Bar-Gad I, Morris G, Bergman H (2003) Information processing, dimensionality reduction and reinforcement learning in the basal ganglia. Prog Neurobiol 71:439-73 [Journal] [PubMed]
Beeler JA, Daw N, Frazier CR, Zhuang X (2010) Tonic dopamine modulates exploitation of reward learning. Front Behav Neurosci 4:170 [Journal] [PubMed]
Beierholm UR, Dayan P (2010) Pavlovian-instrumental interaction in 'observing behavior'. PLoS Comput Biol [Journal] [PubMed]
Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28:309-69 [PubMed]
Berry JA, Cervantes-Sandoval I, Nicholas EP, Davis RL (2012) Dopamine is required for learning and forgetting in Drosophila. Neuron 74:530-42 [Journal] [PubMed]
Berthet P, Hellgren-Kotaleski J, Lansner A (2012) Action selection performance of a reconfigurable basal ganglia inspired model with Hebbian-Bayesian Go-NoGo connectivity. Front Behav Neurosci 6:65 [Journal] [PubMed]
Bolam JP, Pissadaki EK (2012) Living on the edge with too many mouths to feed: why dopamine neurons die. Mov Disord 27:1478-83 [Journal] [PubMed]
Bornstein AM, Daw ND (2011) Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 21:374-80 [Journal] [PubMed]
Botvinick MM, Niv Y, Barto AC (2009) Hierarchically organized behavior and its neural foundations: a reinforcement learning perspective. Cognition 113:262-80 [Journal] [PubMed]
Brea J, Urbanczik R, Senn W (2014) A normative theory of forgetting: lessons from the fruit fly. PLoS Comput Biol 10:e1003640 [Journal] [PubMed]
Chang CY, Esber GR, Marrero-Garcia Y, Yau HJ, Bonci A, Schoenbaum G (2016) Brief optogenetic inhibition of dopamine neurons mimics endogenous negative reward prediction errors. Nat Neurosci 19:111-6 [Journal] [PubMed]
Collins AG, Frank MJ (2014) Opponent actor learning (OpAL): modeling interactive effects of striatal dopamine on reinforcement learning and choice incentive. Psychol Rev 121:337-66 [Journal] [PubMed]
Collins AL, Greenfield VY, Bye JK, Linker KE, Wang AS, Wassum KM (2016) Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation. Sci Rep 6:20231 [Journal] [PubMed]
Dai J, Kerestes R, Upton DJ, Busemeyer JR, Stout JC (2015) An improved cognitive model of the Iowa and Soochow Gambling Tasks with regard to model fitting performance and tests of parameter consistency. Front Psychol 6:229 [Journal] [PubMed]
Damodaran S, Cressman JR, Jedrzejewski-Szmek Z, Blackwell KT (2015) Desynchronization of fast-spiking interneurons reduces ß-band oscillations and imbalance in firing in the dopamine-depleted striatum. J Neurosci 35:1149-59 [Journal] [PubMed]
   Striatal NN model of MSNs and FSIs investigated effects of dopamine depletion (Damodaran et al 2015) [Model]
Daw ND, O'Doherty JP, Dayan P, Seymour B, Dolan RJ (2006) Cortical substrates for exploratory decisions in humans. Nature 441:876-9 [Journal] [PubMed]
Day JJ, Jones JL, Wightman RM, Carelli RM (2010) Phasic nucleus accumbens dopamine release encodes effort- and delay-related costs. Biol Psychiatry 68:306-9 [Journal] [PubMed]
Day JJ, Roitman MF, Wightman RM, Carelli RM (2007) Associative learning mediates dynamic shifts in dopamine signaling in the nucleus accumbens. Nat Neurosci 10:1020-8 [Journal] [PubMed]
Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-98 [PubMed]
Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston K (2008) The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS Comput Biol 4:e1000092 [Journal] [PubMed]
Doya K (2002) Metalearning and neuromodulation. Neural Netw 15:495-506 [PubMed]
Durstewitz D, Deco G (2008) Computational significance of transient dynamics in cortical networks. Eur J Neurosci 27:217-27 [Journal] [PubMed]
Erev I,Roth AE (1998) Predicting how people play games: Reinforcement learning in experimental games with unique, mixed strategy equilibria Am Econ Rev. 88(4):848-81
Eshel N, Bukwich M, Rao V, Hemmelder V, Tian J, Uchida N (2015) Arithmetic and local circuitry underlying dopamine prediction errors. Nature 525:243-6 [Journal] [PubMed]
Frank MJ, Badre D (2012) Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis. Cereb Cortex 22:509-26 [Journal] [PubMed]
Frank MJ, Samanta J, Moustafa AA, Sherman SJ (2007) Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism. Science 318:1309-12 [Journal] [PubMed]
   Roles of subthalamic nucleus and DBS in reinforcement conflict-based decision making (Frank 2006) [Model]
Frey U, Schroeder H, Matthies H (1990) Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices. Brain Res 522:69-75 [PubMed]
Friedrich J, Lengyel M (2016) Goal-Directed Decision Making with Spiking Neurons. J Neurosci 36:1529-46 [Journal] [PubMed]
Gerfen CR, Surmeier DJ (2011) Modulation of striatal projection systems by dopamine. Annu Rev Neurosci 34:441-66 [Journal] [PubMed]
Gershman SJ (2014) Dopamine ramps are a consequence of reward prediction errors. Neural Comput 26:467-71 [Journal] [PubMed]
Gershman SJ, Moustafa AA, Ludvig EA (2014) Time representation in reinforcement learning models of the basal ganglia. Front Comput Neurosci 7:194 [Journal] [PubMed]
Glimcher PW (2011) Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A 108 Suppl 3:15647-54 [Journal] [PubMed]
Hardt O, Nader K, Nadel L (2013) Decay happens: the role of active forgetting in memory. Trends Cogn Sci 17:111-20 [Journal] [PubMed]
Hart AS, Rutledge RB, Glimcher PW, Phillips PE (2014) Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci 34:698-704 [Journal] [PubMed]
Hirashima M, Nozaki D (2012) Learning with slight forgetting optimizes sensorimotor transformation in redundant motor systems. PLoS Comput Biol 8:e1002590 [Journal] [PubMed]
Howe MW, Dombeck DA (2016) Rapid signalling in distinct dopaminergic axons during locomotion and reward. Nature 535:505-10 [Journal] [PubMed]
Howe MW, Tierney PL, Sandberg SG, Phillips PE, Graybiel AM (2013) Prolonged dopamine signalling in striatum signals proximity and value of distant rewards. Nature 500:575-9 [Journal] [PubMed]
Hsiao PY, Lo CC (2013) A plastic corticostriatal circuit model of adaptation in perceptual decision making. Front Comput Neurosci 7:178 [Journal] [PubMed]
Humphries MD, Khamassi M, Gurney K (2012) Dopaminergic Control of the Exploration-Exploitation Trade-Off via the Basal Ganglia. Front Neurosci 6:9 [Journal] [PubMed]
Humphries MD, Stewart RD, Gurney KN (2006) A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J Neurosci 26:12921-42 [Journal] [PubMed]
   Spiking neuron model of the basal ganglia (Humphries et al 2006) [Model]
Hunt LT, Kolling N, Soltani A, Woolrich MW, Rushworth MF, Behrens TE (2012) Mechanisms underlying cortical activity during value-guided choice. Nat Neurosci 15:470-6, S1-3 [Journal] [PubMed]
Ikemoto S, Panksepp J (1996) Dissociations between appetitive and consummatory responses by pharmacological manipulations of reward-relevant brain regions. Behav Neurosci 110:331-45 [PubMed]
Ingram JN, Flanagan JR, Wolpert DM (2013) Context-dependent decay of motor memories during skill acquisition. Curr Biol 23:1107-12 [Journal] [PubMed]
Ito M, Doya K (2009) Validation of decision-making models and analysis of decision variables in the rat basal ganglia. J Neurosci 29:9861-74 [Journal] [PubMed]
Jackson M (2002) Disease and diversity in history. (Reviews of: Cartwright, FF, Biddiss, M. Disease and history. Gloucestershire: Sutton Publishing Limited, 2000; Rotberg RI, ed. Health and disease in human history. Cambridge, MA: MIT Press, 2000; Cliff, A., Haggett, P., Smallman-Raynor, M. Deciphering global epidemics: analytical approaches to the disease records of world cities, 1888-1912. Cambridge: Cambridge University Press, 1998; Riley, JC. Rising life expectancy: a global history. Cambridge: Cambridge University Press, 2001; McMichael, T. Human frontiers, environments and disease: past patterns, uncertain futures. Cambridge: Cambridge University Press, 2001). Soc Hist Med 15:323-40 [PubMed]
Jocham G, Hunt LT, Near J, Behrens TE (2012) A mechanism for value-guided choice based on the excitation-inhibition balance in prefrontal cortex. Nat Neurosci 15:960-1 [Journal] [PubMed]
Joshua M, Adler A, Prut Y, Vaadia E, Wickens JR, Bergman H (2009) Synchronization of midbrain dopaminergic neurons is enhanced by rewarding events. Neuron 62:695-704 [Journal] [PubMed]
Keeler JF, Pretsell DO, Robbins TW (2014) Functional implications of dopamine D1 vs. D2 receptors: A 'prepare and select' model of the striatal direct vs. indirect pathways. Neuroscience 282:156-75 [Journal] [PubMed]
Keiflin R, Janak PH (2015) Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry. Neuron 88:247-63 [Journal] [PubMed]
Keramati M, Gutkin B (2014) Homeostatic reinforcement learning for integrating reward collection and physiological stability. Elife [Journal] [PubMed]
Khamassi M, Humphries MD (2012) Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies. Front Behav Neurosci 6:79 [Journal] [PubMed]
Khamassi M, Quilodran R, Enel P, Dominey PF, Procyk E (2015) Behavioral Regulation and the Modulation of Information Coding in the Lateral Prefrontal and Cingulate Cortex. Cereb Cortex 25:3197-218 [Journal] [PubMed]
Kim B, Hawes SL, Gillani F, Wallace LJ, Blackwell KT (2013) Signaling pathways involved in striatal synaptic plasticity are sensitive to temporal pattern and exhibit spatial specificity. PLoS Comput Biol 9:e1002953 [Journal] [PubMed]
   Gq coupled signaling pathways involved in striatal synaptic plasticity (Kim et al. 2013) [Model]
Kim HF, Hikosaka O (2015) Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards. Brain 138:1776-800 [Journal] [PubMed]
Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220:671-80 [Journal] [PubMed]
Klampfl S, Maass W (2013) Emergence of dynamic memory traces in cortical microcircuit models through STDP. J Neurosci 33:11515-29 [Journal] [PubMed]
Ko D, Wanat MJ (2016) Phasic Dopamine Transmission Reflects Initiation Vigor and Exerted Effort in an Action- and Region-Specific Manner. J Neurosci 36:2202-11 [Journal] [PubMed]
Lak A, Stauffer WR, Schultz W (2014) Dopamine prediction error responses integrate subjective value from different reward dimensions. Proc Natl Acad Sci U S A 111:2343-8 [Journal] [PubMed]
Lau B, Glimcher PW (2005) Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav 84:555-79 [PubMed]
Le Bouc R, Rigoux L, Schmidt L, Degos B, Welter ML, Vidailhet M, Daunizeau J, Pessiglione M (2016) Computational Dissection of Dopamine Motor and Motivational Functions in Humans. J Neurosci 36:6623-33 [Journal] [PubMed]
Li YQ, Xue YX, He YY, Li FQ, Xue LF, Xu CM, Sacktor TC, Shaham Y, Lu L (2011) Inhibition of PKMzeta in nucleus accumbens core abolishes long-term drug reward memory. J Neurosci 31:5436-46 [Journal] [PubMed]
Lindskog M, Kim M, Wikström MA, Blackwell KT, Kotaleski JH (2006) Transient calcium and dopamine increase PKA activity and DARPP-32 phosphorylation. PLoS Comput Biol 2:e119 [Journal] [PubMed]
   Model of DARPP-32 phosphorylation in striatal medium spiny neurons (Lindskog et al. 2006) [Model]
Lisman J, Grace AA, Duzel E (2011) A neoHebbian framework for episodic memory; role of dopamine-dependent late LTP. Trends Neurosci 34:536-47 [Journal] [PubMed]
Lloyd K, Dayan P (2015) Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens. PLoS Comput Biol 11:e1004622 [Journal] [PubMed]
Lo CC, Wang XJ (2006) Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat Neurosci 9:956-63 [Journal] [PubMed]
Lobb CJ, Troyer TW, Wilson CJ, Paladini CA (2011) Disinhibition bursting of dopaminergic neurons. Front Syst Neurosci 5:25 [Journal] [PubMed]
Mandali A, Rengaswamy M, Chakravarthy VS, Moustafa AA (2015) A spiking Basal Ganglia model of synchrony, exploration and decision making. Front Neurosci 9:191 [Journal] [PubMed]
Marr D, Poggio T (1977) From understanding computation to understanding neural circuitry Neurosci. Res. Program Bull. 15:470-488
McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38:339-46 [PubMed]
McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-8 [PubMed]
Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]
Morita K (2014) Differential cortical activation of the striatal direct and indirect pathway cells: reconciling the anatomical and optogenetic results by using a computational method. J Neurophysiol 112:120-46 [Journal] [PubMed]
Morita K, Jitsev J, Morrison A (2016) Corticostriatal circuit mechanisms of value-based action selection: Implementation of reinforcement learning algorithms and beyond. Behav Brain Res 311:110-121 [Journal] [PubMed]
Morita K, Kato A (2014) Striatal dopamine ramping may indicate flexible reinforcement learning with forgetting in the cortico-basal ganglia circuits. Front Neural Circuits 8:36 [Journal] [PubMed]
   Striatal dopamine ramping: an explanation by reinforcement learning with decay (Morita & Kato, 2014) [Model]
Morita K, Kawaguchi Y (2015) Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning. Eur J Neurosci 42:2003-21 [Journal] [PubMed]
Morita K, Morishima M, Sakai K, Kawaguchi Y (2012) Reinforcement learning: computing the temporal difference of values via distinct corticostriatal pathways. Trends Neurosci 35:457-67 [Journal] [PubMed]
Morita K, Morishima M, Sakai K, Kawaguchi Y (2013) Dopaminergic control of motivation and reinforcement learning: a closed-circuit account for reward-oriented behavior. J Neurosci 33:8866-90 [Journal] [PubMed]
Moustafa AA, Bar-Gad I, Korngreen A, Bergman H (2014) Basal ganglia: physiological, behavioral, and computational studies. Front Syst Neurosci 8:150 [Journal] [PubMed]
Nader K, Hardt O (2009) A single standard for memory: the case for reconsolidation. Nat Rev Neurosci 10:224-34 [Journal] [PubMed]
Nakano T, Doi T, Yoshimoto J, Doya K (2010) A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity. PLoS Comput Biol 6:e1000670 [Journal] [PubMed]
   A kinetic model of dopamine- and calcium-dependent striatal synaptic plasticity (Nakano et al. 2010) [Model]
Niv Y (2007) Cost, benefit, tonic, phasic: what do response rates tell us about dopamine and motivation? Ann N Y Acad Sci 1104:357-76 [Journal] [PubMed]
Niv Y, Daniel R, Geana A, Gershman SJ, Leong YC, Radulescu A, Wilson RC (2015) Reinforcement learning in multidimensional environments relies on attention mechanisms. J Neurosci 35:8145-57 [Journal] [PubMed]
Niv Y, Daw ND, Dayan P (2006) Choice values. Nat Neurosci 9:987-8 [Journal] [PubMed]
Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191:507-20 [Journal] [PubMed]
Niv Y, Langdon A (2016) Reinforcement learning with Marr. Curr Opin Behav Sci 11:67-73 [Journal] [PubMed]
Niv Y, Schoenbaum G (2008) Dialogues on prediction errors. Trends Cogn Sci 12:265-72 [Journal] [PubMed]
Niyogi RK, Wong-Lin K (2013) Dynamic excitatory and inhibitory gain modulation can produce flexible, robust and optimal decision-making. PLoS Comput Biol 9:e1003099 [Journal] [PubMed]
O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-37 [PubMed]
Oster A, Faure P, Gutkin BS (2015) Mechanisms for multiple activity modes of VTA dopamine neurons. Front Comput Neurosci 9:95 [Journal] [PubMed]
Pan WX, Schmidt R, Wickens JR, Hyland BI (2008) Tripartite mechanism of extinction suggested by dopamine neuron activity and temporal difference model. J Neurosci 28:9619-31 [Journal] [PubMed]
Panigrahi B, Martin KA, Li Y, Graves AR, Vollmer A, Olson L, Mensh BD, Karpova AY, Dudman JT (2015) Dopamine Is Required for the Neural Representation and Control of Movement Vigor. Cell 162:1418-30 [Journal] [PubMed]
Parker NF, Cameron CM, Taliaferro JP, Lee J, Choi JY, Davidson TJ, Daw ND, Witten IB (2016) Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target. Nat Neurosci 19:845-54 [Journal] [PubMed]
Pavlides A, Hogan SJ, Bogacz R (2015) Computational Models Describing Possible Mechanisms for Generation of Excessive Beta Oscillations in Parkinson's Disease. PLoS Comput Biol 11:e1004609 [Journal] [PubMed]
   Excessive beta oscillations in Parkinson's disease (Pavlides et al. 2015) [Model]
Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM (2003) Subsecond dopamine release promotes cocaine seeking. Nature 422:614-8 [Journal] [PubMed]
Pissadaki EK, Bolam JP (2013) The energy cost of action potential propagation in dopamine neurons: clues to susceptibility in Parkinson's disease. Front Comput Neurosci 7:13 [Journal] [PubMed]
Ponzi A, Wickens J (2010) Sequentially switching cell assemblies in random inhibitory networks of spiking neurons in the striatum. J Neurosci 30:5894-911 [Journal] [PubMed]
Ponzi A, Wickens JR (2013) Optimal balance of the striatal medium spiny neuron network. PLoS Comput Biol 9:e1002954 [Journal] [PubMed]
Rescorla R, Wagner A (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement Classical Conditioning II: Current Research and Theory, Black A:Prokasy W, ed. pp.64
Reynolds JN, Hyland BI, Wickens JR (2001) A cellular mechanism of reward-related learning. Nature 413:67-70 [Journal] [PubMed]
Robbins TW, Everitt BJ (1996) Neurobehavioural mechanisms of reward and motivation. Curr Opin Neurobiol 6:228-36 [PubMed]
Roesch MR, Calu DJ, Schoenbaum G (2007) Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewards. Nat Neurosci 10:1615-24 [Journal] [PubMed]
Roitman MF, Stuber GD, Phillips PE, Wightman RM, Carelli RM (2004) Dopamine operates as a subsecond modulator of food seeking. J Neurosci 24:1265-71 [Journal] [PubMed]
Rummery GA, Niranjan M (1994) On-line Q-learning using connectionist systems Technical Report CUED/F-INFENG/TR 166
Rutledge RB, Dean M, Caplin A, Glimcher PW (2010) Testing the reward prediction error hypothesis with an axiomatic model. J Neurosci 30:13525-36 [Journal] [PubMed]
Rutledge RB, Skandali N, Dayan P, Dolan RJ (2014) A computational and neural model of momentary subjective well-being. Proc Natl Acad Sci U S A 111:12252-7 [Journal] [PubMed]
Rutledge RB, Skandali N, Dayan P, Dolan RJ (2015) Dopaminergic Modulation of Decision Making and Subjective Well-Being. J Neurosci 35:9811-22 [Journal] [PubMed]
Saddoris MP, Cacciapaglia F, Wightman RM, Carelli RM (2015) Differential Dopamine Release Dynamics in the Nucleus Accumbens Core and Shell Reveal Complementary Signals for Error Prediction and Incentive Motivation. J Neurosci 35:11572-82 [Journal] [PubMed]
Salamone JD, Correa M (2002) Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behav Brain Res 137:3-25 [PubMed]
Salamone JD, Cousins MS, Bucher S (1994) Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65:221-9 [PubMed]
Schroll H, Hamker FH (2013) Computational models of basal-ganglia pathway functions: focus on functional neuroanatomy. Front Syst Neurosci 7:122 [Journal] [PubMed]
Schultz W, Carelli RM, Wightman RM (2015) Phasic dopamine signals: from subjective reward value to formal economic utility. Curr Opin Behav Sci 5:147-154 [Journal] [PubMed]
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]
Shema R, Haramati S, Ron S, Hazvi S, Chen A, Sacktor TC, Dudai Y (2011) Enhancement of consolidated long-term memory by overexpression of protein kinase Mzeta in the neocortex. Science 331:1207-10 [Journal] [PubMed]
Soltani A, Wang XJ (2008) From biophysics to cognition: reward-dependent adaptive choice behavior. Curr Opin Neurobiol 18:209-16 [Journal] [PubMed]
Stauffer WR, Lak A, Schultz W (2014) Dopamine reward prediction error responses reflect marginal utility. Curr Biol 24:2491-500 [Journal] [PubMed]
Steinberg EE, Keiflin R, Boivin JR, Witten IB, Deisseroth K, Janak PH (2013) A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci 16:966-73 [Journal] [PubMed]
Strogatz SH (1994) Nonlinear Dynamics And Chaos With Applications To Physics, Biology, Chemistry, And Engineering
Syed EC, Grima LL, Magill PJ, Bogacz R, Brown P, Walton ME (2016) Action initiation shapes mesolimbic dopamine encoding of future rewards. Nat Neurosci 19:34-6 [Journal] [PubMed]
Takahashi YK, Roesch MR, Wilson RC, Toreson K, O'Donnell P, Niv Y, Schoenbaum G (2011) Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortex. Nat Neurosci 14:1590-7 [Journal] [PubMed]
Tamosiunaite M, Ainge J, Kulvicius T, Porr B, Dudchenko P, Wörgötter F (2008) Path-finding in real and simulated rats: assessing the influence of path characteristics on navigation learning. J Comput Neurosci 25:562-82 [Journal] [PubMed]
Tanaka SC, Doya K, Okada G, Ueda K, Okamoto Y, Yamawaki S (2004) Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci 7:887-93 [Journal] [PubMed]
Tetzlaff C, Kolodziejski C, Markelic I, Wörgötter F (2012) Time scales of memory, learning, and plasticity. Biol Cybern 106:715-26 [Journal] [PubMed]
Tobler PN, Fiorillo CD, Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307:1642-5 [Journal] [PubMed]
Toledo-Suárez C, Duarte R, Morrison A (2014) Liquid computing on and off the edge of chaos with a striatal microcircuit. Front Comput Neurosci 8:130 [Journal] [PubMed]
Wassum KM, Ostlund SB, Maidment NT (2012) Phasic mesolimbic dopamine signaling precedes and predicts performance of a self-initiated action sequence task. Biol Psychiatry 71:846-54 [Journal] [PubMed]
Watkins CJCH (1989) Learning from delayed rewards Unpublished doctoral dissertation
Wilson RC, Takahashi YK, Schoenbaum G, Niv Y (2014) Orbitofrontal cortex as a cognitive map of task space. Neuron 81:267-279 [Journal] [PubMed]
Wong KF, Huk AC, Shadlen MN, Wang XJ (2007) Neural circuit dynamics underlying accumulation of time-varying evidence during perceptual decision making. Front Comput Neurosci 1:6 [Journal] [PubMed]
Wong KF, Wang XJ (2006) A recurrent network mechanism of time integration in perceptual decisions. J Neurosci 26:1314-28 [Journal] [PubMed]
Xiao MY, Niu YP, Wigström H (1996) Activity-dependent decay of early LTP revealed by dual EPSP recording in hippocampal slices from young rats. Eur J Neurosci 8:1916-23 [PubMed]
Yagishita S, Hayashi-Takagi A, Ellis-Davies GC, Urakubo H, Ishii S, Kasai H (2014) A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science 345:1616-20 [Journal] [PubMed]
Yttri EA, Dudman JT (2016) Opponent and bidirectional control of movement velocity in the basal ganglia. Nature 533:402-6 [Journal] [PubMed]
(137 refs)