References and models cited by this paper

References and models that cite this paper

Abbott LF, Varela JA, Sen K, Nelson SB (1997) Synaptic depression and cortical gain control. Science 275:220-4 [PubMed]

Alexander GE, DeLong MR, Strick PL (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Annu Rev Neurosci 9:357-81 [Journal] [PubMed]

Amos A (2000) A computational model of information processing in the frontal cortex and basal ganglia. J Cogn Neurosci 12:505-19 [PubMed]

Anderson JR, Bothell D, Byrne MD, Douglass S, Lebiere C, Qin Y (2004) An integrated theory of the mind. Psychol Rev 111:1036-60 [Journal] [PubMed]

Anderson JR, Lebiere C (1998) The atomic components of thought

Baddeley A (1986) Working memory

Baddeley A, Gathercole S, Papagno C (1998) The phonological loop as a language learning device. Psychol Rev 105:158-73 [PubMed]

Beiser DG, Houk JC (1998) Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. J Neurophysiol 79:3168-88 [Journal] [PubMed]

Berns GS, Sejnowski TJ (1995) How the basal ganglia make decisions Neurobiology of decision-making, Damasio A:Damasion H:Christen Y, ed. pp.101

Berns GS, Sejnowski TJ (1998) A computational model of how the basal ganglia produce sequences. J Cogn Neurosci 10:108-21 [PubMed]

Braver TS, Cohen JD (2000) On the control of control: The role of dopamine in regulating prefrontal function and working memory Control of cognitive processes: Attention and performance XVIII, Monsell S:Driver J, ed. pp.713

Burgess N, Hitch GJ (1999) Memory for serial order: A network model of the phonological loop and its timing Psychol Rev 106:551-581

Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321-52 [PubMed]

Cohen JD, Braver TS, O'Reilly RC (1996) A computational approach to prefrontal cortex, cognitive control and schizophrenia: recent developments and current challenges. Philos Trans R Soc Lond B Biol Sci 351:1515-27 [Journal] [PubMed]

Contreras-Vidal JL, Schultz W (1999) A predictive reinforcement model of dopamine neurons for learning approach behavior. J Comput Neurosci 6:191-214 [PubMed]

Dilmore JG, Gutkin BG, Ermentrout GB (1999) Effects of dopaminergic modulation of persistent sodium currents on the excitability of prefrontal cortical neurons: A computational study Neurocomputing 26:104-116

Dominey P, Arbib M, Joseph JP (1995) A model of corticostriatal plasticity for learning oculomotor associations and sequences. J Cogn Neurosci 7:311-36 [Journal] [PubMed]

Durstewitz D, Kelc M, Güntürkün O (1999) A neurocomputational theory of the dopaminergic modulation of working memory functions. J Neurosci 19:2807-22 [PubMed]

Durstewitz D, Seamans JK, Sejnowski TJ (2000) Dopamine-mediated stabilization of delay-period activity in a network model of prefrontal cortex. J Neurophysiol 83:1733-50 [Journal] [PubMed]

Durstewitz D, Seamans JK, Sejnowski TJ (2000) Neurocomputational models of working memory. Nat Neurosci 3 Suppl:1184-91 [Journal] [PubMed]

Elman JL (1990) Finding structure in time Cognitive Science 14:179-211

Emerson MJ, Miyake A (2003) The role of inner speech in task switching: A dual-task investigation J Mem Lang 48:148-168

Frank MJ (2005) Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci 17:51-72 [Journal] [PubMed]

Frank MJ, Claus ED (2006) Anatomy of a decision: striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal. Psychol Rev 113:300-326 [Journal] [PubMed]

Frank MJ, Loughry B, O'Reilly RC (2001) Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cogn Affect Behav Neurosci 1:137-60 [PubMed]

Frank MJ, Seeberger LC, O'reilly RC (2004) By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306:1940-3 [Journal] [PubMed]

Gerfen CR (2000) Molecular effects of dopamine on striatal-projection pathways. Trends Neurosci 23:S64-70 [PubMed]

Gers FA, Schmidhuber J, Cummins F (2000) Learning to forget: continual prediction with LSTM. Neural Comput 12:2451-71 [PubMed]

Gorelova NA, Yang CR (2000) Dopamine D1/D5 receptor activation modulates a persistent sodium current in rat prefrontal cortical neurons in vitro. J Neurophysiol 84:75-87 [Journal] [PubMed]

Graybiel AM, Kimura M (1995) Adaptive neural networks in the basal ganglia Models of information processing in the basal ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.103

Haber SN, Fudge JL, McFarland NR (2000) Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20:2369-82 [PubMed]

Hernández-López S, Bargas J, Surmeier DJ, Reyes A, Galarraga E (1997) D1 receptor activation enhances evoked discharge in neostriatal medium spiny neurons by modulating an L-type Ca2+ conductance. J Neurosci 17:3334-42 [PubMed]

Hernandez-Lopez S, Tkatch T, Perez-Garci E, Galarraga E, Bargas J, Hamm H, Surmeier DJ (2000) D2 dopamine receptors in striatal medium spiny neurons reduce L-type Ca2+ currents and excitability via a novel PLC[beta]1-IP3-calcineurin-signaling cascade. J Neurosci 20:8987-95 [PubMed]

Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9:1735-80 [PubMed]

Houk JC, Adams JL, Barto AG (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement Models of information processing in the basal ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.233

Houk JC, Wise SP (1995) Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: their role in planning and controlling action. Cereb Cortex 5:95-110 [PubMed]

Jackson S, Houghton G (1995) Sensorimotor selection and the basal ganglia: A neural network model Models of information processing in the basal ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.337

Jaeger D, Kita H, Wilson CJ (1994) Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum. J Neurophysiol 72:2555-8 [Journal] [PubMed]

Joel D, Niv Y, Ruppin E (2002) Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw 15:535-47 [PubMed]

Joel D, Weiner I (2000) The connections of the dopaminergic system with the striatum in rats and primates: an analysis with respect to the functional and compartmental organization of the striatum. Neuroscience 96:451-74 [PubMed]

Jordan MI (1986) Attractor dynamics and parallelism in a connectionist sequential machine Proceedings of the 8th Confererence of the Cognitive Science Society :531-546

Kropotov JD, Etlinger SC (1999) Selection of actions in the basal ganglia-thalamocortical circuits: review and model. Int J Psychophysiol 31:197-217 [PubMed]

Levitt JB, Lewis DA, Yoshioka T, Lund JS (1993) Topography of pyramidal neuron intrinsic connections in macaque monkey prefrontal cortex (areas 9 and 46). J Comp Neurol 338:360-76 [Journal] [PubMed]

Lewis BL, O'Donnell P (2000) Ventral tegmental area afferents to the prefrontal cortex maintain membrane potential 'up' states in pyramidal neurons via D(1) dopamine receptors. Cereb Cortex 10:1168-75 [PubMed]

Lisman JE, Fellous JM, Wang XJ (1998) A role for NMDA-receptor channels in working memory. Nat Neurosci 1:273-5 [Journal] [PubMed]

Middleton FA, Strick PL (2000) Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Brain Res Rev 31:236-50 [PubMed]

Mink JW (1996) The basal ganglia: focused selection and inhibition of competing motor programs. Prog Neurobiol 50:381-425 [PubMed]

Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]

Morton JB, Munakata Y (2002) Active versus latent representations: a neural network model of perseveration, dissociation, and decalage. Dev Psychobiol 40:255-65 [PubMed]

Nakahara H, Doya K, Hikosaka O (2001) Parallel cortico-basal ganglia mechanisms for acquisition and execution of visuomotor sequences - a computational approach. J Cogn Neurosci 13:626-47 [Journal] [PubMed]

Nicola SM, Surmeier J, Malenka RC (2000) Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens. Annu Rev Neurosci 23:185-215 [Journal] [PubMed]

O'Reilly RC (1998) Six principles for biologically based computational models of cortical cognition. Trends Cogn Sci 2:455-62 [PubMed]

O'Reilly RC (2001) Generalization in interactive networks: the benefits of inhibitory competition and Hebbian learning. Neural Comput 13:1199-241 [PubMed]

O'Reilly RC, Frank MJ, Hazy TE, Watz B (2006) Rewards are timeless: The primary value and learned value (PVLV) Pavlovian learning algorithm Submitted

O'Reilly RC, Noelle DC, Braver TS, Cohen JD (2002) Prefrontal cortex and dynamic categorization tasks: representational organization and neuromodulatory control. Cereb Cortex 12:246-57 [PubMed]

Oja E (1982) A simplified neuron model as a principal component analyzer. J Math Biol 15:267-73 [PubMed]

Oreilly RC (1996) Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm Neural Comput 8:895-938

Oreilly RC, Braver TS, Cohen JD (1999) A biologically based computational model of working memory Models of working memory: Mechanisms of active maintenance and executive control, Miyake A:Shah P, ed. pp.375

Oreilly RC, Frank MJ (2003) Making working memory work: A computational model of learning in the frontal cortex and basal ganglia ICS Tech. Rep. 03-03, revised 8-04

OReilly RC, Munakata Y (2000) Computational explorations in cognitive neuroscience: understanding the mind by simulating the brain

Oreilly RC, Soto R (2002) A model of the phonological loop: Generalization and binding Advances in neural information processing systems, Dietterich TG:Becker S:Ghahramani Z, ed.

Pucak ML, Levitt JB, Lund JS, Lewis DA (1996) Patterns of intrinsic and associational circuitry in monkey prefrontal cortex. J Comp Neurol 376:614-30 [Journal] [PubMed]

Rescorla R, Wagner A (1972) A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement Classical Conditioning II: Current Research and Theory, Black A:Prokasy W, ed. pp.64

Robinson AJ, Fallside F (1987) The utility driven dynamic error propagation network Tech Rep CUED-F-INFENG-TR 1

Rougier NP, Noelle DC, Braver TS, Cohen JD, O'Reilly RC (2005) Prefrontal cortex and flexible cognitive control: rules without symbols. Proc Natl Acad Sci U S A 102:7338-43 [Journal] [PubMed]

Rougier NP, O'reilly RC (2002) Learning representations in a gated prefrontal cortex model of dynamic task switching Cognitive Science 26:503-520

Schmidhuber J (1992) Learning unambiguous reduced sequence descriptions Advances in neural information processing systems, Moody JE:Hanson SJ:Lippmann RP, ed. pp.291

Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27 [Journal] [PubMed]

Schultz W, Apicella P, Ljungberg T (1993) Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci 13:900-13 [PubMed]

Schultz W, Apicella P, Scarnati E, Ljungberg T (1992) Neuronal activity in monkey ventral striatum related to the expectation of reward. J Neurosci 12:4595-610 [PubMed]

Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]

Schultz W, Romo R, Ljungberg T, Mirenowicz J, Hollerman JR, Dickinson A (1995) Reward-related signals carried by dopamine neurons Models Of Information Processing In The Basal Ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.233

Suri RE, Bargas J, Arbib MA (2001) Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103:65-85 [PubMed]

Sutton RS (1988) Learning to predict by the method of temporal diferences Machine Learning 3:9-44

Sutton RS, Barto AG (1998) Reinforcement learning: an introduction [Journal]

Wang XJ (1999) Synaptic basis of cortical persistent activity: the importance of NMDA receptors to working memory. J Neurosci 19:9587-603 [PubMed]

Wickens J (1993) A theory of the striatum

Wickens JR, Kotter R, Alexander ME (1995) Effects of local connectivity on striatal function: stimulation and analysis of a model. Synapse 20:281-98 [Journal] [PubMed]

Widrow B, Hoff M (1960) Adaptive switching circuits Western Electronic Show And Convention Reco 4:96-104

Williams RJ, Zipser D (1992) Gradient-based learning algorithms for recurrent networks and their computational complexity Backpropagation: Theory, architectures and applications, Chauvin Y:Rumelhart DE, ed.