Citation Relationships



Soltani A, Wang XJ (2006) A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J Neurosci 26:3731-44 [PubMed]

References and models cited by this paper

References and models that cite this paper

Amit DJ, Fusi S (1994) Learning in neural networks with material synapses Neural Comput 6:957-982

Anderson KG, Velkey AJ, Woolverton WL (2002) The generalized matching law as a predictor of choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) 163:319-26 [Journal] [PubMed]

Barraclough DJ, Conroy ML, Lee D (2004) Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci 7:404-10 [Journal] [PubMed]

Baum WM (1974) On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav 22:231-42 [PubMed]

Baum WM (1979) Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav 32:269-81

Baum WM (1981) Optimization and the matching law as accounts of instrumental behavior. J Exp Anal Behav 36:387-403 [PubMed]

Bi G, Poo M (2001) Synaptic modification by correlated activity: Hebb's postulate revisited. Annu Rev Neurosci 24:139-66 [Journal] [PubMed]

Brunel N, Carusi F, Fusi S (1998) Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network. Network 9:123-52 [PubMed]

Brunel N, Wang XJ (2001) Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition. J Comput Neurosci 11:63-85 [PubMed]

Compte A, Constantinidis C, Tegner J, Raghavachari S, Chafee MV, Goldman-Rakic PS, Wang XJ (2003) Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. J Neurophysiol 90:3441-54 [Journal] [PubMed]

Corrado GS, Sugrue LP, Seung HS, Newsome WT (2005) Linear-Nonlinear-Poisson models of primate choice dynamics. J Exp Anal Behav 84:581-617 [PubMed]

Davison M, Baum WM (2000) Choice in a variable environment: every reinforcer counts. J Exp Anal Behav 74:1-24 [Journal] [PubMed]

de_Villiers PA, Herrnstein RJ (1976) Toward a law of response strength Psychol Bull 83:1131-1153

Dorris MC, Glimcher PW (2004) Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron 44:365-78 [Journal] [PubMed]

Doya K (2002) Metalearning and neuromodulation. Neural Netw 15:495-506 [PubMed]

Fino E, Glowinski J, Venance L (2005) Bidirectional activity-dependent plasticity at corticostriatal synapses. J Neurosci 25:11279-87 [Journal] [PubMed]

Fusi S (2002) Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates. Biol Cybern 87:459-70 [Journal] [PubMed]

Fusi S, Asaad WF, Miller EK, Wang X-J (2005) A microcircuit model of arbitrary sensori-motor mapping: learning and forgetting on multiple time scales Soc Neurosci Abstr 31:813

Fusi S, Drew PJ, Abbott LF (2005) Cascade models of synaptically stored memories. Neuron 45:599-611 [Journal] [PubMed]

Gallistel CR (2005) Foraging for brain stimulation: toward a neurobiology of computation. Cognition 50:151-70

Gallistel CR, Mark TA, King AP, Latham PE (2001) The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. J Exp Psychol Anim Behav Process 27:354-72 [PubMed]

HERRNSTEIN RJ (1961) Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav 4:267-72 [Journal] [PubMed]

Herrnstein RJ (1991) Melioration: a theory of distributed choice J Econ Perspect 5:137-156

Herrnstein RJ, Rachlin H, Laibson DI (1997) The matching law: papers in psychology and economics

Herrnstein RJ, Vaughan WJ (1980) Melioration and behavioral allocation Limits to action: the allocation of individual behavior, Staddon JER, ed. pp.143

Heyman GM (1979) A Markov model description of changeover probabilities on concurrent variable-interval schedules. J Exp Anal Behav 31:41-51 [PubMed]

Heyman GM, Luce D (1979) Operant matching is not a logical consequences of maximizing reinforcement rate Learn Behav 7:133-140

Hikosaka O, Nakamura K, Nakahara H (2006) Basal ganglia orient eyes to reward. J Neurophysiol 95:567-84 [Journal] [PubMed]

Houston AI, Sumida BH (1987) Learning rules, matching and frequency dependence J Theor Biol 126:289-308

Huang YY, Simpson E, Kellendonk C, Kandel ER (2004) Genetic evidence for the bidirectional modulation of synaptic plasticity in the prefrontal cortex by D1 receptors. Proc Natl Acad Sci U S A 101:3236-41 [Journal] [PubMed]

Jay TM (2003) Dopamine: a potential substrate for synaptic plasticity and memory mechanisms. Prog Neurobiol 69:375-90 [PubMed]

Kawagoe R, Takikawa Y, Hikosaka O (1998) Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci 1:411-6 [Journal] [PubMed]

Lau B, Glimcher PW (2005) Caudate neurons encode both saccade and reward information in a free-choice task Soc Neurosci Abstr 31:400

Lau B, Glimcher PW (2005) Dynamic response-by-response models of matching behavior in rhesus monkeys. J Exp Anal Behav 84:555-79 [PubMed]

Lauwereyns J, Watanabe K, Coe B, Hikosaka O (2002) A neural correlate of response bias in monkey caudate nucleus. Nature 418:413-7 [Journal] [PubMed]

Leon MI, Shadlen MN (1999) Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque. Neuron 24:415-25 [PubMed]

Malenka RC, Nicoll RA (1999) Long-term potentiation--a decade of progress? Science 285:1870-4 [PubMed]

Montague PR, Berns GS (2002) Neural economics and the biological substrates of valuation. Neuron 36:265-84 [PubMed]

O'Connor DH, Wittenberg GM, Wang SS (2005) Graded bidirectional synaptic plasticity is composed of switch-like unitary events. Proc Natl Acad Sci U S A 102:9679-84 [Journal] [PubMed]

Otani S, Daniel H, Roisin MP, Crepel F (2003) Dopaminergic modulation of long-term synaptic plasticity in rat prefrontal neurons. Cereb Cortex 13:1251-6 [PubMed]

Petersen CC, Malenka RC, Nicoll RA, Hopfield JJ (1998) All-or-none potentiation at CA3-CA1 synapses. Proc Natl Acad Sci U S A 95:4732-7 [PubMed]

Platt ML, Glimcher PW (1999) Neural correlates of decision variables in parietal cortex. Nature 400:233-8 [Journal] [PubMed]

Reynolds JN, Hyland BI, Wickens JR (2001) A cellular mechanism of reward-related learning. Nature 413:67-70 [Journal] [PubMed]

Reynolds JN, Wickens JR (2002) Dopamine-dependent plasticity of corticostriatal synapses. Neural Netw 15:507-21 [PubMed]

Roitman JD, Shadlen MN (2002) Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci 22:9475-89 [PubMed]

Rorie AE, Newsome WT (2004) The role of area LIP in a direction discrimination task with multiple reward contingencies Soc Neurosci Abstr 30:20

Samejima K, Ueda Y, Doya K, Kimura M (2005) Representation of action-specific reward values in the striatum. Science 310:1337-40 [Journal] [PubMed]

Schmolesky MT, Wang Y, Hanes DP, Thompson KG, Leutgeb S, Schall JD, Leventhal AG (1998) Signal timing across the macaque visual system. J Neurophysiol 79:3272-8 [Journal] [PubMed]

Schultz W (2000) Multiple reward signals in the brain. Nat Rev Neurosci 1:199-207 [Journal] [PubMed]

Schultz W (2006) Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 57:87-115 [Journal] [PubMed]

Schweighofer N, Doya K (2003) Meta-learning in reinforcement learning. Neural Netw 16:5-9 [PubMed]

Seung HS (2003) Learning in spiking neural networks by reinforcement of stochastic synaptic transmission. Neuron 40:1063-73 [PubMed]

Shadlen MN, Newsome WT (1994) Noise, neural codes and cortical organization. Curr Opin Neurobiol 4:569-79 [PubMed]

Shadlen MN, Newsome WT (1996) Motion perception: seeing and deciding. Proc Natl Acad Sci U S A 93:628-33 [PubMed]

Shadlen MN, Newsome WT (2001) Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol 86:1916-36 [Journal] [PubMed]

Shidara M, Richmond BJ (2002) Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296:1709-11 [Journal] [PubMed]

Softky WR, Koch C (1993) The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci 13:334-50 [PubMed]

Soltani A, Wang XJ (2004) Exploring the neural basis of the matching law in choice behavior: a cortical network model with reward-gated learning Soc Neurosci Abstr 30:668

Staddon JER, Motheral S (1978) On matching and maximization in operant choice experiments Psychol Rev 85:436-444

Sugrue LP, Corrado GC, Newsome WT (2004) Neural correlates of valuein orbito frontal cortex of the rhesus monkey Soc Neurosci Abstr 30:671

Sugrue LP, Corrado GS, Newsome WT (2004) Matching behavior and the representation of value in the parietal cortex. Science 304:1782-7 [Journal] [PubMed]

Sugrue LP, Corrado GS, Newsome WT (2005) Choosing the greater of two goods: neural currencies for valuation and decision making. Nat Rev Neurosci 6:363-75 [Journal] [PubMed]

Sutton RS, Barto AG (1998) Reinforcement learning: an introduction [Journal]

   A reinforcement learning example (Sutton and Barto 1998) [Model]

van Vreeswijk C, Sompolinsky H (1996) Chaos in neuronal networks with balanced excitatory and inhibitory activity. Science 274:1724-6 [PubMed]

Vaughan W (1981) Melioration, matching, and maximization. J Exp Anal Behav 36:141-9 [PubMed]

Wang XJ (2002) Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36:955-68 [PubMed]

Williams BA (1988) Reinforcement, choice, and response strength Stevens handbook of experimental psychology (2nd Ed), Atkinson RC:Herrnstein RJ:Lindzey G:Luce RD, ed. pp.167

(67 refs)