Citation Relationships

Smith AJ, Becker S, Kapur S (2005) A computational model of the functional role of the ventral-striatal D2 receptor in the expression of previously acquired behaviors. Neural Comput 17:361-95 [PubMed]

References and models cited by this paper

References and models that cite this paper

ADER R, CLINK DW (1957) Effects of chlorpromazine on the acquisition and extinction of an avoidance response in the rat. J Pharmacol Exp Ther 121:144-8 [PubMed]

Aguilar MA, Marí-Sanmillán MI, Morant-Deusa JJ, Miñarro J (2000) Different inhibition of conditioned avoidance response by clozapine and DA D1 and D2 antagonists in male mice. Behav Neurosci 114:389-400 [PubMed]

Anisman H, Irwin J, Zacharko RM, Tombaugh TN (1982) Effects of dopamine receptor blockade on avoidance performance: assessment of effects on cue-shock and response-outcome associations. Behav Neural Biol 36:280-90 [PubMed]

Arana FS, Parkinson JA, Hinton E, Holland AJ, Owen AM, Roberts AC (2003) Dissociable contributions of the human amygdala and orbitofrontal cortex to incentive motivation and goal selection. J Neurosci 23:9632-8 [PubMed]

Arnt J (1982) Pharmacological specificity of conditioned avoidance response inhibition in rats: inhibition by neuroleptics and correlation to dopamine receptor blockade. Acta Pharmacol Toxicol (Copenh) 51:321-9 [PubMed]

Balleine BW, Garner C, Gonzalez F, Dickinson A (1995) Motivational control of heterogeneous instrumental chains J Exp Psychol: Animal Behaviour Processes 21:203-217

Bechara A, Damasio H, Tranel D, Anderson SW (1998) Dissociation Of working memory from decision making within the human prefrontal cortex. J Neurosci 18:428-37 [PubMed]

Beck AT, Rector NA (2003) A cognitive model of hallucinations Cognitive Therapy And Research 27:19-52

Bell DS (1973) The experimental reproduction of amphetamine psychosis. Arch Gen Psychiatry 29:35-40 [PubMed]

Beninger RJ (1989) Dissociating the effects of altered dopaminergic function on performance and learning. Brain Res Bull 23:365-71 [PubMed]

Beninger RJ, Hahn BL (1983) Pimozide blocks establishment but not expression of amphetamine-produced environment-specific conditioning. Science 220:1304-6 [PubMed]

Beninger RJ, Mason ST, Phillips AG, Fibiger HC (1980) The use of conditioned suppression to evaluate the nature of neuroleptic-induced avoidance deficits. J Pharmacol Exp Ther 213:623-7 [PubMed]

Beninger RJ, Mason ST, Phillips AG, Fibiger HC (1980) The use of extinction to investigate the nature of neuroleptic-induced avoidance deficits. Psychopharmacology (Berl) 69:11-8 [PubMed]

Berridge KC, Robinson TE (1998) What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience? Brain Res Brain Res Rev 28:309-69 [PubMed]

Berridge KC, Robinson TE (2003) Parsing reward. Trends Neurosci 26:507-13 [Journal] [PubMed]

Berridge KC, Schulkin J (1989) Palatability shift of a salt-associated incentive during sodium depletion. Q J Exp Psychol B 41:121-38 [PubMed]

BLACK AH (1963) The effects of CS-US interval on avoidance conditioning in the rat. Can J Psychol 17:174-82 [PubMed]

Blackburn JR, Phillips AG (1989) Blockade of acquisition of one-way conditioned avoidance responding by haloperidol and metoclopramide but not by thioridazine or clozapine: implications for screening new antipsychotic drugs. Psychopharmacology (Berl) 98:453-9 [PubMed]

Cador M, Robbins TW, Everitt BJ (1989) Involvement of the amygdala in stimulus-reward associations: interaction with the ventral striatum. Neuroscience 30:77-86 [PubMed]

Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26:321-52 [PubMed]

Cardinal RN, Pennicott DR, Sugathapala CL, Robbins TW, Everitt BJ (2001) Impulsive choice induced in rats by lesions of the nucleus accumbens core. Science 292:2499-501 [Journal] [PubMed]

Cardinal RN, Robbins TW, Everitt BJ (2000) The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology (Berl) 152:362-75 [PubMed]

catania ac (2005) Attention-Deficit/Hyperactivity Disorder (ADHD): delay-of-reinforcement gradients and other behavioral mechanisms Behavioral and Brain Sciences 28:419–424 [Journal]

Connell PH (1958) Amphetamine psychosis


COOK L, WEIDLEY E (1957) Behavioral effects of some psychopharmacological agents. Ann N Y Acad Sci 66:740-52 [PubMed]

Courvoisier S (1956) Pharmacodynamic basis for the use of chlorpromazine in psychiatry Quart Rev Psych Neurol 17:25-37

COURVOISIER S (2005) Pharmacodynamic basis for the use of chlorpromazine in psychiatry. J Clin Exp Psychopathol 17:25-37

Cousins MS, Atherton A, Turner L, Salamone JD (1996) Nucleus accumbens dopamine depletions alter relative response allocation in a T-maze cost/benefit task. Behav Brain Res 74:189-97 [PubMed]

Davidson AB, Weidley E (1976) Differential effects of neuroleptic and other psychotropic agents on acquisition of avoidance in rats. Life Sci 18:1279-84 [PubMed]

DAVIS WM, CAPEHART J, LLEWELLIN WL (1961) Mediated acquisition of a fear-motivated response and inhibitory effects of chlorpromazine. Psychopharmacologia 2:268-76 [PubMed]

Daw ND, Courville AC, Touretzky DS (2004) Timing and partial observability in the dopamine system Advances in neural information processing systems, Still S:Bialek W:Botlou L, ed.

Dayan P (2002) Motivated reinforcement learning Advances in neural information processing systems, Dietterich T:Becker S:Ghahramani Z, ed. pp.11

Dayan P, Balleine BW (2002) Reward, motivation, and reinforcement learning. Neuron 36:285-98 [PubMed]

de Wit H, Enggasser JL, Richards JB (2002) Acute administration of d-amphetamine decreases impulsivity in healthy volunteers. Neuropsychopharmacology 27:813-25 [Journal] [PubMed]

Dews PB, Morse WH (1961) Behavioral Pharmacology Ann Rev Pharmacol 1:145-174

Di Chiara G (1999) Drug addiction as dopamine-dependent associative learning disorder. Eur J Pharmacol 375:13-30 [PubMed]

Dias R, Robbins TW, Roberts AC (1996) Dissociation in prefrontal cortex of affective and attentional shifts. Nature 380:69-72 [Journal] [PubMed]

Dickinson A (1980) Contemporary animal learning theory

Dickinson A (1987) Instrumental performance following saccharin pre-feeding. Behav Processes 14:147-54 [Journal] [PubMed]

Dickinson A, Nicholas DJ, Adams CD (1983) The effect of the instrumental training contingency on susceptibility to reinforcer devaluation Quart J Exp Psychol 35B:35-51

Dickinson A, Smith J, Mirenowicz J (2000) Dissociation of Pavlovian and instrumental incentive learning under dopamine antagonists. Behav Neurosci 114:468-83 [PubMed]

Ettenberg A (1989) Dopamine, neuroleptics and reinforced behavior. Neurosci Biobehav Rev 13:105-11 [PubMed]

Ettenberg A, Koob GF, Bloom FE (1981) Response artifact in the measurement of neuroleptic-induced anhedonia. Science 213:357-9 [PubMed]

Evenden JL, Robbins TW (1983) Dissociable effects of d-amphetamine, chlordiazepoxide and alpha-flupenthixol on choice and rate measures of reinforcement in the rat. Psychopharmacology (Berl) 79:180-6 [PubMed]

Everitt BJ, Cador M, Robbins TW (1989) Interactions between the amygdala and ventral striatum in stimulus-reward associations: studies using a second-order schedule of sexual reinforcement. Neuroscience 30:63-75 [PubMed]

Everitt BJ, Morris KA, O'Brien A, Robbins TW (1991) The basolateral amygdala-ventral striatal system and conditioned place preference: further evidence of limbic-striatal interactions underlying reward-related processes. Neuroscience 42:1-18 [PubMed]

Fibiger HC, Carter DA, Phillips AG (1976) Decreased intracranial self-stimulation after neuroleptics or 6-hydroxydopamine: evidence for mediation by motor deficits rather than by reduced reward. Psychopharmacology (Berl) 47:21-7 [PubMed]

Fiorillo CD, Tobler PN, Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299:1898-902 [Journal] [PubMed]

Fowler SC, LaCerra MM, Ettenberg A (1986) Effects of haloperidol on the biophysical characteristics of operant responding: implications for motor and reinforcement processes. Pharmacol Biochem Behav 25:791-6 [PubMed]

Frances A (2000) Diagnostic and statistical manual of mental disorders, Frances A, ed.

Giordano LA, Bickel WK, Loewenstein G, Jacobs EA, Marsch L, Badger GJ (2002) Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology (Berl) 163:174-82 [Journal] [PubMed]

Gottfried JA, O'Doherty J, Dolan RJ (2002) Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci 22:10829-37 [PubMed]

Grace AA (1991) Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience 41:1-24 [PubMed]

Grace AA (2000) Gating of information flow within the limbic system and the pathophysiology of schizophrenia. Brain Res Brain Res Rev 31:330-41 [PubMed]

Grilly DM, Johnson SK, Minardo R, Jacoby D, LaRiccia J (1984) How do tranquilizing agents selectively inhibit conditioned avoidance responding? Psychopharmacology (Berl) 84:262-7 [PubMed]

Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1:304-9 [Journal] [PubMed]

Horvitz JC (2000) Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience 96:651-6 [PubMed]

Horvitz JC (2002) Dopamine gating of glutamatergic sensorimotor and incentive motivational input signals to the striatum. Behav Brain Res 137:65-74 [PubMed]

Houk JC, Adams JL, Barto AGA (1995) A model of how the basal ganglia generate and use neural signals that predict reinforcement. Models Of Information Processing In The Basal Ganglia, Houk JC:Davis JL:Beiser DG, ed. pp.249

HUNT HF (1956) Some effects of drugs on classical (type S) conditioning. Ann N Y Acad Sci 65:258-67 [PubMed]

Ikemoto S, Panksepp J (1999) The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res Brain Res Rev 31:6-41 [PubMed]

Irwin S (1958) Factors influencing acquisition of avoidance behaviour and sensitivity to drugs Fed Proc 17:380

Iversen SD, Mishkin M (1970) Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res 11:376-86 [PubMed]


Jensen J, McIntosh AR, Crawley AP, Mikulis DJ, Remington G, Kapur S (2003) Direct activation of the ventral striatum in anticipation of aversive stimuli. Neuron 40:1251-7 [PubMed]

Joseph MH, Datla K, Young AM (2003) The interpretation of the measurement of nucleus accumbens dopamine by in vivo dialysis: the kick, the craving or the cognition? Neurosci Biobehav Rev 27:527-41 [PubMed]

Kaelbling LP, Littman ML, Moore AW (1996) Reinforcement learning: A survey J Art Intell Res 4:237-285

KAMIN LJ (1954) Traumatic avoidance learning: the effects of CS-US interval with a trace-conditioning procedure. J Comp Physiol Psychol 47:65-72 [PubMed]

Kandel E, Schwartz J, Jessell T (1991) The Principles of Neural Science

Kauer JA (2003) Addictive drugs and stress trigger a common change at VTA synapses. Neuron 37:549-50 [PubMed]

KEY BJ (1961) The effect of drugs on discrimination and sensory generalisation of auditory stimuli in cats. Psychopharmacologia 2:352-63 [PubMed]

Kilts CD (2001) The changing roles and targets for animal models of schizophrenia. Biol Psychiatry 50:845-55 [PubMed]

Low LA, Eliasson M, Kornetsky C (1966) Effect of chlorpromazine on avoidance acquisition as a function of CS-US interval length. Psychopharmacologia 10:148-54 [PubMed]

Low LA, Low HL (1962) Effects of CS-US interval upon avoidance responding J Compar Physiol Psychol 55:1059-1061

MAFFII G (1959) The secondary conditioned response of rats and the effects of some psychopharmacological agents. J Pharm Pharmacol 11:129-39 [PubMed]

Maher B, Ross JS (1984) Delusions Comprehensive handbook of psychopathology, Adams HE:Sutker P, ed. pp.383

Masterman DL, Cummings JL (1997) Frontal-subcortical circuits: the anatomic basis of executive, social and motivated behaviors. J Psychopharmacol 11:107-14 [Journal] [PubMed]

McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-8 [PubMed]

MILLER RE, MURPHY JV, MIRSKY IA (1957) The effect of chlorpromazine on fear-motivated behavior in rats. J Pharmacol Exp Ther 120:379-87 [PubMed]

Montague PR, Berns GS (2002) Neural economics and the biological substrates of valuation. Neuron 36:265-84 [PubMed]

Montague PR, Dayan P, Person C, Sejnowski TJ (1995) Bee foraging in uncertain environments using predictive hebbian learning. Nature 377:725-8 [Journal] [PubMed]

Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]

Moore H, West AR, Grace AA (1999) The regulation of forebrain dopamine transmission: relevance to the pathophysiology and psychopathology of schizophrenia. Biol Psychiatry 46:40-55 [PubMed]

Morpurgo C (1965) Drug-induced modifications of discriminated avoidance behavior in rats. Psychopharmacologia 8:91-9 [PubMed]

Nishijo H, Ono T, Nishino H (1988) Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8:3570-83 [PubMed]

O'Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38:329-37 [PubMed]

O'Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33:815-26 [PubMed]

Ogren SO, Archer T (1994) Effects of typical and atypical antipsychotic drugs on two-way active avoidance. Relationship to DA receptor blocking profile. Psychopharmacology (Berl) 114:383-91

Pennartz CM, Groenewegen HJ, Lopes da Silva FH (1994) The nucleus accumbens as a complex of functionally distinct neuronal ensembles: an integration of behavioural, electrophysiological and anatomical data. Prog Neurobiol 42:719-61 [PubMed]

Phares V (2003) Understanding abnormal child psychology

Phillips PE, Stuber GD, Heien ML, Wightman RM, Carelli RM (2003) Subsecond dopamine release promotes cocaine seeking. Nature 422:614-8 [Journal] [PubMed]

POSLUNS D (1962) An analysis of chlorpromazine-induced suppression of the avoidance response. Psychopharmacologia 3:361-73 [PubMed]

Redgrave P, Prescott TJ, Gurney K (1999) Is the short-latency dopamine response too short to signal reward error? Trends Neurosci 22:146-51 [PubMed]

Richards JB, Sabol KE, de Wit H (1999) Effects of methamphetamine on the adjusting amount procedure, a model of impulsive behavior in rats. Psychopharmacology (Berl) 146:432-9 [PubMed]

Rizley RC, Rescorla RA (1972) Associations in second-order conditioning and sensory preconditioning. J Comp Physiol Psychol 81:1-11 [PubMed]

Robbins TW, Cador M, Taylor JR, Everitt BJ (2005) Limbic-striatal interactions in reward-related processes. Neurosci Biobehav Rev 13:155-62

Rolls ET, Rolls BJ, Kelly PH, Shaw SG, Wood RJ, Dale R (1974) The relative attenuation of self-stimulation, eating and drinking produced by dopamine-receptor blockade. Psychopharmacologia 38:219-30 [PubMed]

Salamone JD, Cousins MS, Bucher S (1994) Anhedonia or anergia? Effects of haloperidol and nucleus accumbens dopamine depletion on instrumental response selection in a T-maze cost/benefit procedure. Behav Brain Res 65:221-9 [PubMed]

Salamone JD, Cousins MS, Snyder BJ (1997) Behavioral functions of nucleus accumbens dopamine: empirical and conceptual problems with the anhedonia hypothesis. Neurosci Biobehav Rev 21:341-59 [PubMed]

Salamone JD, Kurth PA, McCullough LD, Sokolowski JD, Cousins MS (1993) The role of brain dopamine in response initiation: effects of haloperidol and regionally specific dopamine depletions on the local rate of instrumental responding. Brain Res 628:218-26 [PubMed]

Salamone JD, Steinpreis RE, McCullough LD, Smith P, Grebel D, Mahan K (1991) Haloperidol and nucleus accumbens dopamine depletion suppress lever pressing for food but increase free food consumption in a novel food choice procedure. Psychopharmacology (Berl) 104:515-21 [PubMed]

Salamone JD, Wisniecki A, Carlson BB, Correa M (2001) Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105:863-70

Schmajuk NA, Cox L, Gray JA (2001) Nucleus accumbens, entorhinal cortex and latent inhibition: a neural network model. Behav Brain Res 118:123-41 [PubMed]

Schmajuk NA, Moore JW (1988) The hippocampus and the classically conditioned nictitating membraneresponse: A real-time attentional-associative model Psychobiology 16:20-35

Schneider JS, Sun ZQ, Roeltgen DP (1994) Effects of dopamine agonists on delayed response performance in chronic low-dose MPTP-treated monkeys. Pharmacol Biochem Behav 48:235-40 [PubMed]

Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]

Schultz W, Tremblay L, Hollerman JR (2000) Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex 10:272-84 [PubMed]

Seeman P, Madras BK (1998) Anti-hyperactivity medication: methylphenidate and amphetamine. Mol Psychiatry 3:386-96 [PubMed]

Smith A, Li M, Becker S, Kapur S (2004) A model of antipsychotic action in conditioned avoidance: a computational approach. Neuropsychopharmacology 29:1040-9 [Journal] [PubMed]

Solanto MV, Abikoff H, Sonuga-Barke E, Schachar R, Logan GD, Wigal T, Hechtman L, Hinshaw S, Turkel E (2001) The ecological validity of delay aversion and response inhibition as measures of impulsivity in AD/HD: a supplement to the NIMH multimodal treatment study of AD/HD. J Abnorm Child Psychol 29:215-28 [PubMed]

Stark H, Bischof A, Scheich H (1999) Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box. Neurosci Lett 264:77-80 [PubMed]

Suri RE (2001) Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Exp Brain Res 140:234-40 [Journal] [PubMed]

Suri RE (2005) TD models of reward predictive responses in dopamine neurons. Neural Netw 15:523-33

Suri RE, Bargas J, Arbib MA (2001) Modeling functions of striatal dopamine modulation in learning and planning. Neuroscience 103:65-85 [PubMed]

Suri RE, Schultz W (1998) Learning of sequential movements by neural network model with dopamine-like reinforcement signal. Exp Brain Res 121:350-4 [PubMed]

Sutton RS (1988) Learning to predict by the method of temporal diferences Machine Learning 3:9-44

Sutton RS, Barto AG (1981) An adaptive network that constructs and uses an internal model of its world Cognition And Brain Theory 4:217-246

Sutton RS, Barto AG (1998) Reinforcement learning: an introduction [Journal]

   A reinforcement learning example (Sutton and Barto 1998) [Model]

Talk AC, Gandhi CC, Matzel LD (2002) Hippocampal function during behaviorally silent associative learning: dissociation of memory storage and expression. Hippocampus 12:648-56 [Journal] [PubMed]

Taylor JR, Robbins TW (1984) Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens. Psychopharmacology (Berl) 84:405-12 [PubMed]

Tremblay L, Schultz W (2000) Modifications of reward expectation-related neuronal activity during learning in primate orbitofrontal cortex. J Neurophysiol 83:1877-85 [Journal] [PubMed]

Tremblay L, Schultz W (2000) Reward-related neuronal activity during go-nogo task performance in primate orbitofrontal cortex. J Neurophysiol 83:1864-76 [Journal] [PubMed]

van der Heyden JA, Bradford LD (1988) A rapidly acquired one-way conditioned avoidance procedure in rats as a primary screening test for antipsychotics: influence of shock intensity on avoidance performance. Behav Brain Res 31:61-7 [PubMed]

Wade TR, de Wit H, Richards JB (2000) Effects of dopaminergic drugs on delayed reward as a measure of impulsive behavior in rats. Psychopharmacology (Berl) 150:90-101 [PubMed]

Wadenberg ML, Hicks PB (1999) The conditioned avoidance response test re-evaluated: is it a sensitive test for the detection of potentially atypical antipsychotics? Neurosci Biobehav Rev 23:851-62 [PubMed]

Wadenberg ML, Kapur S, Soliman A, Jones C, Vaccarino F (2000) Dopamine D2 receptor occupancy predicts catalepsy and the suppression of conditioned avoidance response behavior in rats. Psychopharmacology (Berl) 150:422-9 [PubMed]

Wadenberg ML, Soliman A, VanderSpek SC, Kapur S (2001) Dopamine D(2) receptor occupancy is a common mechanism underlying animal models of antipsychotics and their clinical effects. Neuropsychopharmacology 25:633-41 [Journal] [PubMed]

Waelti P, Dickinson A, Schultz W (2001) Dopamine responses comply with basic assumptions of formal learning theory. Nature 412:43-8 [Journal] [PubMed]

Wilkinson LS, Humby T, Killcross AS, Torres EM, Everitt BJ, Robbins TW (1998) Dissociations in dopamine release in medial prefrontal cortex and ventral striatum during the acquisition and extinction of classical aversive conditioning in the rat. Eur J Neurosci 10:1019-26 [PubMed]

Wilson M, Daly M (2004) Do pretty women inspire men to discount the future? Proc Biol Sci 271 Suppl 4:S177-9 [Journal] [PubMed]

Wise RA (1982) Neuroleptics and operant behavior: the anhedonia hypothesis Behav Brain Sci 5:39

Wise RA (2002) Brain reward circuitry: insights from unsensed incentives. Neuron 36:229-40 [PubMed]

Wise RA, Schwartz HV (1981) Pimozide attenuates acquisition of lever-pressing for food in rats. Pharmacol Biochem Behav 15:655-6 [PubMed]

Wise RA, Spindler J, deWit H, Gerberg GJ (1978) Neuroleptic-induced "anhedonia" in rats: pimozide blocks reward quality of food. Science 201:262-4 [PubMed]

Young AM, Ahier RG, Upton RL, Joseph MH, Gray JA (1998) Increased extracellular dopamine in the nucleus accumbens of the rat during associative learning of neutral stimuli. Neuroscience 83:1175-83 [PubMed]

Daw ND, Courville AC, Tourtezky DS, Touretzky DS (2006) Representation and timing in theories of the dopamine system. Neural Comput 18:1637-77 [Journal] [PubMed]

(137 refs)