Citation Relationships

Keramati M, Dezfouli A, Piray P (2011) Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS Comput Biol 7:e1002055 [PubMed]

   Speed/accuracy trade-off between the habitual and the goal-directed processes (Kermati et al. 2011)

References and models cited by this paper

References and models that cite this paper

Aberman JE, Salamone JD (1999) Nucleus accumbens dopamine depletions make rats more sensitive to high ratio requirements but do not impair primary food reinforcement. Neuroscience 92:545-52 [PubMed]

Adams CD (1982) Variations in the sensitivity of instrumental responding to reinforcer devaluation Q J Exp Psychol 34:77-98

Alluisi E,Strain G,Thursmond J (1964) Stimulus-response compatibility and the rate of gain of information Psychon Sci 1:111-112


Balleine BW, Garner C, Gonzalez F, Dickinson A (1995) Motivational control of heterogeneous instrumental chains J Exp Psychol: Animal Behaviour Processes 21:203-217

Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48-69 [Journal] [PubMed]

Barto AG, Mahadevan S (2003) Recent advances in hierarchical reinforcement learning Discrete Event Dynamic Systems 13:341-379

Belin D, Jonkman S, Dickinson A, Robbins TW, Everitt BJ (2009) Parallel and interactive learning processes within the basal ganglia: relevance for the understanding of addiction. Behav Brain Res 199:89-102 [Journal] [PubMed]


Brown MF (1992) Does a cognitive map guide choices in the radial-arm maze? J Exp Psychol Anim Behav Process 18:56-66 [PubMed]

Buckner RL, Carroll DC (2007) Self-projection and the brain. Trends Cogn Sci 11:49-57 [Journal] [PubMed]

Carr GD, White NM (1987) Effects of systemic and intracranial amphetamine injections on behavior in the open field: a detailed analysis. Pharmacol Biochem Behav 27:113-22 [PubMed]

Colwill RM,Rescorla RA (1985) Instrumental responding remains sensitive to reinforcer devaluation after extensive training J Exp Psychol Anim Behav Process 11:520-536

Colwill RM,Rescorla RA (1988) The role of response-reinforcer associations increases throughout extended instrumental training Anim Learn Behav 16:105-111

Correa M, Carlson BB, Wisniecki A, Salamone JD (2002) Nucleus accumbens dopamine and work requirements on interval schedules. Behav Brain Res 137:179-87 [PubMed]

Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-11 [Journal] [PubMed]

Daw ND, Touretzky DS (2002) Long-term reward prediction in TD models of the dopamine system. Neural Comput 14:2567-83 [Journal] [PubMed]

Dearden R,Friedman N,Russell S (1998) Bayesian Q-Learning Proceedings of the 15th National Conference on Artificial Intelligence (AAAI) :761-768

Dickinson A (1985) Actions and habits: The development of behavioural autonomy Phil Trans Royal Soc London B 308:67-78

Dickinson A, Balleine B (2002) The role of learning in motivation Stevens handbook of experimental psychology (3rd ed), Gallistel CR, ed. pp.497

Dickinson A,Balleine B (1995) Motivational control of instrumental action Curr Dir Psychol Sci 4:162-167

Ellias SA, Grossberg S (1975) Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks Biol Cybern 20:69-98

Evans ML, Sherwin RS (2002) Blood glucose and the brain in diabetes: between a rock and a hard place? Curr Diab Rep 2:101-2 [PubMed]

Evenden JL, Robbins TW (1983) Increased response switching, perseveration and perseverative switching following d-amphetamine in the rat. Psychopharmacology (Berl) 80:67-73 [PubMed]

Geist M,Pietquin O,Fricout G (2009) Kalman temporal differences: the deterministic case Proceedings of the 2009 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09) :185-192

Gigerenzer G (2000) Adaptive thinking: Rationality in the real world Evolution

Gigerenzer G,Todd PM,Group AR () Simple heuristics that make us smart. 1st edition

Gold JI, Shadlen MN (2007) The neural basis of decision making. Annu Rev Neurosci 30:535-74 [Journal] [PubMed]

Haber SN (2003) The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26:317-30 [PubMed]

Haber SN, Fudge JL, McFarland NR (2000) Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20:2369-82 [PubMed]

Haruno M, Kawato M (2006) Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Netw 19:1242-54 [Journal] [PubMed]

Hick WE (4) On the rate of gain of information Q J Exp Psychol 11:26

Holland PC (2004) Relations between Pavlovian-instrumental transfer and reinforcer devaluation. J Exp Psychol Anim Behav Process 30:104-17 [Journal] [PubMed]

Howard R (1996) Information value theory IEEE T Syst Sci Cyb 2:22-26

Hu D, Xu X, Gonzalez-Lima F (2006) Vicarious trial-and-error behavior and hippocampal cytochrome oxidase activity during Y-maze discrimination learning in the rat. Int J Neurosci 116:265-80 [Journal] [PubMed]

HYMAN R (1953) Stimulus information as a determinant of reaction time. J Exp Psychol 45:188-96 [PubMed]

Jackson DM, Andén NE, Dahlström A (1975) A functional effect of dopamine in the nucleus accumbens and in some other dopamine-rich parts of the rat brain. Psychopharmacologia 45:139-49 [PubMed]

Joel D, Niv Y, Ruppin E (2002) Actor-critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw 15:535-47 [PubMed]

Jueptner M, Frith CD, Brooks DJ, Frackowiak RS, Passingham RE (1997) Anatomy of motor learning. II. Subcortical structures and learning by trial and error. J Neurophysiol 77:1325-37 [Journal] [PubMed]

Jueptner M, Stephan KM, Frith CD, Brooks DJ, Frackowiak RS, Passingham RE (1997) Anatomy of motor learning. I. Frontal cortex and attention to action. J Neurophysiol 77:1313-24 [Journal] [PubMed]

Julier SJ, Uhlmann JK (2004) Unscented filtering and nonlinear estimation Proc IEEE 92:401-422

Killcross S, Coutureau E (2003) Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex 13:400-8 [PubMed]

Kosaki Y, Dickinson A (2010) Choice and contingency in the development of behavioral autonomy during instrumental conditioning. J Exp Psychol Anim Behav Process 36:334-42 [Journal] [PubMed]

Laurent PA (2008) The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural Netw 21:1493-9 [Journal] [PubMed]

Ljungberg T, Enquist M (1987) Disruptive effects of low doses of d-amphetamine on the ability of rats to organize behaviour into functional sequences. Psychopharmacology (Berl) 93:146-51 [PubMed]

Lyons M,Robbins TW (1975) The action of central nervous system stimulant drugs: a general theory concerning amphetamine effects Current developments in psychopharmacology, Essman W:Valzelli L, ed. pp.80

Mahurin RK, Pirozzolo FJ (1993) Application of Hick's law of response speed in Alzheimer and Parkinson diseases. Percept Mot Skills 77:107-13 [Journal] [PubMed]

Mas-Colell A,Whinston MD,Green JR (1995) Microeconomic Theory

McClure SM, Daw ND, Montague PR (2003) A computational substrate for incentive salience. Trends Neurosci 26:423-8 [PubMed]

Mingote S, Weber SM, Ishiwari K, Correa M, Salamone JD (2005) Ratio and time requirements on operant schedules: effort-related effects of nucleus accumbens dopamine depletions. Eur J Neurosci 21:1749-57 [Journal] [PubMed]

Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]

Mowbray GH,Rhoades MV (1959) On the reduction of choice reaction-times with practice Q J Exp Psychol 11:16-23

Muenzinger K (1938) Vicarious trial and error at a point of choice. i. a general survey of its relation to learning efficacy J Genet Psychol 53:75-86

Munn NL (1950) Handbook of psychological research on the rat

Niv Y, Daw ND, Joel D, Dayan P (2007) Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) 191:507-20 [Journal] [PubMed]

Pessiglione M, Czernecki V, Pillon B, Dubois B, Schüpbach M, Agid Y, Tremblay L (2005) An effect of dopamine depletion on decision-making: the temporal coupling of deliberation and execution. J Cogn Neurosci 17:1886-96 [Journal] [PubMed]

Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545-56 [Journal] [PubMed]

Redish AD, Jensen S, Johnson A (2008) A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci 31:415-37; discussion 437-87 [Journal] [PubMed]

Redish AD, Jensen S, Johnson A, Kurth-Nelson Z (2007) Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. Psychol Rev 114:784-805 [Journal] [PubMed]

Robbins TW,Everitt BJ (1992) Functions of dopamine in the dorsal and ventral striatum Semin Neurosci 4:119-127

Salamone JD, Wisniecki A, Carlson BB, Correa M (2001) Nucleus accumbens dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience 105:863-70

Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80:1-27 [Journal] [PubMed]

Shah A, Barto AG (2009) Effect on movement selection of an evolving sensory representation: a multiple controller model of skill acquisition. Brain Res 1299:55-73 [Journal] [PubMed]

Shiv B,Fedorikhin A (1999) Heart and mind in conflict: The interplay of affect and cognition in consumer decision making J Cons Res 26:278-92

Simon H (1947) Administrative behavior

Simon H (1955) A behavioral model of rational choice Q J Econ 69:99-118

Simon H (1982) Models of bounded rationality

Sokolowski JD, Salamone JD (1998) The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell. Pharmacol Biochem Behav 59:557-66 [PubMed]


Suri RE (2001) Anticipatory responses of dopamine neurons and cortical neurons reproduced by internal model. Exp Brain Res 140:234-40 [Journal] [PubMed]

Tassinari H, Hudson TE, Landy MS (2006) Combining priors and noisy visual cues in a rapid pointing task. J Neurosci 26:10154-63 [Journal] [PubMed]

Taylor JR, Robbins TW (1984) Enhanced behavioural control by conditioned reinforcers following microinjections of d-amphetamine into the nucleus accumbens. Psychopharmacology (Berl) 84:405-12 [PubMed]

Taylor JR, Robbins TW (1986) 6-Hydroxydopamine lesions of the nucleus accumbens, but not of the caudate nucleus, attenuate enhanced responding with reward-related stimuli produced by intra-accumbens d-amphetamine. Psychopharmacology (Berl) 90:390-7 [PubMed]

Tolman E (1938) The determiners of behavior at a choice point. Psychol Rev 45:1-41

Tolman E (1939) Prediction of vicarious trial and error by means of the schematic sowbug Psychol Rev 46:318-336

Tsitsiklis JN,Roy BV (1997) Average cost temporal-difference learning Automatica 35:1799-1808

Vickrey C, Neuringer A (2000) Pigeon reaction time, Hick's law, and intelligence. Psychon Bull Rev 7:284-91 [PubMed]

Welford AT (1980) Choice reaction time: basic concepts Reaction Times, Welford AT, ed. pp.73

Yin HH, Knowlton BJ, Balleine BW (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19:181-9 [PubMed]

Yuille A,Geiger D (1995) Winner-Take-All mechanisms Handbook of Brain Theory and Neural Networks, Arbib M, ed.

Zilberstein S,Russell S (1995) Approximate reasoning using anytime algorithms Imprecise and Approximate Computation, The Kluwer International Series in Engineering and Computer Science, Natarajan S, ed. pp.43

Fiore VG, Ognibene D, Adinoff B, Gu X (2018) A Multilevel Computational Characterization of Endophenotypes in Addiction eNeuro [Journal]

   Computational endophenotypes in addiction (Fiore et al 2018) [Model]

Viejo G, Girard B, Khamassi M (2016) [Re] Speed/accuracy trade-off between the habitual and the goal-directed processes ReScience 2(1):1-5 [Journal]

   Speed/accuracy trade-off between the habitual and the goal-directed processes (Kermati et al. 2011) [Model]

(83 refs)