Citation Relationships

Legends: Link to a Model Reference cited by multiple papers

Fiore VG, Ognibene D, Adinoff B, Gu X (2018) A Multilevel Computational Characterization of Endophenotypes in Addiction eNeuro

   Computational endophenotypes in addiction (Fiore et al 2018)

References and models cited by this paper

References and models that cite this paper

Adams RA, Huys QJ, Roiser JP (2016) Computational Psychiatry: towards a mathematically informed understanding of mental illness. J Neurol Neurosurg Psychiatry 87:53-63 [Journal] [PubMed]
Afraimovich V, Tristan I, Huerta R, Rabinovich MI (2008) Winnerless competition principle and prediction of the transient dynamics in a Lotka-Volterra model. Chaos 18:043103 [Journal] [PubMed]
Baldassarre G, Mannella F, Fiore VG, Redgrave P, Gurney K, Mirolli M (2013) Intrinsically motivated action-outcome learning and goal-based action recall: a system-level bio-constrained computational model. Neural Netw 41:168-87 [Journal] [PubMed]
Balleine BW (2005) Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav 86:717-30 [Journal] [PubMed]
Balleine BW, O'Doherty JP (2010) Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology 35:48-69 [Journal] [PubMed]
Belcher AM, Volkow ND, Moeller FG, Ferré S (2014) Personality traits and vulnerability or resilience to substance use disorders. Trends Cogn Sci 18:211-7 [Journal] [PubMed]
Belin D, Belin-Rauscent A, Everitt BJ, Dalley JW (2016) In search of predictive endophenotypes in addiction: insights from preclinical research. Genes Brain Behav 15:74-88 [Journal] [PubMed]
Belin D, Berson N, Balado E, Piazza PV, Deroche-Gamonet V (2011) High-novelty-preference rats are predisposed to compulsive cocaine self-administration. Neuropsychopharmacology 36:569-79 [Journal] [PubMed]
Belin D, Deroche-Gamonet V (2012) Responses to novelty and vulnerability to cocaine addiction: contribution of a multi-symptomatic animal model. Cold Spring Harb Perspect Med [Journal] [PubMed]
Belin D, Everitt BJ (2008) Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum. Neuron 57:432-41 [Journal] [PubMed]
Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320:1352-5 [Journal] [PubMed]
Bellman R (1966) Dynamic programming. Science 153:34-7 [Journal] [PubMed]
Carroll ME, Morgan AD, Lynch WJ, Campbell UC, Dess NK (2002) Intravenous cocaine and heroin self-administration in rats selectively bred for differential saccharin intake: phenotype and sex differences. Psychopharmacology (Berl) 161:304-13 [Journal] [PubMed]
Cohen MX, Frank MJ (2009) Neurocomputational models of basal ganglia function in learning, memory and choice. Behav Brain Res 199:141-56 [Journal] [PubMed]
Covington HE, Miczek KA (2005) Intense cocaine self-administration after episodic social defeat stress, but not after aggressive behavior: dissociation from corticosterone activation. Psychopharmacology (Berl) 183:331-40 [Journal] [PubMed]
Dalley JW, Everitt BJ, Robbins TW (2011) Impulsivity, compulsivity, and top-down cognitive control. Neuron 69:680-94 [Journal] [PubMed]
Daw ND, Dayan P (2014) The algorithmic anatomy of model-based evaluation. Philos Trans R Soc Lond B Biol Sci [Journal] [PubMed]
Daw ND, Gershman SJ, Seymour B, Dayan P, Dolan RJ (2011) Model-based influences on humans' choices and striatal prediction errors. Neuron 69:1204-15 [Journal] [PubMed]
Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8:1704-11 [Journal] [PubMed]
Dayan P (2009) Dopamine, reinforcement learning, and addiction. Pharmacopsychiatry 42 Suppl 1:S56-65 [Journal] [PubMed]
Deco G, Jirsa VK, Robinson PA, Breakspear M, Friston K (2008) The dynamic brain: from spiking neurons to neural masses and cortical fields. PLoS Comput Biol 4:e1000092 [Journal] [PubMed]
desJardins ME, Durfee EH, Ortiz CL, Wolverton MJ (1999) A survey of research in distributed, continual planning AI Magazine 20:13-22
Dilleen R, Pelloux Y, Mar AC, Molander A, Robbins TW, Everitt BJ, Dalley JW, Belin D (2012) High anxiety is a predisposing endophenotype for loss of control over cocaine, but not heroin, self-administration in rats. Psychopharmacology (Berl) 222:89-97 [Journal] [PubMed]
Dolan RJ, Dayan P (2013) Goals and habits in the brain. Neuron 80:312-25 [Journal] [PubMed]
Doll BB, Daw ND (2016) The expanding role of dopamine. Elife 5:e15963 [Journal] [PubMed]
Doll BB, Jacobs WJ, Sanfey AG, Frank MJ (2009) Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res 1299:74-94 [Journal] [PubMed]
Draganski B, Kherif F, Klöppel S, Cook PA, Alexander DC, Parker GJ, Deichmann R, Ashburner J, Frackowiak RS (2008) Evidence for segregated and integrative connectivity patterns in the human Basal Ganglia. J Neurosci 28:7143-52 [Journal] [PubMed]
Economidou D, Pelloux Y, Robbins TW, Dalley JW, Everitt BJ (2009) High impulsivity predicts relapse to cocaine-seeking after punishment-induced abstinence. Biol Psychiatry 65:851-6 [Journal] [PubMed]
Ersche KD, Turton AJ, Pradhan S, Bullmore ET, Robbins TW (2010) Drug addiction endophenotypes: impulsive versus sensation-seeking personality traits. Biol Psychiatry 68:770-3 [Journal] [PubMed]
Everitt BJ, Robbins TW (2013) From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neurosci Biobehav Rev 37:1946-54 [Journal] [PubMed]
Everitt BJ, Robbins TW (2016) Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On. Annu Rev Psychol 67:23-50 [Journal] [PubMed]
Fiore VG, Dolan RJ, Strausfeld NJ, Hirth F (2015) Evolutionarily conserved mechanisms for the selection and maintenance of behavioural activity. Philos Trans R Soc Lond B Biol Sci [Journal] [PubMed]
Fiore VG, Nolte T, Rigoli F, Smittenaar P, Gu X, Dolan RJ (2018) Value encoding in the globus pallidus: fMRI reveals an interaction effect between reward and dopamine drive. Neuroimage 173:249-257 [Journal] [PubMed]
Fiore VG, Rigoli F, Stenner MP, Zaehle T, Hirth F, Heinze HJ, Dolan RJ (2016) Changing pattern in the basal ganglia: motor switching under reduced dopaminergic drive. Sci Rep 6:23327 [Journal] [PubMed]
Fiore VG,Sperati V,Mannella F,Mirolli M,Gurney K,Friston K,Dolan RJ;Baldassarre G (2014) Keep focussing: striatal dopamine multiple functions resolved in a single mechanism tested in a simulated humanoid robot Front Psychol 5:124
Flagel SB, Robinson TE, Clark JJ, Clinton SM, Watson SJ, Seeman P, Phillips PE, Akil H (2010) An animal model of genetic vulnerability to behavioral disinhibition and responsiveness to reward-related cues: implications for addiction. Neuropsychopharmacology 35:388-400 [Journal] [PubMed]
Flagel SB, Waselus M, Clinton SM, Watson SJ, Akil H (2014) Antecedents and consequences of drug abuse in rats selectively bred for high and low response to novelty. Neuropharmacology 76 Pt B:425-36 [Journal] [PubMed]
Friston KJ, Harrison L, Penny W (2003) Dynamic causal modelling. Neuroimage 19:1273-302 [PubMed]
Gannon BM, Galindo KI, Rice KC, Collins GT (2017) Individual Differences in the Relative Reinforcing Effects of 3,4-Methylenedioxypyrovalerone under Fixed and Progressive Ratio Schedules of Reinforcement in Rats. J Pharmacol Exp Ther 361:181-189 [Journal] [PubMed]
Garrison KA, Potenza MN (2014) Neuroimaging and biomarkers in addiction treatment. Curr Psychiatry Rep 16:513 [Journal] [PubMed]
Gerfen CR, Surmeier DJ (2011) Modulation of striatal projection systems by dopamine. Annu Rev Neurosci 34:441-66 [Journal] [PubMed]
Gershman SJ, Horvitz EJ, Tenenbaum JB (2015) Computational rationality: A converging paradigm for intelligence in brains, minds, and machines. Science 349:273-8 [Journal] [PubMed]
Gillan CM, Kosinski M, Whelan R, Phelps EA, Daw ND (2016) Characterizing a psychiatric symptom dimension related to deficits in goal-directed control. Elife [Journal] [PubMed]
Gould RW, Duke AN, Nader MA (2014) PET studies in nonhuman primate models of cocaine abuse: translational research related to vulnerability and neuroadaptations. Neuropharmacology 84:138-51 [Journal] [PubMed]
Grahn JA, Parkinson JA, Owen AM (2009) The role of the basal ganglia in learning and memory: neuropsychological studies. Behav Brain Res 199:53-60 [Journal] [PubMed]
Gruber AJ, McDonald RJ (2012) Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behavior. Front Behav Neurosci 6:50 [Journal] [PubMed]
Gutkin BS, Dehaene S, Changeux JP (2006) A neurocomputational hypothesis for nicotine addiction. Proc Natl Acad Sci U S A 103:1106-11 [Journal] [PubMed]
Haber S (2008) Parallel and integrative processing through the Basal Ganglia reward circuit: lessons from addiction. Biol Psychiatry 64:173-4 [Journal] [PubMed]
Haber SN (2003) The primate basal ganglia: parallel and integrative networks. J Chem Neuroanat 26:317-30 [PubMed]
Hauser TU, Fiore VG, Moutoussis M, Dolan RJ (2016) Computational Psychiatry of ADHD: Neural Gain Impairments across Marrian Levels of Analysis. Trends Neurosci 39:63-73 [Journal] [PubMed]
Hoffman RE, McGlashan TH (2001) Neural network models of schizophrenia. Neuroscientist 7:441-54 [Journal] [PubMed]
Huys QJ, Maia TV, Frank MJ (2016) Computational psychiatry as a bridge from neuroscience to clinical applications. Nat Neurosci 19:404-13 [Journal] [PubMed]
Hyman SE, Malenka RC, Nestler EJ (2006) Neural mechanisms of addiction: the role of reward-related learning and memory. Annu Rev Neurosci 29:565-98 [Journal] [PubMed]
Jahanshahi M, Obeso I, Rothwell JC, Obeso JA (2015) A fronto-striato-subthalamic-pallidal network for goal-directed and habitual inhibition. Nat Rev Neurosci 16:719-32 [Journal] [PubMed]
Jimenez VA, Grant KA (2017) Studies using macaque monkeys to address excessive alcohol drinking and stress interactions. Neuropharmacology 122:127-135 [Journal] [PubMed]
Jonkman S, Pelloux Y, Everitt BJ (2012) Drug intake is sufficient, but conditioning is not necessary for the emergence of compulsive cocaine seeking after extended self-administration. Neuropsychopharmacology 37:1612-9 [Journal] [PubMed]
Jupp B, Dalley JW (2014) Behavioral endophenotypes of drug addiction: Etiological insights from neuroimaging studies. Neuropharmacology 76 Pt B:487-97 [Journal] [PubMed]
Keramati M, Dezfouli A, Piray P (2011) Speed/accuracy trade-off between the habitual and the goal-directed processes. PLoS Comput Biol 7:e1002055 [Journal] [PubMed]
   Speed/accuracy trade-off between the habitual and the goal-directed processes (Kermati et al. 2011) [Model]
Koob GF, Volkow ND (2016) Neurobiology of addiction: a neurocircuitry analysis. Lancet Psychiatry 3:760-73 [Journal] [PubMed]
Laurent PA (2008) The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural Netw 21:1493-9 [Journal] [PubMed]
Maia TV, Frank MJ (2011) From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci 14:154-62 [Journal] [PubMed]
Marr D,Poggio T (1976) From understanding computation to understanding neural circuitry AI Memo 357:1-22
McClintick MN, Grant KA (2016) Aggressive temperament predicts ethanol self-administration in late adolescent male and female rhesus macaques. Psychopharmacology (Berl) 233:3965-3976 [Journal] [PubMed]
Molander AC, Mar A, Norbury A, Steventon S, Moreno M, Caprioli D, Theobald DE, Belin D, Everitt BJ, Robbins TW, Dalley JW (2011) High impulsivity predicting vulnerability to cocaine addiction in rats: some relationship with novelty preference but not novelty reactivity, anxiety or stress. Psychopharmacology (Berl) 215:721-31 [Journal] [PubMed]
Montague PR, Dolan RJ, Friston KJ, Dayan P (2012) Computational psychiatry. Trends Cogn Sci 16:72-80 [Journal] [PubMed]
Moore AW, Atkeson CG (1993) Prioritized sweeping: Reinforcement learning with less data and less real time Mach Learn 13:103-130
Morgan D, Grant KA, Gage HD, Mach RH, Kaplan JR, Prioleau O, Nader SH, Buchheimer N, Ehrenkaufer RL, Nader MA (2002) Social dominance in monkeys: dopamine D2 receptors and cocaine self-administration. Nat Neurosci 5:169-74 [Journal] [PubMed]
Nadal R, Armario A, Janak PH (2002) Positive relationship between activity in a novel environment and operant ethanol self-administration in rats. Psychopharmacology (Berl) 162:333-8 [Journal] [PubMed]
Nader MA, Czoty PW (2005) PET imaging of dopamine D2 receptors in monkey models of cocaine abuse: genetic predisposition versus environmental modulation. Am J Psychiatry 162:1473-82 [Journal] [PubMed]
Nestler EJ, Aghajanian GK (1997) Molecular and cellular basis of addiction. Science 278:58-63 [PubMed]
Obeso JA, Rodriguez-Oroz MC, Stamelou M, Bhatia KP, Burn DJ (2014) The expanding universe of disorders of the basal ganglia. Lancet 384:523-31 [Journal] [PubMed]
Pelloux Y, Everitt BJ, Dickinson A (2007) Compulsive drug seeking by rats under punishment: effects of drug taking history. Psychopharmacology (Berl) 194:127-37 [Journal] [PubMed]
Pelloux Y, Murray JE, Everitt BJ (2015) Differential vulnerability to the punishment of cocaine related behaviours: effects of locus of punishment, cocaine taking history and alternative reinforcer availability. Psychopharmacology (Berl) 232:125-34 [Journal] [PubMed]
Perry JL, Carroll ME (2008) The role of impulsive behavior in drug abuse. Psychopharmacology (Berl) 200:1-26 [Journal] [PubMed]
Pezzulo G, Rigoli F, Chersi F (2013) The mixed instrumental controller: using value of information to combine habitual choice and mental simulation. Front Psychol 4:92 [Journal] [PubMed]
Piazza PV, Deminière JM, Le Moal M, Simon H (1989) Factors that predict individual vulnerability to amphetamine self-administration. Science 245:1511-3 [PubMed]
Piray P, Keramati MM, Dezfouli A, Lucas C, Mokri A (2010) Individual differences in nucleus accumbens dopamine receptors predict development of addiction-like behavior: a computational approach. Neural Comput 22:2334-68 [Journal] [PubMed]
Redish AD (2004) Addiction as a computational process gone awry. Science 306:1944-7 [Journal] [PubMed]
Redish AD, Jensen S, Johnson A (2008) A unified framework for addiction: vulnerabilities in the decision process. Behav Brain Sci 31:415-37; discussion 437-87 [Journal] [PubMed]
Sadacca BF, Jones JL, Schoenbaum G (2016) Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework. Elife [Journal] [PubMed]
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]
Selverston AI, Rabinovich MI, Abarbanel HD, Elson R, Szücs A, Pinto RD, Huerta R, Varona P (2000) Reliable circuits from irregular neurons: a dynamical approach to understanding central pattern generators. J Physiol Paris 94:357-74 [PubMed]
Simon DA,Daw ND (2012) Dual-system learning models and drugs of abuse Computational Neuroscience of Drug Addiction, Gutkin B:Ahmed SH, ed. pp.145
Singh S,Jaakkola T,Littman ML,Szepesvári C (2000) Convergence Results for Single-Step On-Policy Reinforcement-Learning Algorithms Machine Learning 38:287-308
Smethells JR, Zlebnik NE, Miller DK, Will MJ, Booth F, Carroll ME (2016) Cocaine self-administration and reinstatement in female rats selectively bred for high and low voluntary running. Drug Alcohol Depend 167:163-8 [Journal] [PubMed]
Suto N, Austin JD, Vezina P (2001) Locomotor response to novelty predicts a rat's propensity to self-administer nicotine. Psychopharmacology (Berl) 158:175-80 [Journal] [PubMed]
Sutton RS (1990) Integrated architectures for learning, planning, and reacting based on approximating dynamic programming Proceedings of the Seventh International Conference on Machine Learning :216-224
Verdejo-García A, Lawrence AJ, Clark L (2008) Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci Biobehav Rev 32:777-810 [Journal] [PubMed]
Volkow ND, Fowler JS, Wang GJ, Swanson JM, Telang F (2007) Dopamine in drug abuse and addiction: results of imaging studies and treatment implications. Arch Neurol 64:1575-9 [Journal] [PubMed]
Volkow ND, Morales M (2015) The Brain on Drugs: From Reward to Addiction. Cell 162:712-25 [Journal] [PubMed]
Voon V, Reiter A, Sebold M, Groman S (2017) Model-Based Control in Dimensional Psychiatry. Biol Psychiatry 82:391-400 [Journal] [PubMed]
Watkins C, Dayan P (1992) Q-learning Mach Learn 8:279-292
Willuhn I, Burgeno LM, Everitt BJ, Phillips PE (2012) Hierarchical recruitment of phasic dopamine signaling in the striatum during the progression of cocaine use. Proc Natl Acad Sci U S A 109:20703-8 [Journal] [PubMed]
Yin HH, Knowlton BJ, Balleine BW (2004) Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci 19:181-9 [PubMed]
(96 refs)