Citation Relationships



Zannone S, Brzosko Z, Paulsen O, Clopath C (2018) Acetylcholine-modulated plasticity in reward-driven navigation: a computational study. Sci Rep 8:9486 [PubMed]

   Acetylcholine-modulated plasticity in reward-driven navigation (Zannone et al 2018)

References and models cited by this paper

References and models that cite this paper

Acquas E, Wilson C, Fibiger HC (1996) Conditioned and unconditioned stimuli increase frontal cortical and hippocampal acetylcholine release: effects of novelty, habituation, and fear. J Neurosci 16:3089-96 [PubMed]

Adams SV, Winterer J, Müller W (2004) Muscarinic signaling is required for spike-pairing induction of long-term potentiation at rat Schaffer collateral-CA1 synapses. Hippocampus 14:413-6 [Journal] [PubMed]

Atherton LA, Dupret D, Mellor JR (2015) Memory trace replay: the shaping of memory consolidation by neuromodulation. Trends Neurosci 38:560-70 [Journal] [PubMed]

Bi GQ, Poo MM (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18:10464-72 [PubMed]

Boddeke EW, Enz A, Shapiro G (1992) SDZ ENS 163, a selective muscarinic M1 receptor agonist, facilitates the induction of long-term potentiation in rat hippocampal slices. Eur J Pharmacol 222:21-5 [PubMed]

Brzosko Z, Schultz W, Paulsen O (2015) Retroactive modulation of spike timing-dependent plasticity by dopamine. Elife [Journal] [PubMed]

Brzosko Z, Zannone S, Schultz W, Clopath C, Paulsen O (2017) Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. Elife [Journal] [PubMed]

   Sequential neuromodulation of Hebbian plasticity in reward-based navigation (Brzosko et al 2017) [Model]

Buchanan KA, Petrovic MM, Chamberlain SE, Marrion NV, Mellor JR (2010) Facilitation of long-term potentiation by muscarinic M(1) receptors is mediated by inhibition of SK channels. Neuron 68:948-63 [Journal] [PubMed]

Ceccarelli I, Casamenti F, Massafra C, Pepeu G, Scali C, Aloisi AM (1999) Effects of novelty and pain on behavior and hippocampal extracellular ACh levels in male and female rats. Brain Res 815:169-76 [PubMed]

Connor SA, Maity S, Roy B, Ali DW, Nguyen PV (2012) Conversion of short-term potentiation to long-term potentiation in mouse CA1 by coactivation of ß-adrenergic and muscarinic receptors. Learn Mem 19:535-42 [Journal] [PubMed]

Dayan P (2012) Twenty-five lessons from computational neuromodulation. Neuron 76:240-56 [Journal] [PubMed]

de Lavilléon G, Lacroix MM, Rondi-Reig L, Benchenane K (2015) Explicit memory creation during sleep demonstrates a causal role of place cells in navigation. Nat Neurosci 18:493-5 [Journal] [PubMed]

Deiana S, Platt B, Riedel G (2011) The cholinergic system and spatial learning. Behav Brain Res 221:389-411 [Journal] [PubMed]

Dennis SH, Pasqui F, Colvin EM, Sanger H, Mogg AJ, Felder CC, Broad LM, Fitzjohn SM, Isaac JT, Mellor JR (2016) Activation of Muscarinic M1 Acetylcholine Receptors Induces Long-Term Potentiation in the Hippocampus. Cereb Cortex 26:414-26 [Journal] [PubMed]

Dickinson BA, Jo J, Seok H, Son GH, Whitcomb DJ, Davies CH, Sheng M, Collingridge GL, Cho K (2009) A novel mechanism of hippocampal LTD involving muscarinic receptor-triggered interactions between AMPARs, GRIP and liprin-alpha. Mol Brain 2:18 [Journal] [PubMed]

Digby GJ, Noetzel MJ, Bubser M, Utley TJ, Walker AG, Byun NE, Lebois EP, Xiang Z, Sheffler DJ, Cho HP, Davis AA, Nemirovsky NE, Mennenga SE, Camp BW, Bimonte-Nelson HA, Bode J, Italiano K, Morrison R, Daniels JS, Niswender CM, Olive MF, Lindsley CW, Jones CK, Conn PJ (2012) Novel allosteric agonists of M1 muscarinic acetylcholine receptors induce brain region-specific responses that correspond with behavioral effects in animal models. J Neurosci 32:8532-44 [Journal] [PubMed]

Dong Z, Bai Y, Wu X, Li H, Gong B, Howland JG, Huang Y, He W, Li T, Wang YT (2013) Hippocampal long-term depression mediates spatial reversal learning in the Morris water maze. Neuropharmacology 64:65-73 [Journal] [PubMed]

Doya K (2002) Metalearning and neuromodulation. Neural Netw 15:495-506 [PubMed]

Easton A, Douchamps V, Eacott M, Lever C (2012) A specific role for septohippocampal acetylcholine in memory? Neuropsychologia 50:3156-68 [Journal] [PubMed]

Edelmann E, Lessmann V, Brigadski T (2014) Pre- and postsynaptic twists in BDNF secretion and action in synaptic plasticity. Neuropharmacology 76 Pt C:610-27 [Journal] [PubMed]

Fadda F, Cocco S, Stancampiano R (2000) Hippocampal acetylcholine release correlates with spatial learning performance in freely moving rats. Neuroreport 11:2265-9 [PubMed]

Flicker C, Geyer MA (1982) Behavior during hippocampal microinfusions. II. Muscarinic locomotor activation. Brain Res 257:105-27 [PubMed]

Florian RV (2007) Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput 19:1468-502 [Journal] [PubMed]

Foster DJ, Morris RG, Dayan P (2000) A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10:1-16 [Journal] [PubMed]

Frémaux N, Sprekeler H, Gerstner W (2010) Functional requirements for reward-modulated spike-timing-dependent plasticity. J Neurosci 30:13326-37 [Journal] [PubMed]

Frémaux N, Sprekeler H, Gerstner W (2013) Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS Comput Biol 9:e1003024 [Journal] [PubMed]

Gerstner W, Kistler WM (2002) Spiking neuron models

Giovannini MG, Rakovska A, Benton RS, Pazzagli M, Bianchi L, Pepeu G (2001) Effects of novelty and habituation on acetylcholine, GABA, and glutamate release from the frontal cortex and hippocampus of freely moving rats. Neuroscience 106:43-53 [PubMed]

Golkar A, Bellander M, Öhman A (2013) Temporal properties of fear extinction--does time matter? Behav Neurosci 127:59-69 [Journal] [PubMed]

Hasselmo ME (1999) Neuromodulation: acetylcholine and memory consolidation. Trends Cogn Sci 3:351-359 [PubMed]

Hasselmo ME (2006) The role of acetylcholine in learning and memory. Curr Opin Neurobiol 16:710-5 [Journal] [PubMed]

Huerta PT, Lisman JE (1995) Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron 15:1053-63 [PubMed]

Ihalainen JA, Riekkinen P, Feenstra MG (1999) Comparison of dopamine and noradrenaline release in mouse prefrontal cortex, striatum and hippocampus using microdialysis. Neurosci Lett 277:71-4 [PubMed]

Inglis FM, Day JC, Fibiger HC (1994) Enhanced acetylcholine release in hippocampus and cortex during the anticipation and consumption of a palatable meal. Neuroscience 62:1049-56 [PubMed]

Inglis FM, Fibiger HC (1995) Increases in hippocampal and frontal cortical acetylcholine release associated with presentation of sensory stimuli. Neuroscience 66:81-6 [PubMed]

Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17:2443-52 [Journal] [PubMed]

   Linking STDP and Dopamine action to solve the distal reward problem (Izhikevich 2007) [Model]

Jo J, Son GH, Winters BL, Kim MJ, Whitcomb DJ, Dickinson BA, Lee YB, Futai K, Amici M, Sheng M, Collingridge GL, Cho K (2010) Muscarinic receptors induce LTD of NMDAR EPSCs via a mechanism involving hippocalcin, AP2 and PSD-95. Nat Neurosci 13:1216-24 [Journal] [PubMed]

Jost J (2006) Temporal correlation based learning in neuron models. Theory Biosci 125:37-53 [Journal] [PubMed]

Kametani H, Kawamura H (1990) Alterations in acetylcholine release in the rat hippocampus during sleep-wakefulness detected by intracerebral dialysis. Life Sci 47:421-6 [PubMed]

Kamsler A, McHugh TJ, Gerber D, Huang SY, Tonegawa S (2010) Presynaptic m1 muscarinic receptors are necessary for mGluR long-term depression in the hippocampus. Proc Natl Acad Sci U S A 107:1618-23 [Journal] [PubMed]

Laurent PA (2008) The emergence of saliency and novelty responses from Reinforcement Learning principles. Neural Netw 21:1493-9 [Journal] [PubMed]

Legenstein R, Pecevski D, Maass W (2008) A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS Comput Biol 4:e1000180 [Journal] [PubMed]

   Reward modulated STDP (Legenstein et al. 2008) [Model]

Li S, Cullen WK, Anwyl R, Rowan MJ (2003) Dopamine-dependent facilitation of LTP induction in hippocampal CA1 by exposure to spatial novelty. Nat Neurosci 6:526-31 [Journal] [PubMed]

Lisman J (1989) A mechanism for the Hebb and the anti-Hebb processes underlying learning and memory. Proc Natl Acad Sci U S A 86:9574-8 [PubMed]

Lisman JE, Grace AA (2005) The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46:703-13 [Journal] [PubMed]

Markram H, Lübke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275:213-5 [PubMed]

Marrosu F, Portas C, Mascia MS, Casu MA, Fà M, Giagheddu M, Imperato A, Gessa GL (1995) Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats. Brain Res 671:329-32 [PubMed]

McCool MF, Patel S, Talati R, Ragozzino ME (2008) Differential involvement of M1-type and M4-type muscarinic cholinergic receptors in the dorsomedial striatum in task switching. Neurobiol Learn Mem 89:114-24 [Journal] [PubMed]

McNamara CG, Tejero-Cantero Á, Trouche S, Campo-Urriza N, Dupret D (2014) Dopaminergic neurons promote hippocampal reactivation and spatial memory persistence. Nat Neurosci 17:1658-60 [Journal] [PubMed]

Montague PR, Dayan P, Sejnowski TJ (1996) A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci 16:1936-47 [PubMed]

Ovsepian SV, Anwyl R, Rowan MJ (2004) Endogenous acetylcholine lowers the threshold for long-term potentiation induction in the CA1 area through muscarinic receptor activation: in vivo study. Eur J Neurosci 20:1267-75 [Journal] [PubMed]

Pan WX, Schmidt R, Wickens JR, Hyland BI (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25:6235-42 [Journal] [PubMed]

Pavlov PI (2010) Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. Ann Neurosci 17:136-41 [Journal] [PubMed]

Pepeu G, Giovannini MG (2004) Changes in acetylcholine extracellular levels during cognitive processes. Learn Mem 11:21-7 [Journal] [PubMed]

Picciotto MR, Higley MJ, Mineur YS (2012) Acetylcholine as a neuromodulator: cholinergic signaling shapes nervous system function and behavior. Neuron 76:116-29 [Journal] [PubMed]

Ragozzino ME, Jih J, Tzavos A (2002) Involvement of the dorsomedial striatum in behavioral flexibility: role of muscarinic cholinergic receptors. Brain Res 953:205-14 [PubMed]

Ragozzino ME, Pal SN, Unick K, Stefani MR, Gold PE (1998) Modulation of hippocampal acetylcholine release and spontaneous alternation scores by intrahippocampal glucose injections. J Neurosci 18:1595-601 [PubMed]

Ragozzino ME, Unick KE, Gold PE (1996) Hippocampal acetylcholine release during memory testing in rats: augmentation by glucose. Proc Natl Acad Sci U S A 93:4693-8 [PubMed]

Scheiderer CL, McCutchen E, Thacker EE, Kolasa K, Ward MK, Parsons D, Harrell LE, Dobrunz LE, McMahon LL (2006) Sympathetic sprouting drives hippocampal cholinergic reinnervation that prevents loss of a muscarinic receptor-dependent long-term depression at CA3-CA1 synapses. J Neurosci 26:3745-56 [Journal] [PubMed]

Schultz W (1997) Dopamine neurons and their role in reward mechanisms. Curr Opin Neurobiol 7:191-7 [PubMed]

Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]

Shinoe T, Matsui M, Taketo MM, Manabe T (2005) Modulation of synaptic plasticity by physiological activation of M1 muscarinic acetylcholine receptors in the mouse hippocampus. J Neurosci 25:11194-200 [Journal] [PubMed]

Stancampiano R, Cocco S, Cugusi C, Sarais L, Fadda F (1999) Serotonin and acetylcholine release response in the rat hippocampus during a spatial memory task. Neuroscience 89:1135-43 [PubMed]

Sugisaki E, Fukushima Y, Fujii S, Yamazaki Y, Aihara T (2016) The effect of coactivation of muscarinic and nicotinic acetylcholine receptors on LTD in the hippocampal CA1 network. Brain Res 1649:44-52 [Journal] [PubMed]

Sugisaki E, Fukushima Y, Tsukada M, Aihara T (2011) Cholinergic modulation on spike timing-dependent plasticity in hippocampal CA1 network. Neuroscience 192:91-101 [Journal] [PubMed]

Suri RE, Schultz W (1999) A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91:871-90 [PubMed]

Teles-Grilo Ruivo LM, Mellor JR (2013) Cholinergic modulation of hippocampal network function. Front Synaptic Neurosci 5:2 [Journal] [PubMed]

Thiel CM, Huston JP, Schwarting RK (1998) Hippocampal acetylcholine and habituation learning. Neuroscience 85:1253-62 [PubMed]

Thorndike E (1911) Animal intelligence

Tran AH, Uwano T, Kimura T, Hori E, Katsuki M, Nishijo H, Ono T (2008) Dopamine D1 receptor modulates hippocampal representation plasticity to spatial novelty. J Neurosci 28:13390-400 [Journal] [PubMed]

Tzavos A, Jih J, Ragozzino ME (2004) Differential effects of M1 muscarinic receptor blockade and nicotinic receptor blockade in the dorsomedial striatum on response reversal learning. Behav Brain Res 154:245-53 [Journal] [PubMed]

Vasilaki E, Frémaux N, Urbanczik R, Senn W, Gerstner W (2009) Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comput Biol 5:e1000586 [Journal] [PubMed]

Volk LJ, Pfeiffer BE, Gibson JR, Huber KM (2007) Multiple Gq-coupled receptors converge on a common protein synthesis-dependent long-term depression that is affected in fragile X syndrome mental retardation. J Neurosci 27:11624-34 [Journal] [PubMed]

Yang K, Dani JA (2014) Dopamine D1 and D5 receptors modulate spike timing-dependent plasticity at medial perforant path to dentate granule cell synapses. J Neurosci 34:15888-97 [Journal] [PubMed]

Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-92 [Journal] [PubMed]

Zhang JC, Lau PM, Bi GQ (2009) Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc Natl Acad Sci U S A 106:13028-33 [Journal] [PubMed]

(76 refs)