Citation Relationships

Legends: Link to a Model Reference cited by multiple papers


Brzosko Z, Zannone S, Schultz W, Clopath C, Paulsen O (2017) Sequential neuromodulation of Hebbian plasticity offers mechanism for effective reward-based navigation. Elife [PubMed]

   Sequential neuromodulation of Hebbian plasticity in reward-based navigation (Brzosko et al 2017)

References and models cited by this paper

References and models that cite this paper

Adams SV, Winterer J, Müller W (2004) Muscarinic signaling is required for spike-pairing induction of long-term potentiation at rat Schaffer collateral-CA1 synapses. Hippocampus 14:413-6 [Journal] [PubMed]
Andrade-Talavera Y, Duque-Feria P, Paulsen O, Rodríguez-Moreno A (2016) Presynaptic Spike Timing-Dependent Long-Term Depression in the Mouse Hippocampus. Cereb Cortex 26:3637-3654 [Journal] [PubMed]
Auerbach JM, Segal M (1996) Muscarinic receptors mediating depression and long-term potentiation in rat hippocampus. J Physiol 492 ( Pt 2):479-93 [PubMed]
Bi GQ, Poo MM (1998) Synaptic modifications in cultured hippocampal neurons: dependence on spike timing, synaptic strength, and postsynaptic cell type. J Neurosci 18:10464-72 [PubMed]
Bliss TV, Collingridge GL (1993) A synaptic model of memory: long-term potentiation in the hippocampus. Nature 361:31-9 [Journal] [PubMed]
Bliss TV, Lomo T (1973) Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path. J Physiol 232:331-56 [PubMed]
Boddeke EW, Enz A, Shapiro G (1992) SDZ ENS 163, a selective muscarinic M1 receptor agonist, facilitates the induction of long-term potentiation in rat hippocampal slices. Eur J Pharmacol 222:21-5 [PubMed]
Brzosko Z, Schultz W, Paulsen O (2015) Retroactive modulation of spike timing-dependent plasticity by dopamine. Elife [Journal] [PubMed]
Buchanan KA, Petrovic MM, Chamberlain SE, Marrion NV, Mellor JR (2010) Facilitation of long-term potentiation by muscarinic M(1) receptors is mediated by inhibition of SK channels. Neuron 68:948-63 [Journal] [PubMed]
Charnov EL (1976) Optimal foraging, the marginal value theorem. Theor Popul Biol 9:129-36 [PubMed]
Clopath C, Büsing L, Vasilaki E, Gerstner W (2010) Connectivity reflects coding: a model of voltage-based STDP with homeostasis. Nat Neurosci 13:344-52 [Journal] [PubMed]
   Voltage-based STDP synapse (Clopath et al. 2010) [Model]
Connor SA, Maity S, Roy B, Ali DW, Nguyen PV (2012) Conversion of short-term potentiation to long-term potentiation in mouse CA1 by coactivation of ß-adrenergic and muscarinic receptors. Learn Mem 19:535-42 [Journal] [PubMed]
Debanne D, Gähwiler BH, Thompson SM (1998) Long-term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures. J Physiol 507 ( Pt 1):237-47 [PubMed]
Dennis SH, Pasqui F, Colvin EM, Sanger H, Mogg AJ, Felder CC, Broad LM, Fitzjohn SM, Isaac JT, Mellor JR (2016) Activation of Muscarinic M1 Acetylcholine Receptors Induces Long-Term Potentiation in the Hippocampus. Cereb Cortex 26:414-26 [Journal] [PubMed]
Dickinson BA, Jo J, Seok H, Son GH, Whitcomb DJ, Davies CH, Sheng M, Collingridge GL, Cho K (2009) A novel mechanism of hippocampal LTD involving muscarinic receptor-triggered interactions between AMPARs, GRIP and liprin-alpha. Mol Brain 2:18 [Journal] [PubMed]
Doya K (2002) Metalearning and neuromodulation. Neural Netw 15:495-506 [PubMed]
Edelmann E, Lessmann V (2011) Dopamine Modulates Spike Timing-Dependent Plasticity and Action Potential Properties in CA1 Pyramidal Neurons of Acute Rat Hippocampal Slices. Front Synaptic Neurosci 3:6 [Journal] [PubMed]
Ekstrom AD, Kahana MJ, Caplan JB, Fields TA, Isham EA, Newman EL, Fried I (2003) Cellular networks underlying human spatial navigation. Nature 425:184-8 [Journal] [PubMed]
Florian RV (2007) Reinforcement learning through modulation of spike-timing-dependent synaptic plasticity. Neural Comput 19:1468-502 [Journal] [PubMed]
Foster DJ, Morris RG, Dayan P (2000) A model of hippocampally dependent navigation, using the temporal difference learning rule. Hippocampus 10:1-16 [Journal] [PubMed]
Frémaux N, Sprekeler H, Gerstner W (2010) Functional requirements for reward-modulated spike-timing-dependent plasticity. J Neurosci 30:13326-37 [Journal] [PubMed]
Frémaux N, Sprekeler H, Gerstner W (2013) Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS Comput Biol 9:e1003024 [Journal] [PubMed]
Gerstner W (1995) Time structure of the activity in neural network models. Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Topics 51:738-758 [PubMed]
Gerstner W, Kempter R, van Hemmen JL, Wagner H (1996) A neuronal learning rule for sub-millisecond temporal coding. Nature 383:76-81 [Journal] [PubMed]
Gerstner W,Kistler W,Naud R,Paninski L (2014) Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition, 1st ed.
Hasselmo ME (1999) Neuromodulation: acetylcholine and memory consolidation. Trends Cogn Sci 3:351-359 [PubMed]
Hertz J, Krogh A, Palmer RG (1991) Introduction to the Theory of Neural Computation.
Huerta PT, Lisman JE (1995) Bidirectional synaptic plasticity induced by a single burst during cholinergic theta oscillation in CA1 in vitro. Neuron 15:1053-63 [PubMed]
Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17:2443-52 [Journal] [PubMed]
   Linking STDP and Dopamine action to solve the distal reward problem (Izhikevich 2007) [Model]
Jo J, Son GH, Winters BL, Kim MJ, Whitcomb DJ, Dickinson BA, Lee YB, Futai K, Amici M, Sheng M, Collingridge GL, Cho K (2010) Muscarinic receptors induce LTD of NMDAR EPSCs via a mechanism involving hippocalcin, AP2 and PSD-95. Nat Neurosci 13:1216-24 [Journal] [PubMed]
Kametani H, Kawamura H (1990) Alterations in acetylcholine release in the rat hippocampus during sleep-wakefulness detected by intracerebral dialysis. Life Sci 47:421-6 [PubMed]
Kamsler A, McHugh TJ, Gerber D, Huang SY, Tonegawa S (2010) Presynaptic m1 muscarinic receptors are necessary for mGluR long-term depression in the hippocampus. Proc Natl Acad Sci U S A 107:1618-23 [Journal] [PubMed]
Kwag J, Paulsen O (2009) The timing of external input controls the sign of plasticity at local synapses. Nat Neurosci 12:1219-21 [Journal] [PubMed]
Legenstein R, Pecevski D, Maass W (2008) A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback. PLoS Comput Biol 4:e1000180 [Journal] [PubMed]
   Reward modulated STDP (Legenstein et al. 2008) [Model]
Levey AI, Edmunds SM, Koliatsos V, Wiley RG, Heilman CJ (1995) Expression of m1-m4 muscarinic acetylcholine receptor proteins in rat hippocampus and regulation by cholinergic innervation. J Neurosci 15:4077-92 [PubMed]
Markram H, Lübke J, Frotscher M, Sakmann B (1997) Regulation of synaptic efficacy by coincidence of postsynaptic APs and EPSPs. Science 275:213-5 [PubMed]
Marrosu F, Portas C, Mascia MS, Casu MA, Fà M, Giagheddu M, Imperato A, Gessa GL (1995) Microdialysis measurement of cortical and hippocampal acetylcholine release during sleep-wake cycle in freely moving cats. Brain Res 671:329-32 [PubMed]
Morris RG, Anderson E, Lynch GS, Baudry M (1986) Selective impairment of learning and blockade of long-term potentiation by an N-methyl-D-aspartate receptor antagonist, AP5. Nature 319:774-6 [Journal] [PubMed]
Morris RG, Garrud P, Rawlins JN, O'Keefe J (1982) Place navigation impaired in rats with hippocampal lesions. Nature 297:681-3 [PubMed]
Müller W, Misgeld U, Heinemann U (1988) Carbachol effects on hippocampal neurons in vitro: dependence on the rate of rise of carbachol tissue concentration. Exp Brain Res 72:287-98 [PubMed]
O'Keefe J, Dostrovsky J (1971) The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res 34:171-5 [PubMed]
O'Keefe J, Nadel L (1978) The Hippocampus as a Cognitive Map
Ovsepian SV, Anwyl R, Rowan MJ (2004) Endogenous acetylcholine lowers the threshold for long-term potentiation induction in the CA1 area through muscarinic receptor activation: in vivo study. Eur J Neurosci 20:1267-75 [Journal] [PubMed]
Pan WX, Schmidt R, Wickens JR, Hyland BI (2005) Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci 25:6235-42 [Journal] [PubMed]
Pawlak V, Wickens JR, Kirkwood A, Kerr JN (2010) Timing is not Everything: Neuromodulation Opens the STDP Gate. Front Synaptic Neurosci 2:146 [Journal] [PubMed]
Scheiderer CL, McCutchen E, Thacker EE, Kolasa K, Ward MK, Parsons D, Harrell LE, Dobrunz LE, McMahon LL (2006) Sympathetic sprouting drives hippocampal cholinergic reinnervation that prevents loss of a muscarinic receptor-dependent long-term depression at CA3-CA1 synapses. J Neurosci 26:3745-56 [Journal] [PubMed]
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275:1593-9 [PubMed]
Seol GH, Ziburkus J, Huang S, Song L, Kim IT, Takamiya K, Huganir RL, Lee HK, Kirkwood A (2007) Neuromodulators control the polarity of spike-timing-dependent synaptic plasticity. Neuron 55:919-29 [Journal] [PubMed]
Shinoe T, Matsui M, Taketo MM, Manabe T (2005) Modulation of synaptic plasticity by physiological activation of M1 muscarinic acetylcholine receptors in the mouse hippocampus. J Neurosci 25:11194-200 [Journal] [PubMed]
Song S, Miller KD, Abbott LF (2000) Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat Neurosci 3:919-26 [Journal] [PubMed]
Sugisaki E, Fukushima Y, Fujii S, Yamazaki Y, Aihara T (2016) The effect of coactivation of muscarinic and nicotinic acetylcholine receptors on LTD in the hippocampal CA1 network. Brain Res 1649:44-52 [Journal] [PubMed]
Sugisaki E, Fukushima Y, Tsukada M, Aihara T (2011) Cholinergic modulation on spike timing-dependent plasticity in hippocampal CA1 network. Neuroscience 192:91-101 [Journal] [PubMed]
Suri RE, Schultz W (1999) A neural network model with dopamine-like reinforcement signal that learns a spatial delayed response task. Neuroscience 91:871-90 [PubMed]
Sutton RS, Barto AG (1981) Toward a modern theory of adaptive networks: expectation and prediction. Psychol Rev 88:135-70 [PubMed]
Teles-Grilo Ruivo LM, Mellor JR (2013) Cholinergic modulation of hippocampal network function. Front Synaptic Neurosci 5:2 [Journal] [PubMed]
Thiel CM, Huston JP, Schwarting RK (1998) Hippocampal acetylcholine and habituation learning. Neuroscience 85:1253-62 [PubMed]
Tsien JZ, Huerta PT, Tonegawa S (1996) The essential role of hippocampal CA1 NMDA receptor-dependent synaptic plasticity in spatial memory. Cell 87:1327-38 [PubMed]
Vasilaki E, Frémaux N, Urbanczik R, Senn W, Gerstner W (2009) Spike-based reinforcement learning in continuous state and action space: when policy gradient methods fail. PLoS Comput Biol 5:e1000586 [Journal] [PubMed]
Volk LJ, Pfeiffer BE, Gibson JR, Huber KM (2007) Multiple Gq-coupled receptors converge on a common protein synthesis-dependent long-term depression that is affected in fragile X syndrome mental retardation. J Neurosci 27:11624-34 [Journal] [PubMed]
Yu AJ, Dayan P (2005) Uncertainty, neuromodulation, and attention. Neuron 46:681-92 [Journal] [PubMed]
Zhang JC, Lau PM, Bi GQ (2009) Gain in sensitivity and loss in temporal contrast of STDP by dopaminergic modulation at hippocampal synapses. Proc Natl Acad Sci U S A 106:13028-33 [Journal] [PubMed]
Zhao Y, Tzounopoulos T (2011) Physiological activation of cholinergic inputs controls associative synaptic plasticity via modulation of endocannabinoid signaling. J Neurosci 31:3158-68 [Journal] [PubMed]
Zannone S, Brzosko Z, Paulsen O, Clopath C (2018) Acetylcholine-modulated plasticity in reward-driven navigation: a computational study. Sci Rep 8:9486 [Journal] [PubMed]
   Acetylcholine-modulated plasticity in reward-driven navigation (Zannone et al 2018) [Model]
(66 refs)