Acetylcholine-modulated plasticity in reward-driven navigation (Zannone et al 2018)

 Download zip file 
Help downloading and running models
Accession:245018
"Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike- Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules."
Reference:
1 . Zannone S, Brzosko Z, Paulsen O, Clopath C (2018) Acetylcholine-modulated plasticity in reward-driven navigation: a computational study. Sci Rep 8:9486 [PubMed]
Model Information (Click on a link to find other models with that property)
Model Type: Realistic Network;
Brain Region(s)/Organism: Mouse;
Cell Type(s):
Channel(s):
Gap Junctions:
Receptor(s):
Gene(s):
Transmitter(s): Acetylcholine; Dopamine;
Simulation Environment: MATLAB;
Model Concept(s): Synaptic Plasticity; Learning; STDP; Reward-modulated STDP; Hebbian plasticity; Spatial Navigation;
Implementer(s): Zannone, Sara [s.zannone14 at imperial.ac.uk]; Clopath, Claudia [c.clopath at imperial.ac.uk];
Search NeuronDB for information about:  Acetylcholine; Dopamine; 
function [conv, conv1] = convolution_type2 (conv1, tau_m, eps0, X)
% exponential decay 
% input =       conv1= convolution, decay component 
%               tau_m = decay time constant
%               eps0= multiplying constant, scales the whole convolution  
%               X = spike train vector, if there is a spike the convolution jumps by 1
%output =       conv = total convolution (scaled by eps0)
%               conv1 = convolution, decay component (updated)

conv1 = conv1 + (-conv1)/tau_m + X;
conv = eps0.*(conv1);

end

Loading data, please wait...