Advanced search
User account
Login
Register
Find models by
Model name
First author
Each author
Find models for
Brain region
Concept
Find models of
Realistic Microcircuits
Connectionist Networks
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Download zip file
Auto-launch
Help downloading and running models
Model Information
Model File
Versions
Accession:
144538
"Sensorimotor control has traditionally been considered from a control theory perspective, without relation to neurobiology. In contrast, here we utilized a spiking-neuron model of motor cortex and trained it to perform a simple movement task, which consisted of rotating a single-joint “forearm” to a target. Learning was based on a reinforcement mechanism analogous to that of the dopamine system. This provided a global reward or punishment signal in response to decreasing or increasing distance from hand to target, respectively. Output was partially driven by Poisson motor babbling, creating stochastic movements that could then be shaped by learning. The virtual forearm consisted of a single segment rotated around an elbow joint, controlled by flexor and extensor muscles. ..."
Reference:
1 .
Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW (2012) Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex.
PLoS One
7
:e47251
[
PubMed
]
Citations
Citation Browser
Model Information
(Click on a link to find other models with that property)
Model Type:
Realistic Network;
Brain Region(s)/Organism:
Neocortex;
Cell Type(s):
Neocortex fast spiking (FS) interneuron;
Neocortex spiking regular (RS) neuron;
Neocortex spiking low threshold (LTS) neuron;
Channel(s):
Gap Junctions:
Receptor(s):
GabaA;
AMPA;
NMDA;
Gene(s):
Transmitter(s):
Dopamine;
Gaba;
Glutamate;
Simulation Environment:
NEURON;
Model Concept(s):
Simplified Models;
Synaptic Plasticity;
Long-term Synaptic Plasticity;
Reinforcement Learning;
Reward-modulated STDP;
Implementer(s):
Neymotin, Sam [Samuel.Neymotin at nki.rfmh.org];
Chadderdon, George [gchadder3 at gmail.com];
Search NeuronDB
for information about:
GabaA
;
AMPA
;
NMDA
;
Dopamine
;
Gaba
;
Glutamate
;
/
arm1d
README
drspk.mod
*
Other models using drspk.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
infot.mod
*
Other models using infot.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
intf6_.mod
*
Other models using intf6_.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
intfsw.mod
*
Other models using intfsw.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.mod
*
Other models using misc.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
nstim.mod
*
Other models using nstim.mod:
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
JitCon: Just in time connectivity for large spiking networks (Lytton et al. 2008)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
The virtual slice setup (Lytton et al. 2008)
Tonic-clonic transitions in a seizure simulation (Lytton and Omurtag 2007)
stats.mod
*
Other models using stats.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
updown.mod
*
Other models using updown.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
vecst.mod
*
Other models using vecst.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer models of corticospinal neurons replicate in vitro dynamics (Neymotin et al. 2017)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
arm.hoc
basestdp.hoc
col.hoc
*
Other models using col.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
colors.hoc
*
Other models using colors.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
declist.hoc
*
Other models using declist.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
decmat.hoc
*
Other models using decmat.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decnqs.hoc
*
Other models using decnqs.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decvec.hoc
*
Other models using decvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
default.hoc
*
Other models using default.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
drline.hoc
*
Other models using drline.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
filtutils.hoc
*
Other models using filtutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
geom.hoc
grvec.hoc
*
Other models using grvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
hinton.hoc
*
Other models using hinton.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
infot.hoc
*
Other models using infot.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
init.hoc
intfsw.hoc
*
Other models using intfsw.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
labels.hoc
*
Other models using labels.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
local.hoc
*
Other models using local.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.h
*
Other models using misc.h:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
mosinit.hoc
network.hoc
nload.hoc
nqs.hoc
*
Other models using nqs.hoc:
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
nqsnet.hoc
*
Other models using nqsnet.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
nrnoc.hoc
*
Other models using nrnoc.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
params.hoc
run.hoc
samutils.hoc
*
Other models using samutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
sense.hoc
*
Other models using sense.hoc:
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
setup.hoc
*
Other models using setup.hoc:
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
sim.hoc
simctrl.hoc
*
Other models using simctrl.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer model of clonazepam`s effect in thalamic slice (Lytton 1997)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Feedforward heteroassociative network with HH dynamics (Lytton 1998)
Hippocampus temporo-septal engram shift model (Lytton 1999)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
Thalamic quiescence of spike and wave seizures (Lytton et al 1997)
stats.hoc
*
Other models using stats.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
stim.hoc
syncode.hoc
*
Other models using syncode.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
units.hoc
*
Other models using units.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
xgetargs.hoc
*
Other models using xgetargs.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
File not selected
<- Select file from this column.
