Advanced search
SenseLab
SimToolDB
ModelDB Help
User account
Login
Register
Find models by
Model name
First author
Each author
Region(circuits)
Find models for
Cell type
Current
Receptor
Gene
Transmitters
Concept
Simulators
Methods
Find models of
Realistic Networks
Neurons
Electrical synapses (gap junctions)
Chemical synapses
Ion channels
Neuromuscular junctions
Axons
Pathophysiology
Other resources
SenseLab mailing list
ModelDB related resources
Computational neuroscience ecosystem
Models in a git repository
ModelDB is moving. Check out our new site at
https://modeldb.science
.
The corresponding page is
https://modeldb.science/150245
.
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
 
Download zip file
Help downloading and running models
Model Information
Model File
Citations
Model Views
Versions on GitHub
Accession:
150245
"... We developed a model of sensory and motor neocortex consisting of 704 spiking model-neurons. Sensory and motor populations included excitatory cells and two types of interneurons. Neurons were interconnected with AMPA/NMDA, and GABAA synapses. We trained our model using spike-timing-dependent reinforcement learning to control a 2-joint virtual arm to reach to a fixed target. ... "
Reference:
1 .
Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW (2013) Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex.
Neural Comput
25
:3263-93
[
PubMed
]
Model Information
(Click on a link to find other models with that property)
Model Type:
Realistic Network;
Brain Region(s)/Organism:
Cell Type(s):
Neocortex L5/6 pyramidal GLU cell;
Neocortex U1 L2/6 pyramidal intratelencephalic GLU cell;
Neocortex V1 interneuron basket PV GABA cell;
Neocortex fast spiking (FS) interneuron;
Neocortex spiking regular (RS) neuron;
Neocortex spiking low threshold (LTS) neuron;
Channel(s):
Gap Junctions:
Receptor(s):
GabaA;
AMPA;
NMDA;
Gene(s):
Transmitter(s):
Gaba;
Glutamate;
Simulation Environment:
NEURON;
Model Concept(s):
Synaptic Plasticity;
Learning;
Reinforcement Learning;
STDP;
Reward-modulated STDP;
Sensory processing;
Implementer(s):
Neymotin, Sam [Samuel.Neymotin at nki.rfmh.org];
Chadderdon, George [gchadder3 at gmail.com];
Search NeuronDB
for information about:
Neocortex L5/6 pyramidal GLU cell
;
Neocortex V1 interneuron basket PV GABA cell
;
Neocortex U1 L2/6 pyramidal intratelencephalic GLU cell
;
GabaA
;
AMPA
;
NMDA
;
Gaba
;
Glutamate
;
/
a2dmodeldb
readme.html
drspk.mod
*
Other models using drspk.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
infot.mod
*
Other models using infot.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
intf6_.mod
*
Other models using intf6_.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
misc.mod
*
Other models using misc.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
nstim.mod
*
Other models using nstim.mod:
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
JitCon: Just in time connectivity for large spiking networks (Lytton et al. 2008)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
The virtual slice setup (Lytton et al. 2008)
Tonic-clonic transitions in a seizure simulation (Lytton and Omurtag 2007)
stats.mod
*
Other models using stats.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
vecst.mod
*
Other models using vecst.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer models of corticospinal neurons replicate in vitro dynamics (Neymotin et al. 2017)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
arm.hoc
basestdp.hoc
col.hoc
colors.hoc
*
Other models using colors.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
declist.hoc
*
Other models using declist.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decmat.hoc
*
Other models using decmat.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decnqs.hoc
*
Other models using decnqs.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decvec.hoc
*
Other models using decvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
default.hoc
*
Other models using default.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
drline.hoc
*
Other models using drline.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
filtutils.hoc
*
Other models using filtutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
geom.hoc
grvec.hoc
*
Other models using grvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
hinton.hoc
*
Other models using hinton.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
infot.hoc
*
Other models using infot.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
init.hoc
labels.hoc
*
Other models using labels.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.h
*
Other models using misc.h:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
mosinit.hoc
network.hoc
nload.hoc
nqs.hoc
*
Other models using nqs.hoc:
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
nqsnet.hoc
*
Other models using nqsnet.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
nrnoc.hoc
*
Other models using nrnoc.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
params.hoc
python.hoc
pywrap.hoc
*
Other models using pywrap.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
run.hoc
samutils.hoc
*
Other models using samutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
screenshot.png
sense.hoc
*
Other models using sense.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
setup.hoc
*
Other models using setup.hoc:
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
simctrl.hoc
*
Other models using simctrl.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer model of clonazepam`s effect in thalamic slice (Lytton 1997)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Feedforward heteroassociative network with HH dynamics (Lytton 1998)
Hippocampus temporo-septal engram shift model (Lytton 1999)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
Thalamic quiescence of spike and wave seizures (Lytton et al 1997)
stats.hoc
*
Other models using stats.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
stim.hoc
syncode.hoc
*
Other models using syncode.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
trainedplast.nqs
units.hoc
*
Other models using units.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
xgetargs.hoc
*
Other models using xgetargs.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
File not selected
<- Select file from this column.
Load Model Views
naive network
trained network
Loading data, please wait...