Advanced search
User account
Login
Register
Find models by
Model name
First author
Each author
Find models for
Brain region
Concept
Find models of
Realistic Microcircuits
Connectionist Networks
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Download zip file
Auto-launch
Help downloading and running models
Model Information
Model File
Model Views
Versions
Accession:
150245
"... We developed a model of sensory and motor neocortex consisting of 704 spiking model-neurons. Sensory and motor populations included excitatory cells and two types of interneurons. Neurons were interconnected with AMPA/NMDA, and GABAA synapses. We trained our model using spike-timing-dependent reinforcement learning to control a 2-joint virtual arm to reach to a fixed target. ... "
Reference:
1 .
Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW (2013) Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex.
Neural Comput
25
:3263-93
[
PubMed
]
Citations
Citation Browser
Model Information
(Click on a link to find other models with that property)
Model Type:
Realistic Network;
Brain Region(s)/Organism:
Cell Type(s):
Neocortex L5/6 pyramidal GLU cell;
Neocortex U1 L2/6 pyramidal intratelencephalic GLU cell;
Neocortex V1 interneuron basket PV GABA cell;
Neocortex fast spiking (FS) interneuron;
Neocortex spiking regular (RS) neuron;
Neocortex spiking low threshold (LTS) neuron;
Channel(s):
Gap Junctions:
Receptor(s):
GabaA;
AMPA;
NMDA;
Gene(s):
Transmitter(s):
Gaba;
Glutamate;
Simulation Environment:
NEURON;
Model Concept(s):
Synaptic Plasticity;
Learning;
Reinforcement Learning;
STDP;
Reward-modulated STDP;
Sensory processing;
Implementer(s):
Neymotin, Sam [Samuel.Neymotin at nki.rfmh.org];
Chadderdon, George [gchadder3 at gmail.com];
Search NeuronDB
for information about:
Neocortex L5/6 pyramidal GLU cell
;
Neocortex V1 interneuron basket PV GABA cell
;
Neocortex U1 L2/6 pyramidal intratelencephalic GLU cell
;
GabaA
;
AMPA
;
NMDA
;
Gaba
;
Glutamate
;
Download the displayed file
/
a2dmodeldb
readme.html
drspk.mod
*
Other models using drspk.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
infot.mod
*
Other models using infot.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
intf6_.mod
*
Other models using intf6_.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
misc.mod
*
Other models using misc.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
nstim.mod
*
Other models using nstim.mod:
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
JitCon: Just in time connectivity for large spiking networks (Lytton et al. 2008)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
The virtual slice setup (Lytton et al. 2008)
Tonic-clonic transitions in a seizure simulation (Lytton and Omurtag 2007)
stats.mod
*
Other models using stats.mod:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
vecst.mod
*
Other models using vecst.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer models of corticospinal neurons replicate in vitro dynamics (Neymotin et al. 2017)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
arm.hoc
basestdp.hoc
col.hoc
colors.hoc
*
Other models using colors.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
declist.hoc
*
Other models using declist.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decmat.hoc
*
Other models using decmat.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decnqs.hoc
*
Other models using decnqs.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decvec.hoc
*
Other models using decvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
default.hoc
*
Other models using default.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
drline.hoc
*
Other models using drline.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
filtutils.hoc
*
Other models using filtutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
geom.hoc
grvec.hoc
*
Other models using grvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
hinton.hoc
*
Other models using hinton.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
infot.hoc
*
Other models using infot.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
init.hoc
labels.hoc
*
Other models using labels.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.h
*
Other models using misc.h:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
mosinit.hoc
network.hoc
nload.hoc
nqs.hoc
*
Other models using nqs.hoc:
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
nqsnet.hoc
*
Other models using nqsnet.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
nrnoc.hoc
*
Other models using nrnoc.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
params.hoc
python.hoc
pywrap.hoc
*
Other models using pywrap.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
run.hoc
samutils.hoc
*
Other models using samutils.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
screenshot.png
sense.hoc
*
Other models using sense.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
setup.hoc
*
Other models using setup.hoc:
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
simctrl.hoc
*
Other models using simctrl.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer model of clonazepam`s effect in thalamic slice (Lytton 1997)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Feedforward heteroassociative network with HH dynamics (Lytton 1998)
Hippocampus temporo-septal engram shift model (Lytton 1999)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
Thalamic quiescence of spike and wave seizures (Lytton et al 1997)
stats.hoc
*
Other models using stats.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
stim.hoc
syncode.hoc
*
Other models using syncode.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
trainedplast.nqs
units.hoc
*
Other models using units.hoc:
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
xgetargs.hoc
*
Other models using xgetargs.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
ModelDB scripts have detected that binary file '/a2dmodeldb/trainedplast.nqs' is not displayable. You may download the file to examine if desired.
<- Select file from this column.
Load Model Views
naive network
trained network
