Advanced search
SenseLab
SimToolDB
ModelDB Help
User account
Login
Register
Find models by
Model name
First author
Each author
Region(circuits)
Find models for
Cell type
Current
Receptor
Gene
Transmitters
Concept
Simulators
Methods
Find models of
Realistic Networks
Neurons
Electrical synapses (gap junctions)
Chemical synapses
Ion channels
Neuromuscular junctions
Axons
Pathophysiology
Other resources
SenseLab mailing list
ModelDB related resources
Computational neuroscience ecosystem
Models in a git repository
ModelDB is moving. Check out our new site at
https://modeldb.science
.
The corresponding page is
https://modeldb.science/183014
.
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
 
Download zip file
Help downloading and running models
Model Information
Model File
Citations
Versions on GitHub
Accession:
183014
We developed a 3-layer sensorimotor cortical network of consisting of 704 spiking model-neurons, including excitatory, fast-spiking and low-threshold spiking interneurons. Neurons were interconnected with AMPA/NMDA, and GABAA synapses. We trained our model using spike-timing-dependent reinforcement learning to control a virtual musculoskeletal human arm, with realistic anatomical and biomechanical properties, to reach a target. Virtual arm position was used to simultaneously control a robot arm via a network interface.
References:
1 .
Dura-Bernal S, Zhou X, Neymotin SA, Przekwas A, Francis JT, Lytton WW (2015) Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm.
Front Neurorobot
9
:13
[
PubMed
]
2 .
Dura-Bernal S, Li K, Neymotin SA, Francis JT, Principe JC, Lytton WW (2016) Restoring Behavior via Inverse Neurocontroller in a Lesioned Cortical Spiking Model Driving a Virtual Arm.
Front Neurosci
10
:28
[
PubMed
]
Model Information
(Click on a link to find other models with that property)
Model Type:
Realistic Network;
Brain Region(s)/Organism:
Cell Type(s):
Neocortex M1 L5B pyramidal pyramidal tract GLU cell;
Neocortex M1 L2/6 pyramidal intratelencephalic GLU cell;
Neocortex M1 interneuron basket PV GABA cell;
Neocortex fast spiking (FS) interneuron;
Neostriatum fast spiking interneuron;
Neocortex spiking regular (RS) neuron;
Neocortex spiking low threshold (LTS) neuron;
Channel(s):
Gap Junctions:
Receptor(s):
GabaA;
AMPA;
NMDA;
Gene(s):
Transmitter(s):
Gaba;
Glutamate;
Simulation Environment:
NEURON;
Python (web link to model);
Model Concept(s):
Synaptic Plasticity;
Learning;
Reinforcement Learning;
STDP;
Reward-modulated STDP;
Sensory processing;
Motor control;
Touch;
Implementer(s):
Neymotin, Sam [Samuel.Neymotin at nki.rfmh.org];
Dura, Salvador [ salvadordura at gmail.com];
Search NeuronDB
for information about:
Neocortex M1 L2/6 pyramidal intratelencephalic GLU cell
;
Neocortex M1 L5B pyramidal pyramidal tract GLU cell
;
Neocortex M1 interneuron basket PV GABA cell
;
GabaA
;
AMPA
;
NMDA
;
Gaba
;
Glutamate
;
/
arm2dms_modeldb
mod
msarm
stimdata
README.html
analyse_funcs.py
analysis.py
armGraphs.py
arminterface_pipe.py
basestdp.hoc
bicolormap.py
boxes.hoc
*
Other models using boxes.hoc:
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
bpf.h
*
Other models using bpf.h:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
col.hoc
colors.hoc
*
Other models using colors.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
declist.hoc
*
Other models using declist.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
decmat.hoc
*
Other models using decmat.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
decnqs.hoc
*
Other models using decnqs.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
decvec.hoc
*
Other models using decvec.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
default.hoc
*
Other models using default.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
drline.hoc
*
Other models using drline.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
filtutils.hoc
*
Other models using filtutils.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
grvec.hoc
hinton.hoc
*
Other models using hinton.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
hocinterface.py
infot.hoc
*
Other models using infot.hoc:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
init.hoc
intfsw.hoc
*
Other models using intfsw.hoc:
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
labels.hoc
load.hoc
load.py
local.hoc
*
Other models using local.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
main.hoc
main_demo.hoc
main_neurostim.hoc
misc.h
*
Other models using misc.h:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.py
*
Other models using misc.py:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
msarm.hoc
network.hoc
neuroplot.py
*
Other models using neuroplot.py:
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
neurostim.hoc
nload.hoc
nqs.hoc
*
Other models using nqs.hoc:
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
nqsnet.hoc
*
Other models using nqsnet.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
nrnoc.hoc
params.hoc
perturb.hoc
python.hoc
pywrap.hoc
*
Other models using pywrap.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
run.hoc
runbatch_neurostim.py
runsim_neurostim
samutils.hoc
*
Other models using samutils.hoc:
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
saveoutput.hoc
saveoutput2.hoc
setup.hoc
*
Other models using setup.hoc:
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
sim.hoc
sim.py
sim_demo.py
simctrl.hoc
*
Other models using simctrl.hoc:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
CA3 Network Model of Epileptic Activity (Sanjay et. al, 2015)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer model of clonazepam`s effect in thalamic slice (Lytton 1997)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
Feedforward heteroassociative network with HH dynamics (Lytton 1998)
Hippocampus temporo-septal engram shift model (Lytton 1999)
Hopfield and Brody model (Hopfield, Brody 2000) (NEURON+python)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Ketamine disrupts theta modulation of gamma in a computer model of hippocampus (Neymotin et al 2011)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
Thalamic quiescence of spike and wave seizures (Lytton et al 1997)
stats.hoc
*
Other models using stats.hoc:
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
stim.hoc
syncode.hoc
*
Other models using syncode.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
units.hoc
*
Other models using units.hoc:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
vector.py
xgetargs.hoc
*
Other models using xgetargs.hoc:
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
File not selected
<- Select file from this column.
Loading data, please wait...