Advanced search
User account
Login
Register
Find models by
Model name
First author
Each author
Find models for
Brain region
Concept
Find models of
Realistic Microcircuits
Connectionist Networks
Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015)
Download zip file
Auto-launch
Help downloading and running models
Model Information
Model File
Versions
Accession:
183014
We developed a 3-layer sensorimotor cortical network of consisting of 704 spiking model-neurons, including excitatory, fast-spiking and low-threshold spiking interneurons. Neurons were interconnected with AMPA/NMDA, and GABAA synapses. We trained our model using spike-timing-dependent reinforcement learning to control a virtual musculoskeletal human arm, with realistic anatomical and biomechanical properties, to reach a target. Virtual arm position was used to simultaneously control a robot arm via a network interface.
Reference:
1 .
Dura-Bernal S, Zhou X, Neymotin SA, Przekwas A, Francis JT, Lytton WW (2015) Cortical Spiking Network Interfaced with Virtual Musculoskeletal Arm and Robotic Arm.
Front Neurorobot
9
:13
[
PubMed
]
2 .
Dura-Bernal S, Li K, Neymotin SA, Francis JT, Principe JC, Lytton WW (2016) Restoring Behavior via Inverse Neurocontroller in a Lesioned Cortical Spiking Model Driving a Virtual Arm.
Front Neurosci
10
:28
[
PubMed
]
Citations
Citation Browser
Model Information
(Click on a link to find other models with that property)
Model Type:
Realistic Network;
Brain Region(s)/Organism:
Cell Type(s):
Neocortex M1 L5B pyramidal pyramidal tract GLU cell;
Neocortex M1 L2/6 pyramidal intratelencephalic GLU cell;
Neocortex M1 interneuron basket PV GABA cell;
Neocortex fast spiking (FS) interneuron;
Neostriatum fast spiking interneuron;
Neocortex spiking regular (RS) neuron;
Neocortex spiking low threshold (LTS) neuron;
Channel(s):
Gap Junctions:
Receptor(s):
GabaA;
AMPA;
NMDA;
Gene(s):
Transmitter(s):
Gaba;
Glutamate;
Simulation Environment:
NEURON;
Python (web link to model);
Model Concept(s):
Synaptic Plasticity;
Learning;
Reinforcement Learning;
STDP;
Reward-modulated STDP;
Sensory processing;
Motor control;
Touch;
Implementer(s):
Neymotin, Sam [Samuel.Neymotin at nki.rfmh.org];
Dura, Salvador [ salvadordura at gmail.com];
Search NeuronDB
for information about:
Neocortex M1 L2/6 pyramidal intratelencephalic GLU cell
;
Neocortex M1 L5B pyramidal pyramidal tract GLU cell
;
Neocortex M1 interneuron basket PV GABA cell
;
GabaA
;
AMPA
;
NMDA
;
Gaba
;
Glutamate
;
/
arm2dms_modeldb
mod
drspk.mod
*
Other models using drspk.mod:
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
infot.mod
*
Other models using infot.mod:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
intf6.mod
*
Other models using intf6.mod:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
intfsw.mod
*
Other models using intfsw.mod:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
misc.mod
*
Other models using misc.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
mySTDP.mod
nsloc.mod
nstim.mod
*
Other models using nstim.mod:
Computational Surgery (Lytton et al. 2011)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Emergence of physiological oscillation frequencies in neocortex simulations (Neymotin et al. 2011)
JitCon: Just in time connectivity for large spiking networks (Lytton et al. 2008)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
The virtual slice setup (Lytton et al. 2008)
Tonic-clonic transitions in a seizure simulation (Lytton and Omurtag 2007)
place.mod
*
Other models using place.mod:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
stats.mod
*
Other models using stats.mod:
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
updown.mod
*
Other models using updown.mod:
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Synaptic information transfer in computer models of neocortical columns (Neymotin et al. 2010)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
vecst.mod
*
Other models using vecst.mod:
Boolean network-based analysis of the apoptosis network (Mai and Liu 2009)
Ca+/HCN channel-dependent persistent activity in multiscale model of neocortex (Neymotin et al 2016)
Computational Surgery (Lytton et al. 2011)
Computer models of corticospinal neurons replicate in vitro dynamics (Neymotin et al. 2017)
Electrostimulation to reduce synaptic scaling driven progression of Alzheimers (Rowan et al. 2014)
Ih tunes oscillations in an In Silico CA3 model (Neymotin et al. 2013)
In silico hippocampal modeling for multi-target pharmacotherapy in schizophrenia (Sherif et al 2020)
Motor cortex microcircuit simulation based on brain activity mapping (Chadderdon et al. 2014)
Multitarget pharmacology for Dystonia in M1 (Neymotin et al 2016)
Neuronal dendrite calcium wave model (Neymotin et al, 2015)
Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012)
Reinforcement learning of targeted movement (Chadderdon et al. 2012)
Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013)
Synaptic scaling balances learning in a spiking model of neocortex (Rowan & Neymotin 2013)
parameters.multi
File not selected
<- Select file from this column.
