Citations for Motor system model with reinforcement learning drives virtual arm (Dura-Bernal et al 2017)

Legends: Link to a Model Reference cited by multiple papers


Dura-Bernal S, Neymotin SA, Kerr CC, Sivagnanam S, Majumdar A, Francis JT, Lytton WW (2017) Evolutionary algorithm optimization of biological learning parameters in a biomimetic neuroprosthesis. IBM Journal of Research and Development (Computational Neuroscience special issue) 61(2/3):6:1-6:14

References and models cited by this paper

References and models that cite this paper

Anderson CT, Sheets PL, Kiritani T, Shepherd GM (2010) Sublayer-specific microcircuits of corticospinal and corticostriatal neurons in motor cortex. Nat Neurosci 13:739-44 [Journal] [PubMed]
Asher DE,Krichmar JL,Oros N (2014) Evolution of biologically plausible neural networks performing a visually guided reaching task Proc. Genetic Evol. Comput. Conf. :145-152
Bensmaia SJ, Miller LE (2014) Restoring sensorimotor function through intracortical interfaces: progress and looming challenges. Nat Rev Neurosci 15:313-25 [Journal] [PubMed]
Beyer H (2007) Evolution strategies Scholarpedia 2(8):1965
Carlson KD, Nageswaran JM, Dutt N, Krichmar JL (2014) An efficient automated parameter tuning framework for spiking neural networks. Front Neurosci 8:10 [Journal] [PubMed]
Carmena JM (2013) Advances in neuroprosthetic learning and control. PLoS Biol 11:e1001561 [Journal] [PubMed]
Chadderdon GL, Neymotin SA, Kerr CC, Lytton WW (2012) Reinforcement learning of targeted movement in a spiking neuronal model of motor cortex. PLoS One 7:e47251 [Journal] [PubMed]
  • Reinforcement learning of targeted movement (Chadderdon et al. 2012) [Model]
Demandt E, Mehring C, Vogt K, Schulze-Bonhage A, Aertsen A, Ball T (2012) Reaching movement onset- and end-related characteristics of EEG spectral power modulations. Front Neurosci 6:65 [Journal] [PubMed]
DeWolf T, Eliasmith C (2011) The neural optimal control hierarchy for motor control. J Neural Eng 8:065009 [Journal] [PubMed]
Dura-Bernal S, Li K, Neymotin SA, Francis JT, Principe JC, Lytton WW (2016) Restoring Behavior via Inverse Neurocontroller in a Lesioned Cortical Spiking Model Driving a Virtual Arm. Front Neurosci 10:28 [Journal] [PubMed]
  • Cortical model with reinforcement learning drives realistic virtual arm (Dura-Bernal et al 2015) [Model]
Dura-Bernal S,Kerr C,Neymotin S,Suter B,Shepherd G,Francis J,Lytton W (2015) Large-scale m1 microcircuit model with plastic input connections from biological pmd neurons used for prosthetic arm control 24th Annual Computational Neuroscience Meeting (CNS15) BMC Neuroscience
Featherstone R,Orin D (2000) Robot dynamics: Equations and algorithms In ICRA (International Conference Robotics and Automation) :826-834
Flint RD, Lindberg EW, Jordan LR, Miller LE, Slutzky MW (2012) Accurate decoding of reaching movements from field potentials in the absence of spikes. J Neural Eng 9:046006 [Journal] [PubMed]
Frémaux N, Sprekeler H, Gerstner W (2013) Reinforcement learning using a continuous time actor-critic framework with spiking neurons. PLoS Comput Biol 9:e1003024 [Journal] [PubMed]
Hogri R, Bamford SA, Taub AH, Magal A, Del Giudice P, Mintz M (2015) A neuro-inspired model-based closed-loop neuroprosthesis for the substitution of a cerebellar learning function in anesthetized rats. Sci Rep 5:8451 [Journal] [PubMed]
Hosp JA, Pekanovic A, Rioult-Pedotti MS, Luft AR (2011) Dopaminergic projections from midbrain to primary motor cortex mediate motor skill learning. J Neurosci 31:2481-7 [Journal] [PubMed]
Izhikevich EM (2007) Solving the distal reward problem through linkage of STDP and dopamine signaling. Cereb Cortex 17:2443-52 [Journal] [PubMed]
  • Linking STDP and Dopamine action to solve the distal reward problem (Izhikevich 2007) [Model]
Izhikevich EM, Edelman GM (2008) Large-scale model of mammalian thalamocortical systems. Proc Natl Acad Sci U S A 105:3593-8 [Journal] [PubMed]
Kerr CC, Neymotin SA, Chadderdon GL, Fietkiewicz CT, Francis JT, Lytton WW (2012) Electrostimulation as a prosthesis for repair of information flow in a computer model of neocortex. IEEE Trans Neural Syst Rehabil Eng 20:153-60 [Journal] [PubMed]
  • Prosthetic electrostimulation for information flow repair in a neocortical simulation (Kerr 2012) [Model]
Kocaturk M, Gulcur HO, Canbeyli R (2015) Toward Building Hybrid Biological/in silico Neural Networks for Motor Neuroprosthetic Control. Front Neurorobot 9:8 [Journal] [PubMed]
Kozloski J (2016) Closed-Loop Brain Model of Neocortical Information-Based Exchange. Front Neuroanat 10:3 [Journal] [PubMed]
Kubikova L, Kostál L (2010) Dopaminergic system in birdsong learning and maintenance. J Chem Neuroanat 39:112-23 [Journal] [PubMed]
Lee D, Seo H, Jung MW (2012) Neural basis of reinforcement learning and decision making. Annu Rev Neurosci 35:287-308 [Journal] [PubMed]
Lee G, Matsunaga A, Dura-Bernal S, Zhang W, Lytton WW, Francis JT, Fortes JA (2014) Towards real-time communication between in vivo neurophysiological data sources and simulator-based brain biomimetic models. J Comput Surg 3:1-23 [Journal] [PubMed]
Ling G (2013) Newsmaker interview: Geoffrey Ling. DARPA aims to rebuild brains. Interview by Emily Underwood. Science 342:1029-30 [Journal] [PubMed]
Luque NR, Garrido JA, Carrillo RR, Coenen OJ, Ros E (2011) Cerebellar input configuration toward object model abstraction in manipulation tasks. IEEE Trans Neural Netw 22:1321-8 [Journal] [PubMed]
Lytton WW, Seidenstein AH, Dura-Bernal S, McDougal RA, Schürmann F, Hines ML (2016) Simulation Neurotechnologies for Advancing Brain Research: Parallelizing Large Networks in NEURON. Neural Comput 28:2063-90 [Journal] [PubMed]
  • Parallelizing large networks in NEURON (Lytton et al. 2016) [Model]
Markram H, Muller E, Ramaswamy S, Reimann MW, Abdellah M, Sanchez CA, Ailamaki A, Alonso-Nanclares L, Antille N, Arsever S, Kahou GA, Berger TK, Bilgili A, Buncic N, Chalimourda A, Chindemi G, Courcol JD, Delalondre F, Delattre V, Druckmann S, Dumusc R, Dynes J, Eilemann S, Gal E, Gevaert ME, Ghobril JP, Gidon A, Graham JW, Gupta A, Haenel V, Hay E, Heinis T, Hernando JB, Hines M, Kanari L, Keller D, Kenyon J, Khazen G, Kim Y, King JG, Kisvarday Z, Kumbhar P, Lasserre S, Le Bé JV, Magalhães BR, Merchán-Pérez A, Meystre J, Morrice BR, Muller J, Muñoz-Céspedes A, Muralidhar S, Muthurasa K, Nachbaur D, Newton TH, Nolte M, Ovcharenko A, Palacios J, Pastor L, Perin R, Ranjan R, Riachi I, Rodríguez JR, Riquelme JL, Rössert C, Sfyrakis K, Shi Y, Shillcock JC, Silberberg G, Silva R, Tauheed F, Telefont M, Toledo-Rodriguez M, Tränkler T, Van Geit W, Díaz JV, Walker R, Wang Y, Zaninetta SM (2015) Reconstruction and Simulation of Neocortical Microcircuitry. Cell 163:456-92 [Journal] [PubMed]
  • The neocortical microcircuit collaboration portal (Markram et al. 2015) [Model]
Marsh BT, Tarigoppula VS, Chen C, Francis JT (2015) Toward an autonomous brain machine interface: integrating sensorimotor reward modulation and reinforcement learning. J Neurosci 35:7374-87 [Journal] [PubMed]
Martin WN,Lienig J,Cohoon JP (1997) Island (migration) models: Evolutionary algorithms based on punctuated equilibria Handbook of Evolutionary Computation
Miranda RA, Casebeer WD, Hein AM, Judy JW, Krotkov EP, Laabs TL, Manzo JE, Pankratz KG, Pratt GA, Sanchez JC, Weber DJ, Wheeler TL, Ling GS (2015) DARPA-funded efforts in the development of novel brain-computer interface technologies. J Neurosci Methods 244:52-67 [Journal] [PubMed]
Molina-Luna K, Pekanovic A, Röhrich S, Hertler B, Schubring-Giese M, Rioult-Pedotti MS, Luft AR (2009) Dopamine in motor cortex is necessary for skill learning and synaptic plasticity. PLoS One 4:e7082 [Journal] [PubMed]
Neymotin SA, Chadderdon GL, Kerr CC, Francis JT, Lytton WW (2013) Reinforcement learning of two-joint virtual arm reaching in a computer model of sensorimotor cortex. Neural Comput 25:3263-93 [Journal] [PubMed]
  • Sensorimotor cortex reinforcement learning of 2-joint virtual arm reaching (Neymotin et al. 2013) [Model]
Nowostawski M,Poli R (1999) Parallel genetic algorithm taxonomy Proc. IEEE 3rd Int. Conf. Knowl.-Based Intell. Inf. Eng. Syst. :88-92
Prins NW, Sanchez JC, Prasad A (2014) A confidence metric for using neurobiological feedback in actor-critic reinforcement learning based brain-machine interfaces. Front Neurosci 8:111 [Journal] [PubMed]
Rumbell TH, Draguljic D, Yadav A, Hof PR, Luebke JI, Weaver CM (2016) Automated evolutionary optimization of ion channel conductances and kinetics in models of young and aged rhesus monkey pyramidal neurons. J Comput Neurosci 41:65-90 [Journal] [PubMed]
  • Rhesus Monkey Young and Aged L3 PFC Pyramidal Neurons (Rumbell et al. 2016) [Model]
Sanchez J, Lytton W, Carmena J, Principe J, Fortes J, Barbour R, Francis J (2012) Dynamically repairing and replacing neural networks: using hybrid computational and biological tools. IEEE Pulse 3:57-9 [Journal] [PubMed]
Shadmehr R, Krakauer JW (2008) A computational neuroanatomy for motor control. Exp Brain Res 185:359-81 [Journal] [PubMed]
Shadmehr R, Mussa-Ivaldi FA (1994) Adaptive representation of dynamics during learning of a motor task. J Neurosci 14:3208-24 [PubMed]
Skolicki Z,De Jong K (2005) The influence of migration sizes and intervals on island models Proc. 7th Annu. Conf. Genetic Evol. Comput. :1295-1302
Song W, Kerr CC, Lytton WW, Francis JT (2013) Cortical plasticity induced by spike-triggered microstimulation in primate somatosensory cortex. PLoS One 8:e57453 [Journal] [PubMed]
Stanley GB (2013) Reading and writing the neural code. Nat Neurosci 16:259-63 [Journal] [PubMed]
Tessadori J, Bisio M, Martinoia S, Chiappalone M (2012) Modular neuronal assemblies embodied in a closed-loop environment: toward future integration of brains and machines. Front Neural Circuits 6:99 [Journal] [PubMed]
Thelen DG, Anderson FC, Delp SL (2003) Generating dynamic simulations of movement using computed muscle control. J Biomech 36:321-8 [PubMed]
Van Geit W, De Schutter E, Achard P (2008) Automated neuron model optimization techniques: a review. Biol Cybern 99:241-51 [Journal] [PubMed]
Weiler N, Wood L, Yu J, Solla SA, Shepherd GM (2008) Top-down laminar organization of the excitatory network in motor cortex. Nat Neurosci 11:360-6 [Journal] [PubMed]
  • Laminar connectivity matrix simulation (Weiler et al 2008) [Model]
Yagishita S, Hayashi-Takagi A, Ellis-Davies GC, Urakubo H, Ishii S, Kasai H (2014) A critical time window for dopamine actions on the structural plasticity of dendritic spines. Science 345:1616-20 [Journal] [PubMed]
(54 refs)