Citation Relationships

Waltemath D, Wolkenhauer O (2016) How Modeling Standards, Software, and Initiatives Support Reproducibility in Systems Biology and Systems Medicine. IEEE Trans Biomed Eng 63:1999-2006 [PubMed]

References and models cited by this paper

References and models that cite this paper

(2009) Credit where credit is overdue. Nat Biotechnol 27:579 [Journal] [PubMed]

Altman DG, Simera I, Hoey J, Moher D, Schulz K (2008) EQUATOR: reporting guidelines for health research. Open Med 2:e49-50 [PubMed]

Arrowsmith J (2011) Trial watch: Phase II failures: 2008-2010. Nat Rev Drug Discov 10:328-9 [Journal] [PubMed]

Asai Y, Suzuki Y, Kido Y, Oka H, Heien E, Nakanishi M, Urai T, Hagihara K, Kurachi Y, Nomura T (2008) Specifications of insilicoML 1.0: a multilevel biophysical model description language. J Physiol Sci 58:447-58 [Journal] [PubMed]

Bechhofer S (2013) Why linked data is not enough for scientists Future Generation Comput. Syst 29(2):599-611

Bechhofer S,Et Al () Research objects: Towards exchange and reuse of digital knowledge Future Web Collaborative Sci [Journal]

Begley CG, Ellis LM (2012) Drug development: Raise standards for preclinical cancer research. Nature 483:531-3 [Journal] [PubMed]

Begley CG, Ioannidis JP (2015) Reproducibility in science: improving the standard for basic and preclinical research. Circ Res 116:116-26 [Journal] [PubMed]

Bell AW, Deutsch EW, Au CE, Kearney RE, Beavis R, Sechi S, Nilsson T, Bergeron JJ, HUPO Test Sample Working Group (2009) A HUPO test sample study reveals common problems in mass spectrometry-based proteomics. Nat Methods 6:423-30 [Journal] [PubMed]

Bergmann FT, Adams R, Moodie S, Cooper J, Glont M, Golebiewski M, Hucka M, Laibe C, Miller AK, Nickerson DP, Olivier BG, Rodriguez N, Sauro HM, Scharm M, Soiland-Reyes S, Waltemath D, Yvon F, Le Novère N (2014) COMBINE archive and OMEX format: one file to share all information to reproduce a modeling project. BMC Bioinformatics 15:369 [Journal] [PubMed]

Bergmann FT, Cooper J, Le Novère N, Nickerson D, Waltemath D (2015) Simulation Experiment Description Markup Language (SED-ML) Level 1 Version 2. J Integr Bioinform 12:262 [Journal] [PubMed]

Bergmann FT,Sauro HM (2006) SBW—A modular framework for systems biology Proc. 38th Conf. Winter Simul. :1637-1645

Boettiger (2015) An introduction to Docker for reproducible research ACM SIGOPS Oper. Syst. Rev. 49(1):71-79

Buckheit JB,Donoho DL (1995) Wavelab and reproducible research Wavelets and Statistics :55-81

Collins FS, Tabak LA (2014) Policy: NIH plans to enhance reproducibility. Nature 505:612-3 [PubMed]

Cooper J, Scharm M, Mirams GR (2016) The Cardiac Electrophysiology Web Lab. Biophys J 110:292-300 [Journal] [PubMed]

Courtot M, Juty N, Knüpfer C, Waltemath D, Zhukova A, Dräger A, Dumontier M, Finney A, Golebiewski M, Hastings J, Hoops S, Keating S, Kell DB, Kerrien S, Lawson J, Lister A, Lu J, Machne R, Mendes P, Pocock M, Rodriguez N, Villeger A, Wilkinson DJ, Wimalaratne S, Laibe C, Hucka M, Le Novère N (2011) Controlled vocabularies and semantics in systems biology. Mol Syst Biol 7:543 [Journal] [PubMed]

Demir E, Cary MP, Paley S, Fukuda K, Lemer C, Vastrik I, Wu G, D'Eustachio P, Schaefer C, Luciano J, Schacherer F, Martinez-Flores I, Hu Z, Jimenez-Jacinto V, Joshi-Tope G, Kandasamy K, Lopez-Fuentes AC, Mi H, Pichler E, Rodchenkov I, Splendiani A, Tkachev S, Zucker J, Gopinath G, Rajasimha H, Ramakrishnan R, Shah I, Syed M, Anwar N, Babur O, Blinov M, Brauner E, Corwin D, Donaldson S, Gibbons F, Goldberg R, Hornbeck P, Luna A, Murray-Rust P, Neumann E, Ruebenacker O, Reubenacker O, Samwald M, van Iersel M, Wimalaratne S, Allen K, Braun B, Whirl-Carrillo M, Cheung KH, Dahlquist K, Finney A, Gillespie M, Glass E, Gong L, Haw R, Honig M, Hubaut O, Kane D, Krupa S, Kutmon M, Leonard J, Marks D, Merberg D, Petri V, Pico A, Ravenscroft D, Ren L, Shah N, Sunshine M, Tang R, Whaley R, Letovksy S, Buetow KH, Rzhetsky A, Schachter V, Sobral BS, Dogrusoz U, McWeeney S, Aladjem M, Birney E (2010) The BioPAX community standard for pathway data sharing. Nat Biotechnol 28:935-42 [Journal] [PubMed]

ENCODE Project Consortium (2012) An integrated encyclopedia of DNA elements in the human genome. Nature 489:57-74 [Journal] [PubMed]

Errington TM, Iorns E, Gunn W, Tan FE, Lomax J, Nosek BA (2014) An open investigation of the reproducibility of cancer biology research. Elife [Journal] [PubMed]

Galdzicki M, Clancy KP, Oberortner E, Pocock M, Quinn JY, Rodriguez CA, Roehner N, Wilson ML, Adam L, Anderson JC, Bartley BA, Beal J, Chandran D, Chen J, Densmore D, Endy D, Grünberg R, Hallinan J, Hillson NJ, Johnson JD, Kuchinsky A, Lux M, Misirli G, Peccoud J, Plahar HA, Sirin E, Stan GB, Villalobos A, Wipat A, Gennari JH, Myers CJ, Sauro HM (2014) The Synthetic Biology Open Language (SBOL) provides a community standard for communicating designs in synthetic biology. Nat Biotechnol 32:545-50 [Journal] [PubMed]

García-Berthou E, Alcaraz C (2004) Incongruence between test statistics and P values in medical papers. BMC Med Res Methodol 4:13 [Journal] [PubMed]

Garijo D, Kinnings S, Xie L, Xie L, Zhang Y, Bourne PE, Gil Y (2013) Quantifying reproducibility in computational biology: the case of the tuberculosis drugome. PLoS One 8:e80278 [Journal] [PubMed]

Gleeson P, Crook S, Cannon RC, Hines ML, Billings GO, Farinella M, Morse TM, Davison AP, Ray S, Bhalla US, Barnes SR, Dimitrova YD, Silver RA (2010) NeuroML: a language for describing data driven models of neurons and networks with a high degree of biological detail. PLoS Comput Biol 6:e1000815 [Journal] [PubMed]

Gleeson PPIASINIE,Crook S,Cannon R,Steuber V,Jaeger D,Et AL (2012) The Open Source Brain Initiative: enabling collaborative modelling in computational neuroscience Twenty First Annual Computational Neuroscience Meeting: CNS*2012

Goecks J, Nekrutenko A, Taylor J, Galaxy Team (2010) Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol 11:R86 [Journal] [PubMed]

Henkel R (2015) Combining computational models, semantic annotations and simulation experiments in a graph database Database 2015:bau130

Henkel R, Endler L, Peters A, Le Novère N, Waltemath D (2010) Ranked retrieval of Computational Biology models. BMC Bioinformatics 11:423 [Journal] [PubMed]

Hetherington J,Et Al (2007) Addressing the challenges of multiscale model management in systems biology Comput. Chemi. Eng. 31(8):962-979

Hines ML, Morse T, Migliore M, Carnevale NT, Shepherd GM (2004) ModelDB: A Database to Support Computational Neuroscience. J Comput Neurosci 17:7-11 [Journal] [PubMed]

Hoops S, Sahle S, Gauges R, Lee C, Pahle J, Simus N, Singhal M, Xu L, Mendes P, Kummer U (2006) COPASI--a COmplex PAthway SImulator. Bioinformatics 22:3067-74 [Journal] [PubMed]

Hucka M, Finney A, Sauro HM, Bolouri H, Doyle JC, Kitano H, Arkin AP, Bornstein BJ, Bray D, Cornish-Bowden A, Cuellar AA, Dronov S, Gilles ED, Ginkel M, Gor V, Goryanin II, Hedley WJ, Hodgman TC, Hofmeyr JH, Hunter PJ, Juty NS, Kasberger JL, Kremling A, Kummer U, Le Novère N, Loew LM, Lucio D, Mendes P, Minch E, Mjolsness ED, Nakayama Y, Nelson MR, Nielsen PF, Sakurada T, Schaff JC, Shapiro BE, Shimizu TS, Spence HD, Stelling J, Takahashi K, Tomita M, Wagner J, Wang J, SBML Forum (2003) The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics 19:524-31 [PubMed]

Hucka M, Nickerson DP, Bader GD, Bergmann FT, Cooper J, Demir E, Garny A, Golebiewski M, Myers CJ, Schreiber F, Waltemath D, Le Novère N (2015) Promoting Coordinated Development of Community-Based Information Standards for Modeling in Biology: The COMBINE Initiative. Front Bioeng Biotechnol 3:19 [Journal] [PubMed]

Hucka M,et al (2011) A profile of today’s SBML–Compatible software Proc. IEEE e-Science Workshops :143-150

Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2:e124 [Journal] [PubMed]

Ioannidis JP (2014) How to make more published research true. PLoS Med 11:e1001747 [Journal] [PubMed]

Ioannidis JP, Allison DB, Ball CA, Coulibaly I, Cui X, Culhane AC, Falchi M, Furlanello C, Game L, Jurman G, Mangion J, Mehta T, Nitzberg M, Page GP, Petretto E, van Noort V (2009) Repeatability of published microarray gene expression analyses. Nat Genet 41:149-55 [Journal] [PubMed]

Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R (2014) Increasing value and reducing waste in research design, conduct, and analysis. Lancet 383:166-75 [Journal] [PubMed]

Juty N, Ali R, Glont M, Keating S, Rodriguez N, Swat MJ, Wimalaratne SM, Hermjakob H, Le Novère N, Laibe C, Chelliah V (2015) BioModels: Content, Features, Functionality, and Use. CPT Pharmacometrics Syst Pharmacol 4:e3 [Journal] [PubMed]

Juty N, Le Novère N, Laibe C (2012) and MIRIAM Registry: community resources to provide persistent identification. Nucleic Acids Res 40:D580-6 [Journal] [PubMed]

Krause F, Uhlendorf J, Lubitz T, Schulz M, Klipp E, Liebermeister W (2010) Annotation and merging of SBML models with semanticSBML. Bioinformatics 26:421-2 [Journal] [PubMed]

Le Novère N (2006) Model storage, exchange and integration. BMC Neurosci 7 Suppl 1:S11 [Journal] [PubMed]

Le Novère N, Finney A, Hucka M, Bhalla US, Campagne F, Collado-Vides J, Crampin EJ, Halstead M, Klipp E, Mendes P, Nielsen P, Sauro H, Shapiro B, Snoep JL, Spence HD, Wanner BL (2005) Minimum information requested in the annotation of biochemical models (MIRIAM). Nat Biotechnol 23:1509-15 [Journal] [PubMed]

Le Novère N, Hucka M, Mi H, Moodie S, Schreiber F, Sorokin A, Demir E, Wegner K, Aladjem MI, Wimalaratne SM, Bergman FT, Gauges R, Ghazal P, Kawaji H, Li L, Matsuoka Y, Villéger A, Boyd SE, Calzone L, Courtot M, Dogrusoz U, Freeman TC, Funahashi A, Ghosh S, Jouraku A, Kim S, Kolpakov F, Luna A, Sahle S, Schmidt E, Watterson S, Wu G, Goryanin I, Kell DB, Sander C, Sauro H, Snoep JL, Kohn K, Kitano H (2009) The Systems Biology Graphical Notation. Nat Biotechnol 27:735-41 [Journal] [PubMed]

Leek JT, Peng RD (2015) Opinion: Reproducible research can still be wrong: adopting a prevention approach. Proc Natl Acad Sci U S A 112:1645-6 [Journal] [PubMed]

Lehrer J (2010) The truth wears off New Yorker 13:52

Li C, Donizelli M, Rodriguez N, Dharuri H, Endler L, Chelliah V, Li L, He E, Henry A, Stefan MI, Snoep JL, Hucka M, Le Novère N, Laibe C (2010) BioModels Database: An enhanced, curated and annotated resource for published quantitative kinetic models. BMC Syst Biol 4:92 [Journal] [PubMed]

Lord P,Et Al (2006) Large-scale data sharing in the life sciences: Data standards, incentives, barriers and funding models, the joint data standards study http://www. mrc.

MacCoun R, Perlmutter S (2015) Blind analysis: Hide results to seek the truth. Nature 526:187-9 [Journal] [PubMed]

Machné R, Finney A, Müller S, Lu J, Widder S, Flamm C (2006) The SBML ODE Solver Library: a native API for symbolic and fast numerical analysis of reaction networks. Bioinformatics 22:1406-7 [Journal] [PubMed]

Mobley A, Linder SK, Braeuer R, Ellis LM, Zwelling L (2013) A survey on data reproducibility in cancer research provides insights into our limited ability to translate findings from the laboratory to the clinic. PLoS One 8:e63221 [Journal] [PubMed]

Mons B (2005) Which gene did you mean? BMC Bioinformatics 6:142 [Journal] [PubMed]

Mullard A (2011) Reliability of 'new drug target' claims called into question. Nat Rev Drug Discov 10:643-4 [Journal] [PubMed]

Murphy SN, Weber G, Mendis M, Gainer V, Chueh HC, Churchill S, Kohane I (2010) Serving the enterprise and beyond with informatics for integrating biology and the bedside (i2b2). J Am Med Inform Assoc 17:124-30 [Journal] [PubMed]

Nosek BA, Alter G, Banks GC, Borsboom D, Bowman SD, Breckler SJ, Buck S, Chambers CD, Chin G, Christensen G, Contestabile M, Dafoe A, Eich E, Freese J, Glennerster R, Goroff D, Green DP, Hesse B, Humphreys M, Ishiyama J, Karlan D, Kraut A, Lupia A, Mabry P, Madon TA, Malhotra N, Mayo-Wilson E, McNutt M, Miguel E, Paluck EL, Simonsohn U, Soderberg C, Spellman BA, Turitto J, VandenBos G, Vazire S, Wagenmakers EJ, Wilson R, Yarkoni T (2015) SCIENTIFIC STANDARDS. Promoting an open research culture. Science 348:1422-5 [Journal] [PubMed]

Nuzzo R (2015) How scientists fool themselves - and how they can stop. Nature 526:182-5 [Journal] [PubMed]

Ohagan S,Kell DB (2015) Software review: The KNIME work- flow environment and its applications in genetic programming and machine learning Genetic Program. Evolvable Mach. 16(3):387-391 [Journal]

Olivier BG, Snoep JL (2004) Web-based kinetic modelling using JWS Online. Bioinformatics 20:2143-4 [Journal] [PubMed]

Pattinson D (2014) PLOS ONE launches reproducibility initiative PLOS ONE Community Blog http://blogs.plos. org/everyone/2012/08/14/plos-one-launches-reproducibility-initiative/

Peng RD (2011) Reproducible research in computational science. Science 334:1226-7 [Journal] [PubMed]

Penkler G, du Toit F, Adams W, Rautenbach M, Palm DC, van Niekerk DD, Snoep JL (2015) Construction and validation of a detailed kinetic model of glycolysis in Plasmodium falciparum. FEBS J 282:1481-511 [Journal] [PubMed]

Piccolo SR,Et al (2015) Tools and techniques for computational reproducibility, bioRxiv

Piwowar HA, Day RS, Fridsma DB (2007) Sharing detailed research data is associated with increased citation rate. PLoS One 2:e308 [Journal] [PubMed]

Piwowar HA, Vision TJ, Whitlock MC (2011) Data archiving is a good investment. Nature 473:285 [Journal] [PubMed]

Popper K (2005) The Logic of Scientific Discovery

Prinz F, Schlange T, Asadullah K (2011) Believe it or not: how much can we rely on published data on potential drug targets? Nat Rev Drug Discov 10:712 [Journal] [PubMed]

Richard B (2014) Reproducibility undergoes scrutiny BioScience 64(4):368

Rodriguez N, Pettit JB, Dalle Pezze P, Li L, Henry A, van Iersel MP, Jalowicki G, Kutmon M, Natarajan KN, Tolnay D, Stefan MI, Evelo CT, Le Novère N (2016) The systems biology format converter. BMC Bioinformatics 17:154 [Journal] [PubMed]

Ronald P (2013) Lab life: The anatomy of a retraction Scientific American, OCT. 2013, last accessed online: 2015-08-07

Sandve GK, Nekrutenko A, Taylor J, Hovig E (2013) Ten simple rules for reproducible computational research. PLoS Comput Biol 9:e1003285 [Journal] [PubMed]

Sansone SA, Rocca-Serra P, Field D, Maguire E, Taylor C, Hofmann O, Fang H, Neumann S, Tong W, Amaral-Zettler L, Begley K, Booth T, Bougueleret L, Burns G, Chapman B, Clark T, Coleman LA, Copeland J, Das S, de Daruvar A, de Matos P, Dix I, Edmunds S, Evelo CT, Forster MJ, Gaudet P, Gilbert J, Goble C, Griffin JL, Jacob D, Kleinjans J, Harland L, Haug K, Hermjakob H, Ho Sui SJ, Laederach A, Liang S, Marshall S, McGrath A, Merrill E, Reilly D, Roux M, Shamu CE, Shang CA, Steinbeck C, Trefethen A, Williams-Jones B, Wolstencroft K, Xenarios I, Hide W (2012) Toward interoperable bioscience data. Nat Genet 44:121-6 [Journal] [PubMed]

Scharm M (2015) Combine archive show case,” University of Rostock, ostock, Germany, Tech. Rep.,

Scharm M, Wolkenhauer O, Waltemath D (2016) An algorithm to detect and communicate the differences in computational models describing biological systems. Bioinformatics 32:563-70 [Journal] [PubMed]

Scharm M,Waltemath D (2015) Extracting reproducible simulation stud- ies from model repositories using the combinearchive toolkit Datenbanksysteme fur Business, Technologie und Web, Ritter N:Henrich A:Lehner W, ed.

Schnell S (2015) Ten Simple Rules for a Computational Biologist's Laboratory Notebook. PLoS Comput Biol 11:e1004385 [Journal] [PubMed]

Sneddon TP, Zhe XS, Edmunds SC, Li P, Goodman L, Hunter CI (2014) GigaDB: promoting data dissemination and reproducibility. Database (Oxford) 2014:bau018 [Journal] [PubMed]

Stodden (2013) Setting the default to reproducible Comput. Sci. Res. SIAM News 46:4-6

Stodden V, Guo P, Ma Z (2013) Toward Reproducible Computational Research: An Empirical Analysis of Data and Code Policy Adoption by Journals. PLoS One 8:e67111 [Journal] [PubMed]

Swat MJ, Moodie S, Wimalaratne SM, Kristensen NR, Lavielle M, Mari A, Magni P, Smith MK, Bizzotto R, Pasotti L, Mezzalana E, Comets E, Sarr C, Terranova N, Blaudez E, Chan P, Chard J, Chatel K, Chenel M, Edwards D, Franklin C, Giorgino T, Glont M, Girard P, Grenon P, Harling K, Hooker AC, Kaye R, Keizer R, Kloft C, Kok JN, Kokash N, Laibe C, Laveille C, Lestini G, Mentré F, Munafo A, Nordgren R, Nyberg HB, Parra-Guillen ZP, Plan E, Ribba B, Smith G, Trocóniz IF, Yvon F, Milligan PA, Harnisch L, Karlsson M, Hermjakob H, Le Novère N (2015) Pharmacometrics Markup Language (PharmML): Opening New Perspectives for Model Exchange in Drug Development. CPT Pharmacometrics Syst Pharmacol 4:316-9 [Journal] [PubMed]

The Reproducibility Initiative (2015) Replication best practices last accessed 2015-08-03

Topalidou M, Leblois A, Boraud T, Rougier NP (2015) A long journey into reproducible computational neuroscience. Front Comput Neurosci 9:30 [Journal] [PubMed]

Waltemath D (2013) Reproducibility of model-based results in systems biology System Biology :301-320

Waltemath D (2014) Meeting report from the fourth meeting of the computational modeling in biology network (COMBINE) Standards Genomic Sci.

Waltemath D, Adams R, Beard DA, Bergmann FT, Bhalla US, Britten R, Chelliah V, Cooling MT, Cooper J, Crampin EJ, Garny A, Hoops S, Hucka M, Hunter P, Klipp E, Laibe C, Miller AK, Moraru I, Nickerson D, Nielsen P, Nikolski M, Sahle S, Sauro HM, Schmidt H, Snoep JL, Tolle D, Wolkenhauer O, Le Novère N (2011) Minimum Information About a Simulation Experiment (MIASE). PLoS Comput Biol 7:e1001122 [Journal] [PubMed]

Waltemath D, Adams R, Bergmann FT, Hucka M, Kolpakov F, Miller AK, Moraru II, Nickerson D, Sahle S, Snoep JL, Le Novère N (2011) Reproducible computational biology experiments with SED-ML--the Simulation Experiment Description Markup Language. BMC Syst Biol 5:198 [Journal] [PubMed]

Waltemath D, Karr JR, Bergmann FT, Chelliah V, Hucka M, Krantz M, Liebermeister W, Mendes P, Myers CJ, Pir P, Alaybeyoglu B, Aranganathan NK, Baghalian K, Bittig AT, Burke PE, Cantarelli M, Chew YH, Costa RS, Cursons J, Czauderna T, Goldberg AP, Gomez HF, Hahn J, Hameri T, Gardiol DF, Kazakiewicz D, Kiselev I, Knight-Schrijver V, Knupfer C, Konig M, Lee D, Lloret-Villas A, Mandrik N, Medley JK, Moreau B, Naderi-Meshkin H, Palaniappan SK, Priego-Espinosa D, Scharm M, Sharma M, Smallbone K, Stanford NJ, Song JH, Theile T, Tokic M, Tomar N, Toure V, Uhlendorf J, Varusai TM, Watanabe LH, Wendland F, Wolfien M, Yurkovich JT, Zhu Y, Zardilis A, Zhukova A, Schreiber F (2016) Toward Community Standards and Software for Whole-Cell Modeling. IEEE Trans Biomed Eng 63:2007-14 [Journal] [PubMed]

Weidemann A, Richter S, Stein M, Sahle S, Gauges R, Gabdoulline R, Surovtsova I, Semmelrock N, Besson B, Rojas I, Wade R, Kummer U (2008) SYCAMORE--a systems biology computational analysis and modeling research environment. Bioinformatics 24:1463-4 [Journal] [PubMed]

Wolstencroft K, Owen S, Krebs O, Nguyen Q, Stanford NJ, Golebiewski M, Weidemann A, Bittkowski M, An L, Shockley D, Snoep JL, Mueller W, Goble C (2015) SEEK: a systems biology data and model management platform. BMC Syst Biol 9:33 [Journal] [PubMed]

Wruck W, Peuker M, Regenbrecht CR (2014) Data management strategies for multinational large-scale systems biology projects. Brief Bioinform 15:65-78 [Journal] [PubMed]

Yu T, Lloyd CM, Nickerson DP, Cooling MT, Miller AK, Garny A, Terkildsen JR, Lawson J, Britten RD, Hunter PJ, Nielsen PM (2011) The Physiome Model Repository 2. Bioinformatics 27:743-4 [Journal] [PubMed]

(90 refs)