repeat after me: is our research reproducible (enough)?

Repeat after me: Is our research reproducible (enough)?

Lex Nederbragt

whoami

@lexnederbragt flxlexblog.wordpress.com

whatdoido

What is ‘Reproducible research’?

Wikipedia

“Reproducibility is the ability of an entire experiment or study to be reproduced

either by the researcher or by someone else working independently.

It is one of the main principles of the scientific method.”

Reproducibility: why?

TRUST

The worst case

https://www.sciencemag.org/content/334/6056/579.full.pdf

A reproducibility crisis?

Retraction rates are on the rise Murat Cokol, Fatih Ozbay & Raul Rodriguez-EstebanEMBO reports (2008) 9, 2 doi:10.1038/sj.embor.7401143

Does this affect us?

An example from our own work

2011

An example from our own work

Supplementary information, page 19-63 of 72

Are all these figures/tables reproducible?

An exercise in reproducibilityMaster student project at informatics Sabba Ifzal

Solutions

Flick: http://farm4.staticflickr.com/3319/3265787219_bfbc654b5e_o.jpg Wikimedia commons

Levels of reproducibility

Loose descriptions that are very

incomplete, no data/materials

All data, protocols, code etc

Levels of reproducibility

Loose descriptions that are very

incomplete, no data/materials

All data, protocols, code etc

Minimum effort needed to reproduce meaningfully

Reproducibility and reusability

http://upload.wikimedia.org/wikipedia/commons/4/48/Recycle.jpg

How to make your research reproducibleDocument your work

How to make your research reproducible

http://howdoitradestocks.com/wp-content/uploads/2011/12/share-ideas1.jpg

SHARE

How to make your research reproducible

SHARE

https://twitter.com/vsbuffalo/statuses/377651287133003776

How to make your research reproducible

SHARE

https://github.com/lexnederbragt

How to make your research reproducible

https://www.atlassian.com/git/workflows

Version control

How to make your research reproducible

How to make your research reproducible

http://software-carpentry.org

https://twitter.com/ctitusbrown/status/383730337811296256