aaas 2012: data about the costs and benefits of open research data

109
This symposium is thanks to...

Upload: heather-piwowar

Post on 01-Nov-2014

688 views

Category:

Education


1 download

DESCRIPTION

Heather Piwowar's talk at AAAS 2012 session on Accelerating Scientific Progress Through Public Availability of Research Data http://aaas.confex.com/aaas/2012/webprogram/Session4117.html

TRANSCRIPT

Page 1: AAAS 2012: Data about the costs and benefits of Open Research DAta

This symposium is thanks to...

Page 2: AAAS 2012: Data about the costs and benefits of Open Research DAta

Heather  Piwowar  @researchremix  DataONE  postdoc  with  NESCent  and  Dryad,  at  UBC

#aaasmtg  2012  

Data aboutthe costs and benefits of

Open Research Data

some photos NC, SA

Page 3: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.metmuseum.org/toah/ho/09/euwf/ho_24.45.1.htm

Page 4: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/jsmjr/62443357/

Page 5: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/camilleharrington/3587294608/

Page 6: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/rkuhnau/3318245976/

Page 7: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/conformpdx/1796399674/

Page 8: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/rkuhnau/3317418699/

Page 9: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/zemlinki/261617721/

Page 10: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/tracenmatt/3020786491/

Page 11: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/the-o/2078239333/

Page 12: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 13: AAAS 2012: Data about the costs and benefits of Open Research DAta

90%

Perry. Government Information Quarterly, 2008Tenopir et al, PLoS ONE 2011

Piwowar, ongoing data collection

Page 14: AAAS 2012: Data about the costs and benefits of Open Research DAta

but....

Page 16: AAAS 2012: Data about the costs and benefits of Open Research DAta

90%

Noor et al, PLoS Biology, 2006

Page 17: AAAS 2012: Data about the costs and benefits of Open Research DAta

but elsewhere...

Page 18: AAAS 2012: Data about the costs and benefits of Open Research DAta

45%

Piwowar PLoS ONE 2011

Page 19: AAAS 2012: Data about the costs and benefits of Open Research DAta

10-30%

Tenopir et al, PLoS ONE 2011 Campbell et al. JAMA. 2002.

Kyzas et al. J Natl Cancer Inst. 2005.Vogeli et al. Acad Med. 2006.

Reidpath et al. Bioethics 2001.

Page 20: AAAS 2012: Data about the costs and benefits of Open Research DAta

Data withholding has real costs.

Page 21: AAAS 2012: Data about the costs and benefits of Open Research DAta

5-10% papers have errors that change conclusions

Gore et al 1977, Kantoer and Taylor 1994,

McGuigan 1995, Hurlbert and White 1993

Page 22: AAAS 2012: Data about the costs and benefits of Open Research DAta

2% data fraud

Fanelli PLoS ONE 2009

Page 23: AAAS 2012: Data about the costs and benefits of Open Research DAta

50% say lack of data has restricted their ability to answer scientific questions

Vogeli et al. Acad Med. 2006 Feb; 81(2):128-36Tenopir et al, PLoS ONE 2011

Page 24: AAAS 2012: Data about the costs and benefits of Open Research DAta

Withholding not random:young, productive

Campbell et all 2000

Page 25: AAAS 2012: Data about the costs and benefits of Open Research DAta

Withholding not random:cancer

Piwowar PLoS ONE 2011

Page 26: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 28: AAAS 2012: Data about the costs and benefits of Open Research DAta

are we sure it is worth it?

Page 29: AAAS 2012: Data about the costs and benefits of Open Research DAta

a) data reused?b) all the data reused?c) pain worth the gain?

Page 30: AAAS 2012: Data about the costs and benefits of Open Research DAta

a) data reused?b) all the data reused?c) pain worth the gain?

Page 31: AAAS 2012: Data about the costs and benefits of Open Research DAta

high profile success stories

Page 32: AAAS 2012: Data about the costs and benefits of Open Research DAta

what about the rest?

Page 33: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/jima/606588905/

Zimmerman, Tenopir, etc.

Page 35: AAAS 2012: Data about the costs and benefits of Open Research DAta

10 * 100 = 1000

Page 36: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 37: AAAS 2012: Data about the costs and benefits of Open Research DAta

• E-AFMX-12.. E-CAGE-21.. E-CAGE-52.. E-CAGE-54.. E-CAGE-56.. E-CBIL-3.. E-FPMI-6.. E-MARS-2.. E-MARS-4.. E-MAXD-5.. E-MEXP-116.. E-MEXP-17.. E-MEXP-182.. E-MEXP-191.. E-MEXP-199.. E-MEXP-218.. E-MEXP-230.. E-MEXP-233.. E-MEXP-234.. E-MEXP-237.. E-MEXP-246.. E-MEXP-250.. E-MEXP-251.. E-MEXP-257.. E-MEXP-258.. E-MEXP-268.. E-MEXP-269.. E-MEXP-273.. E-MEXP-277.. E-MEXP-283.. E-MEXP-284.. E-MEXP-288.. E-MEXP-294.. E-MEXP-297.. E-MEXP-300.. E-MEXP-301.. E-MEXP-305.. E-MEXP-306.. E-MEXP-307.. E-MEXP-309.. E-MEXP-310.. E-MEXP-314.. E-MEXP-318.. E-MEXP-321.. E-MEXP-322.. E-MEXP-324.. E-MEXP-334.. E-MEXP-338.. E-MEXP-350.. E-MEXP-355.. E-MEXP-359.. E-MEXP-360.. E-MEXP-362.. E-MEXP-364.. E-MEXP-369.. E-MEXP-370.. E-MEXP-373.. E-MEXP-375.. E-MEXP-378.. E-MEXP-381.. E-MEXP-382.. E-MEXP-384.. E-MEXP-386.. E-MEXP-388.. E-MEXP-390.. E-MEXP-393.. E-MEXP-394.. E-MEXP-399.. E-MEXP-405.. E-MEXP-410.. E-MEXP-411.. E-MEXP-412.. E-MEXP-414.. E-MEXP-415.. E-MEXP-416.. E-MEXP-417.. E-MEXP-418.. E-MEXP-422.. E-MEXP-423.. E-MEXP-427.. E-MEXP-429.. E-MEXP-432.. E-MEXP-437.. E-MEXP-438.. E-MEXP-439.. E-MEXP-442.. E-MEXP-443.. E-MEXP-449.. E-MEXP-451.. E-MEXP-459.. E-MEXP-465.. E-MEXP-468.. E-MEXP-469.. E-MEXP-470.. E-MEXP-474.. E-MEXP-482.. E-MEXP-483.. E-MEXP-484.. E-MEXP-486.. E-MEXP-489.. E-MEXP-491.. E-MEXP-498.. E-MEXP-504.. E-MEXP-508.. E-MEXP-513.. E-MEXP-515.. E-MEXP-517.. E-MEXP-88.. E-MIMR-42.. E-MIMR-43.. E-MNIA-66.. E-MNIA-67.. E-MNIA-69.. E-MNIA-73.. E-NASC-45.. E-NASC-49.. E-NASC-55.. E-RZPD-11.. E-RZPD-14.. E-RZPD-18.. E-RZPD-21.. E-TABM-11.. E-TABM-14.. E-TABM-24.. E-TABM-27.. E-TABM-29.. E-TABM-3.. E-TABM-30.. E-TABM-37.. E-TABM-40.. E-TABM-42.. E-TABM-44.. E-TABM-51.. E-TABM-56.. E-TABM-61.. E-TABM-64.. E-TABM-65.. E-TABM-67.. E-TIGR-121.. E-TIGR-122.. E-TIGR-128.. E-TOXM-11.. E-TOXM-16.. E-TOXM-17.. E-TOXM-20.. E-UMCU-11.. E-UMCU-15.. E-UMCU-18.. E-UMCU-20.. E-UMCU-21.. BMRB.. 6453.. 6454.. 6455.. 6457.. 6458.. 6460.. 6467.. 6468.. 6469.. 6470.. 6473.. 6475.. 6476.. 6478.. 6480.. 6481.. 6483.. 6484.. 6489.. 6503.. 6505.. 6506.. 6517.. 6518.. 6519.. 6520.. 6527.. 6531.. 6532.. 6536.. 6538.. 6546.. 6553.. 6555.. 6563.. 6570.. 6571.. 6575.. 6577.. 6579.. 6581.. 6583.. 6587.. 6588.. 6589.. 6590.. 6594.. 6596.. 6597.. 6600.. 6609.. 6610.. 6612.. 6624.. 6626.. 6642.. 6645.. 6648.. 6649.. 6655.. 6679.. 6680.. 6687.. 6688.. 6689.. 6693.. 6699.. 6705.. 6709.. 6712.. 6715.. 6721.. 6724.. 6727.. 6730.. 6738.. 6739.. 6740.. 6746.. 6747.. 6753.. 6754.. 6769.. 6771.. 6779.. 6783.. 6786.. 6788.. 6805.. 6806.. 6808.. 6816.. 6821.. 6824.. 6826.. 6833.. 6834.. 6840.. 6841.. 6850.. 6851.. 6854.. 6865.. 6866.. 6868.. 6869.. 6877.. 6883.. 6893.. 6900.. 6902.. 6908.. 6913.. 6916.. 6918.. 6920.. 6926.. 6927.. 6928.. GEO.. GSE1165.. GSE1173.. GSE1174.. GSE1175.. GSE1191.. GSE1205.. GSE1220.. GSE1236.. GSE1241.. GSE1243.. GSE1244.. GSE1255.. GSE1397.. GSE1434.. GSE1455.. GSE1557.. GSE1610.. GSE1656.. GSE1707.. GSE1772.. GSE1782.. GSE1818.. GSE1843.. GSE1849.. GSE1862.. GSE1875.. GSE1876.. GSE1914.. GSE1920.. GSE1957.. GSE2014.. GSE2058.. GSE2095.. GSE2104.. GSE2122.. GSE2132.. GSE2133.. GSE2144.. GSE2151.. GSE2191.. GSE2208.. GSE2239.. GSE2259.. GSE2266.. GSE2273.. GSE2289.. GSE2349.. GSE2350.. GSE2378.. GSE2418.. GSE2434.. GSE2464.. GSE2472.. GSE2499.. GSE2512.. GSE2520.. GSE2552.. GSE2578.. GSE2603.. GSE2617.. GSE2620.. GSE2626.. GSE2641.. GSE2657.. GSE2672.. GSE2689.. GSE2701.. GSE2719.. GSE2772.. GSE2781.. GSE2787.. GSE2855.. GSE2868.. GSE2880.. GSE2890.. GSE2896.. GSE2899.. GSE2953.. GSE2956.. GSE2978.. GSE3013.. GSE3053.. GSE3060.. GSE3065.. GSE3137.. GSE3138.. GSE3184.. GSE3214.. GSE3224.. GSE3236.. GSE3238.. GSE3271.. GSE3292.. GSE3321.. GSE3358.. GSE3398.. GSE3411.. GSE3462.. GSE3525.. GSE3551.. GSE3554.. GSE3564.. GSE3570.. GSE3594.. GSE3658.. GSE3663.. GSE3677.. GSE3739.. GSE3755.. GSE3771.. GSE3777.. GSE3791.. GSE3857.. GSE3862.. GSE3878.. GSE3889.. GSE3904.. GSE3913.. GSE3922.. GSE3933.. GSE3956.. GSE988.. GEOROC.. 7176.. 7177.. 7178.. 7180.. 7241.. 7252.. 7306.. 7402.. 7403.. 7505.. 7507.. 7508.. 7509.. 7510.. 7517.. 7521.. 7526.. 7527.. 7529.. 7568.. 7702.. 7703.. 7713.. 7767.. 7768.. 7770.. 7792.. 7862.. 7863.. 7865.. 7866.. 7878.. 7966.. 7978.. 8035.. 8036.. 8074.. 8183.. 8185.. 8186.. 8312.. 8491.. 8493.. 8495.. 8496.. 8497.. 8498.. 8501.. 8504.. 8505.. 8512.. 8513.. 8514.. 8515.. 8517.. 8518.. 8520.. 8521.. 8528.. 8529.. 8530.. 8531.. 8651.. 8657.. 8659.. 8662.. 8663.. 8669.. 8692.. 8701.. 8704.. 8741.. 8743.. 8786.. 8809.. 8879.. 8880.. 8899.. 8900.. 9022.. 9027.. 9165.. 9582.. 9709.. 9871.. 10002.. 10056.. 10589.. 10592.. 10596.. 10597.. 10705.. 10892.. 10915.. 11143.. 11231.. 11357.. 11404.. 11417.. 11636.. 11637.. 11918.. 11959.. 11985.. 11987.. 12041.. 12195.. 12196.. 12641.. 12982.. 13131.. 13163.. 13690.. 13762.. 14015.. 14097.. 14234.. 14418.. 14632.. HEPData.. p1.. p1039.. p1047.. p1113.. p1115.. p1116.. p1118.. p1120.. p1121.. p1122.. p1123.. p1308.. p1333.. p1336.. p1337.. p1338.. p1341.. p1342.. p1343.. p1344.. p1345.. p1346.. p1347.. p1348.. p1350.. p1351.. p1355.. p1931.. p3095.. p3096.. p3097.. p3098.. p3099.. p3100.. p336.. p366.. p368.. p369.. p376.. p377.. p378.. p379.. p38.. p380.. p381.. p4266.. p4310.. p4640.. p4641.. p4642.. p4643.. p5113.. p5128.. p5129.. p5880.. p5881.. p628.. p6847.. p6855.. p6856.. p6862.. p6866.. p727.. p728.. p730.. p731.. p732.. p733.. p734.. p735.. p736.. p737.. p738.. p739.. p741.. p75.. p7594.. p76.. p7654.. p7663.. p7948.. p7977.. p7998.. p7999.. p8011.. p8012.. p8027.. p990.. p991.. p992.. p993.. ICPSR.. 1306.. 1307.. 1308.. 1309.. 1310.. 1311.. 1312.. 1313.. 1314.. 1315.. 1317.. 1319.. 1320.. 1321.. IQSS.. hdl:1902.1/10043.. hdl:1902.1/10045.. hdl:1902.1/10046.. hdl:1902.1/10047.. hdl:1902.1/10048.. hdl:1902.1/10052.. hdl:1902.1/10053.. hdl:1902.1/10054.. hdl:1902.1/10098.. hdl:1902.1/15500.. JournalArchive.. . . . .. Kevin Dobbin and Richard Simon.. Rickey E. Carter, Stuart R. Li.. Xiangqin Cui, J. T. Gene Hwang.. Sin-Ho Jung, Heejung Bang, and.. Michael P. Fay. Random margina.. Ina Hoeschele and Hua Li. A no.. Binbing Yu and Joseph L. Gastw.. Brenda F. Kurland and Patrick .. Sonia Hernández, David O. Sieg.. Ola Hössjer. Conditional likel.. Anne-Mette K. Hein, Sylvia Ric.. M. Fiocco, H. Putter, and J. C.. Lars Ängquist and Ola Hössjer... R. Mcnamee. Optimal design and.. K. Alec Chrystal and Paul Mize.. Glenn D. Rudebusch. Assessing .. Mikael Apel, Richard Friberg, .. Dogan Tirtiroglu, Kenneth N. D.. Lucio Sarno, Daniel L. Thornto.. Michael W. McCracken and Steph.. Jan J.J. Groen. Exchange Rate.. Ray Yeutien Chou . Forecasting.. Ellen E. Meade and D. Nathan S.. Alan C. Hess and Avraham Kamar.. Huw Lloyd-Ellis, Shiqiang Zhan.. Michael M. Hutchison and Ilan .. Ali Anari, James Kolari, and J.. Alan S. Blinder and John Morga.. Ming Chien Lo and Jeremy Piger.. David E. Rapach and Mark E. Wo.. Katherine S. Neiss and Edward .. A. P. Vogler, A. Cardoso, T. G.. Y.M. Yuan, S. Wolhauser, M. Mö.. K. G. McCracken and M. D. Sore.. R. C. Winkworeth, D. Bryant, P.. T. Sasaki, M. Nikaido, H. Hami.. "K. Roelants and F. Bossuyt.. . A".. JEROME C. REGIER, ULRICH PAUKS.. Matthew C. Brandley, Andreas S.. Peng Zhang, Hui Zhou, Yue-Qin .. "Ziheng Yang and Bruce Rannala.. ".. Robert V. Hill. Integration of.. Matt Lavin, Patrick S. Herende.. Martyn Kennedy, Barbara R. Hol.. Regina L. Cunha, Rita Castilho.. Dennis V. Lavrov and B. Franz .. Alexandra H. Wortley, Paula J... Tine Huyse and Filip A. M. Vol.. Céline Poux, Ole Madsen, Elisa.. Henner Brinkmann, Mark van der.. David W. Weisrock, Luke J. Har.. John J. Wiens, James W. Fetzne.. Fengrong Ren, Hiroshi Tanaka, .. Philippe Gaubert, W. Chris Woz.. Casey W. Dunn, Philip R. Pugh,.. Louise A. Lewis and Paul O. Le.. Bart Cockx and Muriel Dejemepp.. Robert Sollis. Evidence on Pur.. Jeffrey M. Wooldridge. Simple .. Fabio Canova. The Transmission.. Vasco M. Carvalho and Andrew C.. D. Harding and A. R. Pagan. A .. Chang-Jin Kim, James Morley, a.. Gert Peersman. What caused the.. Smets, F. and R. Wouters. Comp.. . . Journal of Applied Econome.. Christopher R. Bollinger and M.. Sanghamitra Das, Charles F. Ma.. X. Gong, A. van Soest, and P. .. Joachim Grammig, Reinhard Huje.. Krishna Pendakur. Semiparametr.. Mahmoud A. El-Gamal and Hulusi.. Cheng Hsiao, Yan Shen, and Hir.. Zacharias Psaradakis, Morten O.. Achim Zeileis and Christian Kl.. Dennis Fok, Dick van Dijk, and.. Libertad González. Nonparametr.. Gary Koop, Dale Poirier and Ju.. Juan M. Rodriguez-Poo, Stefan .. Troy Davig. Periodically Expan.. J. Fernandez-Villaverde and J... Fernando Fernández-Rodríguez, .. Peter R. Hansen and Asger Lund.. Shin-Ichi Nishiyama. The Cross.. "Andrew McLennan .. . The Expecte".. Joris Pinkse and Guofu Tan . T.. Steven G. Rivkin, Eric A. Hanu.. Ovidiu L. Calin, Yu Chen, Thom.. Kenneth A. Small, Clifford Win.. Peter Arcidiacono . Affirmativ.. David Card, and Dean R. Hyslop.. Dirk Bergemann and Stephen Mor.. Fernando Alvarez and Urban J. .. I-Hui Cheng and Howard J. Wall.. Ellen E. Meade . The FOMC: Pre.. Thomas A. Garrett and Russell .. Thomas A. Garrett, Rubén Herná.. Christopher H. Wheeler . Evide.. . . The Federal Reserve Bank o.. Hui Guo and Kevin L. Kliesen ... Christopher J. Neely . An Ana.. "Robert Shimer.. . The Cyclical B".. Abdul Abiad and Ashoka Mody. F.. "Tack Yun.. . Optimal Monetary Po".. Alan J. Auerbach and Maurice O.. John H. Cochrane and Monika Pi.. Òscar Jordà. Estimation and In.. Jeremy Greenwood, Ananth Sesha.. Daniel M. Bernhofen and John C.. José Wynne. Wealth as a Determ.. Bhagwan Chowdhry, Richard Roll.. Gary S. Becker, Tomas J. Phili.. Carolyn L. Evans and James Har.. Daniel Diermeier, Michael Kean.. Wolfram Schlenker, W. Michael .. Costas Meghir and Mårten Palme.. Refet S. Gürkaynak, Brian Sack.. Sandra E. Black, Paul J. Dever.. Peter Thompson and Melanie Fox.. "Eric Neumayer.. . Asylum Recogni".. Yoav Gortzak, Yoram Z. Haftel,.. Akan Malici. Discord and Colla.. Christian Davenport. Understan.. Mirjam E. Sørli, Nils Petter G.. Walter Enders and Todd Sandler.. "Quan Li.. . Does Democracy Promo".. Carlos Pestana Barros and Isab.. Patrick M. Regan and Daniel No.. "Gil Friedman.. . Commercial Paci".. Ahmer Tarar. Constituencies an.. Benjamin E. Goldsmith, Yusaku .. James D. Fearon. Primary Commo.. Macartan Humphreys. Natural Re.. Päivi Lujala, Nils Petter Gled.. Michael Horowitz, Rose McDermo.. Jaroslav Tir. Keeping the Peac.. Mary Caprioli and Peter F. Tru.. Uk Heo and Robert J. Eger III... Beth A. Simmons. Rules over Re.. Joseph Paul Vasquez III. Shoul.. Michael Koch and Scott Sigmund.. Eric Neumayer. Do Internationa.. Ron, James; Howard Ramos; and .. Neumayer, Eric (2005). Bogus R.. "Mullenbach, Mark J. (2005). .. .".. Starr, Harvey and G. Dale Thom.. Shadlen, Kenneth C.; Andrew Sc.. Fordham, Benjamin O. and Thoma.. Brooks, Sarah M. (2005). Inter.. Lai, Brian, and Dan Reiter (20.. Sobek, David (2005). Machiave.. Caprioli, Mary (2005). Primed .. Keller, Jonathan W. (2005). Le.. Greig, J. Michael and Paul F. .. Emilie M. Hafner-Burton. Right.. David H. Bearce & Sawa Omori ... Navin Bapat . Insurgency and t.. Lesley G. Terris & Zeev Maoz. .. Lotta Harbom & Peter Wallenste.. Atsushi Tago. Determinants of .. Jaroslav Tir. Dividing Countri.. Hyung Min Kim & David L. Rouss.. Marie L. Besançon. Relative Re.. Henrik Urdal. People vs. Malth.. Quan Li & Ming Wen. The Immedi.. Karen Rasler & William R. Thom.. James Meernik. Justice and Pea.. Christina Schatzman . Politica.. Jacob Shamir & Khalil Shikaki .. Douglas M. Gibler, Toby J. Rid.. Ron P. Smith & Ali Tasiran. Th.. Erik Melander . Political Gend.. J. Joseph Hewitt. A Crisis-Den.. Charles R. Boehmer & David Sob.. Karl R. DeRouen Jr & Shaun Gol.. Vally Koubi. War and Economic .. Yehudith Auerbach & Yaeli Bloc.. Eric Neumayer. Inequality and .. link to google search results.. imported to Mendeley?.. PDB.. 1OHO.. 1PK3.. 1RJC.. 1S7Y.. 1SB2.. 1SK0.. 1T2B.. 1T4R.. 1TB0.. 1TCU.. 1TI8.. 1TJR.. 1TL6.. 1TT9.. 1TTO.. 1TZ1.. 1U3H.. 1U6T.. 1U72.. 1U9Q.. 1UWA.. 1V9X.. 1VBJ.. 1VDN.. 1VGK.. 1VGP.. 1W6G.. 1W78.. 1W8U.. 1W9X.. 1WA9.. 1WBU.. 1WCY.. 1WEL.. 1WLM.. 1WNM.. 1WRY.. 1WV0.. 1WVL.. 1WY3.. 1WZ5.. 1WZL.. 1X32.. 1X37.. 1X5E.. 1X6B.. 1X7A.. 1X8C.. 1XKF.. 1XLN.. 1XO2.. 1XQQ.. 1XQX.. 1XRO.. 1XSF.. 1XSX.. 1XWR.. 1XY9.. 1XYR.. 1XYU.. 1XZ8.. 1Y0J.. 1Y1Q.. 1Y1U.. 1Y32.. 1Y3A.. 1Y3W.. 1Y4C.. 1Y8K.. 1YD6.. 1YF4.. 1YHG.. 1YIG.. 1YJI.. 1YJJ.. 1YKQ.. 1YLA.. 1YLR.. 1YN9.. 1YO8.. 1YOB.. 1YQ2.. 1YSH.. 1YSW.. 1YVI.. 1YXN.. 1YZE.. 1YZR.. 1YZS.. 1Z16.. 1Z4R.. 1Z73.. 1Z75.. 1Z92.. 1Z9G.. 1ZI9.. 1ZJ2.. 1ZKM.. 1ZL6.. 1ZND.. 1ZQ9.. 1ZR5.. 1ZRB.. 1ZRS.. 1ZWM.. 1ZX8.. 2A0J.. 2A1X.. 2A3L.. 2A4F.. 2A5D.. 2A77.. 2A78.. 2A8M.. 2A9M.. 2ACV.. 2ADJ.. 2AFT.. 2AV4.. 2AXY.. 2B0O.. 2B6A.. 2B7O.. 2BAK.. 2BE4.. 2BGY.. 2BH8.. 2BHM.. 2BLV.. 2BO7.. 2BRL.. 2BU1.. 2BUJ.. 2BV3.. 2BW2.. 2BYD.. 2BZ8.. 2C0X.. 2C1N.. 2C3D.. 2C3Q.. 2C43.. 2CR8.. 2CRL.. 2CVJ.. 2D2S.. 2ET4.. 2F8M.. 2FDS.. title.. article reference.. TreeBASE.. S1096.. S1153.. S1171.. S1191.. S1203.. S1212.. S1215.. S1223.. S1224.. S1225.. S1227.. S1228.. S1229.. S1230.. S1231.. S1232.. S1234.. S1235.. S1236.. S1237.. S1242.. S1243.. S1244.. S1247.. S1249.. S1250.. S1252.. S1253.. S1256.. S1257.. S1258.. S1260.. S1261.. S1262.. S1263.. S1265.. S1267.. S1268.. S1270.. S1271.. S1273.. S1274.. S1275.. S1276.. S1277.. S1278.. S1279.. S1281.. S1282.. S1284.. S1285.. S1290.. S1291.. S1292.. S1293.. S1294.. S1298.. S1301.. S1302.. S1303.. S1305.. S1306.. S1307.. S1309.. S1310.. S1311.. S1313.. S1314.. S1316.. S1319.. S1323.. S1324.. S1325.. S1326.. S1327.. S1330.. S1333.. S1334.. S1335.. S1336.. S1338.. S1339.. S1341.. S1343.. S1344.. S1347.. S1349.. S1350.. S1351.. S1352.. S1354.. S1355.. S1356.. S1358.. S1359.. S1360.. S1362.. S1363.. S1364.. S1368.. S1369.. S1372.. S1373.. S1375.. S1377.. S1378.. S1379.. S1381.. S1383.. S1384.. S1385.. S1386.. S1388.. S1389.. S1390.. S1392.. S1395.. S1400.. S1403.. S1413.. S1415.. S1416.. S1418.. S1419.. S1425.. S1430.. S1455.. S1458.. S1460.. S1463.. S1472.. S1485.. S1500.. S1512.. S1551.. S1567.. S1594.. S1601.. S1648.. S2116.. S2144.. (blank).. (blank).. Pangaea.. http://doi.pangaea.de/10.1594/PANGAEA.206394.. http://doi.pangaea.de/10.1594/PANGAEA.230042.. http://doi.pangaea.de/10.1594/PANGAEA.315658.. http://doi.pangaea.de/10.1594/PANGAEA.319950.. http://doi.pangaea.de/10.1594/PANGAEA.328911.. http://doi.pangaea.de/10.1594/PANGAEA.339110.. http://doi.pangaea.de/10.1594/PANGAEA.370797.. http://doi.pangaea.de/10.1594/PANGAEA.472208.. http://doi.pangaea.de/10.1594/PANGAEA.484677.. http://doi.pangaea.de/10.1594/PANGAEA.56129.. http://doi.pangaea.de/10.1594/PANGAEA.670929.. http://doi.pangaea.de/10.1594/PANGAEA.672035.. http://doi.pangaea.de/10.1594/PANGAEA.676688.. http://doi.pangaea.de/10.1594/PANGAEA.676892.. http://doi.pangaea.de/10.1594/PANGAEA.684703.. http://doi.pangaea.de/10.1594/PANGAEA.685594.. http://doi.pangaea.de/10.1594/PANGAEA.688263.. http://doi.pangaea.de/10.1594/PANGAEA.690658.. http://doi.pangaea.de/10.1594/PANGAEA.690848.. http://doi.pangaea.de/10.1594/PANGAEA.691304.. http://doi.pangaea.de/10.1594/PANGAEA.691478.. http://doi.pangaea.de/10.1594/PANGAEA.694086.. http://doi.pangaea.de/10.1594/PANGAEA.700959.. http://doi.pangaea.de/10.1594/PANGAEA.701279.. http://doi.pangaea.de/10.1594/PANGAEA.704257.. http://doi.pangaea.de/10.1594/PANGAEA.707898.. http://doi.pangaea.de/10.1594/PANGAEA.708249.. http://doi.pangaea.de/10.1594/PANGAEA.710774.. http://doi.pangaea.de/10.1594/PANGAEA.710788.. http://doi.pangaea.de/10.1594/PANGAEA.710795.. http://doi.pangaea.de/10.1594/PANGAEA.711337.. http://doi.pangaea.de/10.1594/PANGAEA.711520.. http://doi.pangaea.de/10.1594/PANGAEA.711534.. http://doi.pangaea.de/10.1594/PANGAEA.711655.. http://doi.pangaea.de/10.1594/PANGAEA.711656.. http://doi.pangaea.de/10.1594/PANGAEA.711985.. http://doi.pangaea.de/10.1594/PANGAEA.711998.. http://doi.pangaea.de/10.1594/PANGAEA.712921.. http://doi.pangaea.de/10.1594/PANGAEA.712938.. http://doi.pangaea.de/10.1594/PANGAEA.713701.. http://doi.pangaea.de/10.1594/PANGAEA.720961.. http://doi.pangaea.de/10.1594/PANGAEA.721804.. http://doi.pangaea.de/10.1594/PANGAEA.722600.. http://doi.pangaea.de/10.1594/PANGAEA.722622.. http://doi.pangaea.de/10.1594/PANGAEA.726861.. http://doi.pangaea.de/10.1594/PANGAEA.727523.. http://doi.pangaea.de/10.1594/PANGAEA.728138.. http://doi.pangaea.de/10.1594/PANGAEA.728219.. http://doi.pangaea.de/10.1594/PANGAEA.728220.. http://doi.pangaea.de/10.1594/PANGAEA.733691.. http://doi.pangaea.de/10.1594/PANGAEA.736818.. http://doi.pangaea.de/10.1594/PANGAEA.736977.. http://doi.pangaea.de/10.1594/PANGAEA.738239.. http://doi.pangaea.de/10.1594/PANGAEA.738240.. http://doi.pangaea.de/10.1594/PANGAEA.738241.. http://doi.pangaea.de/10.1594/PANGAEA.738242.. http://doi.pangaea.de/10.1594/PANGAEA.738246.. http://doi.pangaea.de/10.1594/PANGAEA.738255.. http://doi.pangaea.de/10.1594/PANGAEA.738263.. http://doi.pangaea.de/10.1594/PANGAEA.738265.. http://doi.pangaea.de/10.1594/PANGAEA.738279.. http://doi.pangaea.de/10.1594/PANGAEA.738282.. http://doi.pangaea.de/10.1594/PANGAEA.738377.. http://doi.pangaea.de/10.1594/PANGAEA.738441.. http://doi.pangaea.de/10.1594/PANGAEA.738561.. http://

Page 38: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 39: AAAS 2012: Data about the costs and benefits of Open Research DAta

!"

#!!"

$!!"

%!!"

&!!"

'!!"

(!!"

$!!'" $!!(" $!!)" $!!*" $!!+" $!#!"

,-./010"

.023040"

5-6"

./7"

7897"

:;<=20>0=?@AB4C"

5-696D"

E=4470C4"

F==0G"-HI=4CC"

cumulative use of 100 datasets, by repo

Page 40: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 41: AAAS 2012: Data about the costs and benefits of Open Research DAta

1) a new lease on life

Page 42: AAAS 2012: Data about the costs and benefits of Open Research DAta

Traditional research funding:$400k = 16 papers

At Dryad cost levels,at similar levels of reuse to GEO, $400k would facilitate 1000 reuse papers

A stellar Scientific ROI is in easy reach.

2) more impact per funding dollar

Page 43: AAAS 2012: Data about the costs and benefits of Open Research DAta

Piwowar, Vision, Whitlock (2011) Data archiving is a good investment. Nature 473, 285

http://researchremix.wordpress.com/2011/05/19/nature-letter/

Page 44: AAAS 2012: Data about the costs and benefits of Open Research DAta

a) data reused?b) all the data reused?c) pain worth the gain?

Page 45: AAAS 2012: Data about the costs and benefits of Open Research DAta

PLoS ONE, 2010: 83%

Page 46: AAAS 2012: Data about the costs and benefits of Open Research DAta

We have observed reuse of at 35% of GEO datasets submitted in 2005.

Page 47: AAAS 2012: Data about the costs and benefits of Open Research DAta

a) are data reused?b) are all the data reused?c) is the pain worth the gain?

Page 49: AAAS 2012: Data about the costs and benefits of Open Research DAta

Study of attitudes, experiences

- online questionnaire- corresponding authors- 40 journals- 3 years

Data collection ongoing...please do not disseminate widely.

Page 50: AAAS 2012: Data about the costs and benefits of Open Research DAta

worried  that...

Page 51: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 52: AAAS 2012: Data about the costs and benefits of Open Research DAta

worried  that...

Page 53: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 54: AAAS 2012: Data about the costs and benefits of Open Research DAta

worried  that...

Page 55: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 56: AAAS 2012: Data about the costs and benefits of Open Research DAta

worried  that...

Page 57: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 58: AAAS 2012: Data about the costs and benefits of Open Research DAta

worried  that...

Page 59: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 61: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 62: AAAS 2012: Data about the costs and benefits of Open Research DAta

~70% in multivariate analysis

Page 63: AAAS 2012: Data about the costs and benefits of Open Research DAta

Gleditsch et al. 2003. Posting Your Data: Will You Be Scooped or Will You Be Famous?, International Studies Perspectives 4(1): 89–97.

Ioannidis et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149 - 155

Pienta et al. 2010. NSR Social Science Secondary Use. Michigan IR.

Henneken et al. 2011. Linking to Data – Effect on Citation Rates in Astronomy. ESO.

Sears 2011. Data Sharing Effect on Article Citation rate in Paleoceanography. AGU.

Page 64: AAAS 2012: Data about the costs and benefits of Open Research DAta

a) data reusedb) lots of the data reusedc) pain worth the gain

Page 65: AAAS 2012: Data about the costs and benefits of Open Research DAta

so what do we do about it?

Page 67: AAAS 2012: Data about the costs and benefits of Open Research DAta

Journal policies

Page 68: AAAS 2012: Data about the costs and benefits of Open Research DAta

Odds Ratio

0.25 0.50 1.00 2.00 4.00 8.00

Has journal policy0.95Count of R01 & other NIH grants

Authors prev GEOAE sharing & OA & microarray creation

NO K funding or P funding

Institution high citations & collaboration

Journal impact

Journal policy consequences & long halflife

NOT animals or mice

Instititution is government & NOT higher ed

Last author num prev pubs & first year pub

Large NIH grant

Humans & cancer

NO geo reuse + YES high institution output

First author num prev pubs & first year pub

Multivariate nonlinear regressions with interactions

Odds Ratio

0.25 0.50 1.00 2.00 4.00 8.00

Has journal policy0.95Count of R01 & other NIH grants

Authors prev GEOAE sharing & OA & microarray creation

NO K funding or P funding

Journal impact

Journal policy consequences & long halflife

Institution high citations & collaboration

NOT animals or mice

Instititution is government & NOT higher ed

Last author num prev pubs & first year pub

Large NIH grant

Humans & cancer

NO geo reuse + YES high institution output

First author num prev pubs & first year pub

Multivariate nonlinear regressions with interactions

Page 69: AAAS 2012: Data about the costs and benefits of Open Research DAta

High-impact journals

tend to have

a strong data-sharing

policy

Page 70: AAAS 2012: Data about the costs and benefits of Open Research DAta

JDAP

Page 71: AAAS 2012: Data about the costs and benefits of Open Research DAta

only 33% opt for embargos

Page 72: AAAS 2012: Data about the costs and benefits of Open Research DAta

Funder policies

Page 73: AAAS 2012: Data about the costs and benefits of Open Research DAta

if no consequences, no impact

Page 74: AAAS 2012: Data about the costs and benefits of Open Research DAta

Piwowar and Chapman. Journal of Informetrics 2010

Page 75: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 76: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 78: AAAS 2012: Data about the costs and benefits of Open Research DAta

Demonstrable impact

Page 79: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 80: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 83: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 84: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://total-impact.org

Page 85: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://total-impact.org

Page 86: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://total-impact.org

Page 87: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://total-impact.org

Page 88: AAAS 2012: Data about the costs and benefits of Open Research DAta
Page 89: AAAS 2012: Data about the costs and benefits of Open Research DAta

...but then bring it back to the science

Page 90: AAAS 2012: Data about the costs and benefits of Open Research DAta

demonstrating that value will be the biggest win

Page 91: AAAS 2012: Data about the costs and benefits of Open Research DAta

... our first next steps ...

Page 92: AAAS 2012: Data about the costs and benefits of Open Research DAta

1. raise our expectations

Page 94: AAAS 2012: Data about the costs and benefits of Open Research DAta

2. raise our glasses

Page 96: AAAS 2012: Data about the costs and benefits of Open Research DAta

(+ join in)

Page 97: AAAS 2012: Data about the costs and benefits of Open Research DAta

3. raise our voices

Page 99: AAAS 2012: Data about the costs and benefits of Open Research DAta

http://www.flickr.com/photos/huzzahvintage/4577075021/

Page 101: AAAS 2012: Data about the costs and benefits of Open Research DAta

thank youTodd Vision,

Mike WhitlockJonathan Carlson, Estephanie Sta Maria, Jason Priem, total-Impact and Beyond Impact

The open science online community and those who release their articles, datasets and photos openly

blog: ResearchRemix.wordpress.com@researchremix

Page 102: AAAS 2012: Data about the costs and benefits of Open Research DAta