aaas 2012: data about the costs and benefits of open research data
DESCRIPTION
Heather Piwowar's talk at AAAS 2012 session on Accelerating Scientific Progress Through Public Availability of Research Data http://aaas.confex.com/aaas/2012/webprogram/Session4117.htmlTRANSCRIPT
This symposium is thanks to...
Heather Piwowar @researchremix DataONE postdoc with NESCent and Dryad, at UBC
#aaasmtg 2012
Data aboutthe costs and benefits of
Open Research Data
some photos NC, SA
http://www.metmuseum.org/toah/ho/09/euwf/ho_24.45.1.htm
http://www.flickr.com/photos/jsmjr/62443357/
http://www.flickr.com/photos/camilleharrington/3587294608/
http://www.flickr.com/photos/rkuhnau/3318245976/
http://www.flickr.com/photos/conformpdx/1796399674/
http://www.flickr.com/photos/rkuhnau/3317418699/
http://www.flickr.com/photos/zemlinki/261617721/
http://www.flickr.com/photos/tracenmatt/3020786491/
http://www.flickr.com/photos/the-o/2078239333/
90%
Perry. Government Information Quarterly, 2008Tenopir et al, PLoS ONE 2011
Piwowar, ongoing data collection
but....
http://www.flickr.com/photos/davemurr/4592014327/
90%
Noor et al, PLoS Biology, 2006
but elsewhere...
45%
Piwowar PLoS ONE 2011
10-30%
Tenopir et al, PLoS ONE 2011 Campbell et al. JAMA. 2002.
Kyzas et al. J Natl Cancer Inst. 2005.Vogeli et al. Acad Med. 2006.
Reidpath et al. Bioethics 2001.
Data withholding has real costs.
5-10% papers have errors that change conclusions
Gore et al 1977, Kantoer and Taylor 1994,
McGuigan 1995, Hurlbert and White 1993
2% data fraud
Fanelli PLoS ONE 2009
50% say lack of data has restricted their ability to answer scientific questions
Vogeli et al. Acad Med. 2006 Feb; 81(2):128-36Tenopir et al, PLoS ONE 2011
Withholding not random:young, productive
Campbell et all 2000
Withholding not random:cancer
Piwowar PLoS ONE 2011
http://www.flickr.com/photos/tonivc/2283676770/
http://www.flickr.com/photos/johnnyvulkan/381941233/
are we sure it is worth it?
a) data reused?b) all the data reused?c) pain worth the gain?
a) data reused?b) all the data reused?c) pain worth the gain?
high profile success stories
what about the rest?
http://www.flickr.com/photos/jima/606588905/
Zimmerman, Tenopir, etc.
http://www.flickr.com/photos/pixscapes/4331070047
10 * 100 = 1000
• E-AFMX-12.. E-CAGE-21.. E-CAGE-52.. E-CAGE-54.. E-CAGE-56.. E-CBIL-3.. E-FPMI-6.. E-MARS-2.. E-MARS-4.. E-MAXD-5.. E-MEXP-116.. E-MEXP-17.. E-MEXP-182.. E-MEXP-191.. E-MEXP-199.. E-MEXP-218.. E-MEXP-230.. E-MEXP-233.. E-MEXP-234.. E-MEXP-237.. E-MEXP-246.. E-MEXP-250.. E-MEXP-251.. E-MEXP-257.. E-MEXP-258.. E-MEXP-268.. E-MEXP-269.. E-MEXP-273.. E-MEXP-277.. E-MEXP-283.. E-MEXP-284.. E-MEXP-288.. E-MEXP-294.. E-MEXP-297.. E-MEXP-300.. E-MEXP-301.. E-MEXP-305.. E-MEXP-306.. E-MEXP-307.. E-MEXP-309.. E-MEXP-310.. E-MEXP-314.. E-MEXP-318.. E-MEXP-321.. E-MEXP-322.. E-MEXP-324.. E-MEXP-334.. E-MEXP-338.. E-MEXP-350.. E-MEXP-355.. E-MEXP-359.. E-MEXP-360.. E-MEXP-362.. E-MEXP-364.. E-MEXP-369.. E-MEXP-370.. E-MEXP-373.. E-MEXP-375.. E-MEXP-378.. E-MEXP-381.. E-MEXP-382.. E-MEXP-384.. E-MEXP-386.. E-MEXP-388.. E-MEXP-390.. E-MEXP-393.. E-MEXP-394.. E-MEXP-399.. E-MEXP-405.. E-MEXP-410.. E-MEXP-411.. E-MEXP-412.. E-MEXP-414.. E-MEXP-415.. E-MEXP-416.. E-MEXP-417.. E-MEXP-418.. E-MEXP-422.. E-MEXP-423.. E-MEXP-427.. E-MEXP-429.. E-MEXP-432.. E-MEXP-437.. E-MEXP-438.. E-MEXP-439.. E-MEXP-442.. E-MEXP-443.. E-MEXP-449.. E-MEXP-451.. E-MEXP-459.. E-MEXP-465.. E-MEXP-468.. E-MEXP-469.. E-MEXP-470.. E-MEXP-474.. E-MEXP-482.. E-MEXP-483.. E-MEXP-484.. E-MEXP-486.. E-MEXP-489.. E-MEXP-491.. E-MEXP-498.. E-MEXP-504.. E-MEXP-508.. E-MEXP-513.. E-MEXP-515.. E-MEXP-517.. E-MEXP-88.. E-MIMR-42.. E-MIMR-43.. E-MNIA-66.. E-MNIA-67.. E-MNIA-69.. E-MNIA-73.. E-NASC-45.. E-NASC-49.. E-NASC-55.. E-RZPD-11.. E-RZPD-14.. E-RZPD-18.. E-RZPD-21.. E-TABM-11.. E-TABM-14.. E-TABM-24.. E-TABM-27.. E-TABM-29.. E-TABM-3.. E-TABM-30.. E-TABM-37.. E-TABM-40.. E-TABM-42.. E-TABM-44.. E-TABM-51.. E-TABM-56.. E-TABM-61.. E-TABM-64.. E-TABM-65.. E-TABM-67.. E-TIGR-121.. E-TIGR-122.. E-TIGR-128.. E-TOXM-11.. E-TOXM-16.. E-TOXM-17.. E-TOXM-20.. E-UMCU-11.. E-UMCU-15.. E-UMCU-18.. E-UMCU-20.. E-UMCU-21.. BMRB.. 6453.. 6454.. 6455.. 6457.. 6458.. 6460.. 6467.. 6468.. 6469.. 6470.. 6473.. 6475.. 6476.. 6478.. 6480.. 6481.. 6483.. 6484.. 6489.. 6503.. 6505.. 6506.. 6517.. 6518.. 6519.. 6520.. 6527.. 6531.. 6532.. 6536.. 6538.. 6546.. 6553.. 6555.. 6563.. 6570.. 6571.. 6575.. 6577.. 6579.. 6581.. 6583.. 6587.. 6588.. 6589.. 6590.. 6594.. 6596.. 6597.. 6600.. 6609.. 6610.. 6612.. 6624.. 6626.. 6642.. 6645.. 6648.. 6649.. 6655.. 6679.. 6680.. 6687.. 6688.. 6689.. 6693.. 6699.. 6705.. 6709.. 6712.. 6715.. 6721.. 6724.. 6727.. 6730.. 6738.. 6739.. 6740.. 6746.. 6747.. 6753.. 6754.. 6769.. 6771.. 6779.. 6783.. 6786.. 6788.. 6805.. 6806.. 6808.. 6816.. 6821.. 6824.. 6826.. 6833.. 6834.. 6840.. 6841.. 6850.. 6851.. 6854.. 6865.. 6866.. 6868.. 6869.. 6877.. 6883.. 6893.. 6900.. 6902.. 6908.. 6913.. 6916.. 6918.. 6920.. 6926.. 6927.. 6928.. GEO.. GSE1165.. GSE1173.. GSE1174.. GSE1175.. GSE1191.. GSE1205.. GSE1220.. GSE1236.. GSE1241.. GSE1243.. GSE1244.. GSE1255.. GSE1397.. GSE1434.. GSE1455.. GSE1557.. GSE1610.. GSE1656.. GSE1707.. GSE1772.. GSE1782.. GSE1818.. GSE1843.. GSE1849.. GSE1862.. GSE1875.. GSE1876.. GSE1914.. GSE1920.. GSE1957.. GSE2014.. GSE2058.. GSE2095.. GSE2104.. GSE2122.. GSE2132.. GSE2133.. GSE2144.. GSE2151.. GSE2191.. GSE2208.. GSE2239.. GSE2259.. GSE2266.. GSE2273.. GSE2289.. GSE2349.. GSE2350.. GSE2378.. GSE2418.. GSE2434.. GSE2464.. GSE2472.. GSE2499.. GSE2512.. GSE2520.. GSE2552.. GSE2578.. GSE2603.. GSE2617.. GSE2620.. GSE2626.. GSE2641.. GSE2657.. GSE2672.. GSE2689.. GSE2701.. GSE2719.. GSE2772.. GSE2781.. GSE2787.. GSE2855.. GSE2868.. GSE2880.. GSE2890.. GSE2896.. GSE2899.. GSE2953.. GSE2956.. GSE2978.. GSE3013.. GSE3053.. GSE3060.. GSE3065.. GSE3137.. GSE3138.. GSE3184.. GSE3214.. GSE3224.. GSE3236.. GSE3238.. GSE3271.. GSE3292.. GSE3321.. GSE3358.. GSE3398.. GSE3411.. GSE3462.. GSE3525.. GSE3551.. GSE3554.. GSE3564.. GSE3570.. GSE3594.. GSE3658.. GSE3663.. GSE3677.. GSE3739.. GSE3755.. GSE3771.. GSE3777.. GSE3791.. GSE3857.. GSE3862.. GSE3878.. GSE3889.. GSE3904.. GSE3913.. GSE3922.. GSE3933.. GSE3956.. GSE988.. GEOROC.. 7176.. 7177.. 7178.. 7180.. 7241.. 7252.. 7306.. 7402.. 7403.. 7505.. 7507.. 7508.. 7509.. 7510.. 7517.. 7521.. 7526.. 7527.. 7529.. 7568.. 7702.. 7703.. 7713.. 7767.. 7768.. 7770.. 7792.. 7862.. 7863.. 7865.. 7866.. 7878.. 7966.. 7978.. 8035.. 8036.. 8074.. 8183.. 8185.. 8186.. 8312.. 8491.. 8493.. 8495.. 8496.. 8497.. 8498.. 8501.. 8504.. 8505.. 8512.. 8513.. 8514.. 8515.. 8517.. 8518.. 8520.. 8521.. 8528.. 8529.. 8530.. 8531.. 8651.. 8657.. 8659.. 8662.. 8663.. 8669.. 8692.. 8701.. 8704.. 8741.. 8743.. 8786.. 8809.. 8879.. 8880.. 8899.. 8900.. 9022.. 9027.. 9165.. 9582.. 9709.. 9871.. 10002.. 10056.. 10589.. 10592.. 10596.. 10597.. 10705.. 10892.. 10915.. 11143.. 11231.. 11357.. 11404.. 11417.. 11636.. 11637.. 11918.. 11959.. 11985.. 11987.. 12041.. 12195.. 12196.. 12641.. 12982.. 13131.. 13163.. 13690.. 13762.. 14015.. 14097.. 14234.. 14418.. 14632.. HEPData.. p1.. p1039.. p1047.. p1113.. p1115.. p1116.. p1118.. p1120.. p1121.. p1122.. p1123.. p1308.. p1333.. p1336.. p1337.. p1338.. p1341.. p1342.. p1343.. p1344.. p1345.. p1346.. p1347.. p1348.. p1350.. p1351.. p1355.. p1931.. p3095.. p3096.. p3097.. p3098.. p3099.. p3100.. p336.. p366.. p368.. p369.. p376.. p377.. p378.. p379.. p38.. p380.. p381.. p4266.. p4310.. p4640.. p4641.. p4642.. p4643.. p5113.. p5128.. p5129.. p5880.. p5881.. p628.. p6847.. p6855.. p6856.. p6862.. p6866.. p727.. p728.. p730.. p731.. p732.. p733.. p734.. p735.. p736.. p737.. p738.. p739.. p741.. p75.. p7594.. p76.. p7654.. p7663.. p7948.. p7977.. p7998.. p7999.. p8011.. p8012.. p8027.. p990.. p991.. p992.. p993.. ICPSR.. 1306.. 1307.. 1308.. 1309.. 1310.. 1311.. 1312.. 1313.. 1314.. 1315.. 1317.. 1319.. 1320.. 1321.. IQSS.. hdl:1902.1/10043.. hdl:1902.1/10045.. hdl:1902.1/10046.. hdl:1902.1/10047.. hdl:1902.1/10048.. hdl:1902.1/10052.. hdl:1902.1/10053.. hdl:1902.1/10054.. hdl:1902.1/10098.. hdl:1902.1/15500.. JournalArchive.. . . . .. Kevin Dobbin and Richard Simon.. Rickey E. Carter, Stuart R. Li.. Xiangqin Cui, J. T. Gene Hwang.. Sin-Ho Jung, Heejung Bang, and.. Michael P. Fay. Random margina.. Ina Hoeschele and Hua Li. A no.. Binbing Yu and Joseph L. Gastw.. Brenda F. Kurland and Patrick .. Sonia Hernández, David O. Sieg.. Ola Hössjer. Conditional likel.. Anne-Mette K. Hein, Sylvia Ric.. M. Fiocco, H. Putter, and J. C.. Lars Ängquist and Ola Hössjer... R. Mcnamee. Optimal design and.. K. Alec Chrystal and Paul Mize.. Glenn D. Rudebusch. Assessing .. Mikael Apel, Richard Friberg, .. Dogan Tirtiroglu, Kenneth N. D.. Lucio Sarno, Daniel L. Thornto.. Michael W. McCracken and Steph.. Jan J.J. Groen. Exchange Rate.. Ray Yeutien Chou . Forecasting.. Ellen E. Meade and D. Nathan S.. Alan C. Hess and Avraham Kamar.. Huw Lloyd-Ellis, Shiqiang Zhan.. Michael M. Hutchison and Ilan .. Ali Anari, James Kolari, and J.. Alan S. Blinder and John Morga.. Ming Chien Lo and Jeremy Piger.. David E. Rapach and Mark E. Wo.. Katherine S. Neiss and Edward .. A. P. Vogler, A. Cardoso, T. G.. Y.M. Yuan, S. Wolhauser, M. Mö.. K. G. McCracken and M. D. Sore.. R. C. Winkworeth, D. Bryant, P.. T. Sasaki, M. Nikaido, H. Hami.. "K. Roelants and F. Bossuyt.. . A".. JEROME C. REGIER, ULRICH PAUKS.. Matthew C. Brandley, Andreas S.. Peng Zhang, Hui Zhou, Yue-Qin .. "Ziheng Yang and Bruce Rannala.. ".. Robert V. Hill. Integration of.. Matt Lavin, Patrick S. Herende.. Martyn Kennedy, Barbara R. Hol.. Regina L. Cunha, Rita Castilho.. Dennis V. Lavrov and B. Franz .. Alexandra H. Wortley, Paula J... Tine Huyse and Filip A. M. Vol.. Céline Poux, Ole Madsen, Elisa.. Henner Brinkmann, Mark van der.. David W. Weisrock, Luke J. Har.. John J. Wiens, James W. Fetzne.. Fengrong Ren, Hiroshi Tanaka, .. Philippe Gaubert, W. Chris Woz.. Casey W. Dunn, Philip R. Pugh,.. Louise A. Lewis and Paul O. Le.. Bart Cockx and Muriel Dejemepp.. Robert Sollis. Evidence on Pur.. Jeffrey M. Wooldridge. Simple .. Fabio Canova. The Transmission.. Vasco M. Carvalho and Andrew C.. D. Harding and A. R. Pagan. A .. Chang-Jin Kim, James Morley, a.. Gert Peersman. What caused the.. Smets, F. and R. Wouters. Comp.. . . Journal of Applied Econome.. Christopher R. Bollinger and M.. Sanghamitra Das, Charles F. Ma.. X. Gong, A. van Soest, and P. .. Joachim Grammig, Reinhard Huje.. Krishna Pendakur. Semiparametr.. Mahmoud A. El-Gamal and Hulusi.. Cheng Hsiao, Yan Shen, and Hir.. Zacharias Psaradakis, Morten O.. Achim Zeileis and Christian Kl.. Dennis Fok, Dick van Dijk, and.. Libertad González. Nonparametr.. Gary Koop, Dale Poirier and Ju.. Juan M. Rodriguez-Poo, Stefan .. Troy Davig. Periodically Expan.. J. Fernandez-Villaverde and J... Fernando Fernández-Rodríguez, .. Peter R. Hansen and Asger Lund.. Shin-Ichi Nishiyama. The Cross.. "Andrew McLennan .. . The Expecte".. Joris Pinkse and Guofu Tan . T.. Steven G. Rivkin, Eric A. Hanu.. Ovidiu L. Calin, Yu Chen, Thom.. Kenneth A. Small, Clifford Win.. Peter Arcidiacono . Affirmativ.. David Card, and Dean R. Hyslop.. Dirk Bergemann and Stephen Mor.. Fernando Alvarez and Urban J. .. I-Hui Cheng and Howard J. Wall.. Ellen E. Meade . The FOMC: Pre.. Thomas A. Garrett and Russell .. Thomas A. Garrett, Rubén Herná.. Christopher H. Wheeler . Evide.. . . The Federal Reserve Bank o.. Hui Guo and Kevin L. Kliesen ... Christopher J. Neely . An Ana.. "Robert Shimer.. . The Cyclical B".. Abdul Abiad and Ashoka Mody. F.. "Tack Yun.. . Optimal Monetary Po".. Alan J. Auerbach and Maurice O.. John H. Cochrane and Monika Pi.. Òscar Jordà. Estimation and In.. Jeremy Greenwood, Ananth Sesha.. Daniel M. Bernhofen and John C.. José Wynne. Wealth as a Determ.. Bhagwan Chowdhry, Richard Roll.. Gary S. Becker, Tomas J. Phili.. Carolyn L. Evans and James Har.. Daniel Diermeier, Michael Kean.. Wolfram Schlenker, W. Michael .. Costas Meghir and Mårten Palme.. Refet S. Gürkaynak, Brian Sack.. Sandra E. Black, Paul J. Dever.. Peter Thompson and Melanie Fox.. "Eric Neumayer.. . Asylum Recogni".. Yoav Gortzak, Yoram Z. Haftel,.. Akan Malici. Discord and Colla.. Christian Davenport. Understan.. Mirjam E. Sørli, Nils Petter G.. Walter Enders and Todd Sandler.. "Quan Li.. . Does Democracy Promo".. Carlos Pestana Barros and Isab.. Patrick M. Regan and Daniel No.. "Gil Friedman.. . Commercial Paci".. Ahmer Tarar. Constituencies an.. Benjamin E. Goldsmith, Yusaku .. James D. Fearon. Primary Commo.. Macartan Humphreys. Natural Re.. Päivi Lujala, Nils Petter Gled.. Michael Horowitz, Rose McDermo.. Jaroslav Tir. Keeping the Peac.. Mary Caprioli and Peter F. Tru.. Uk Heo and Robert J. Eger III... Beth A. Simmons. Rules over Re.. Joseph Paul Vasquez III. Shoul.. Michael Koch and Scott Sigmund.. Eric Neumayer. Do Internationa.. Ron, James; Howard Ramos; and .. Neumayer, Eric (2005). Bogus R.. "Mullenbach, Mark J. (2005). .. .".. Starr, Harvey and G. Dale Thom.. Shadlen, Kenneth C.; Andrew Sc.. Fordham, Benjamin O. and Thoma.. Brooks, Sarah M. (2005). Inter.. Lai, Brian, and Dan Reiter (20.. Sobek, David (2005). Machiave.. Caprioli, Mary (2005). Primed .. Keller, Jonathan W. (2005). Le.. Greig, J. Michael and Paul F. .. Emilie M. Hafner-Burton. Right.. David H. Bearce & Sawa Omori ... Navin Bapat . Insurgency and t.. Lesley G. Terris & Zeev Maoz. .. Lotta Harbom & Peter Wallenste.. Atsushi Tago. Determinants of .. Jaroslav Tir. Dividing Countri.. Hyung Min Kim & David L. Rouss.. Marie L. Besançon. Relative Re.. Henrik Urdal. People vs. Malth.. Quan Li & Ming Wen. The Immedi.. Karen Rasler & William R. Thom.. James Meernik. Justice and Pea.. Christina Schatzman . Politica.. Jacob Shamir & Khalil Shikaki .. Douglas M. Gibler, Toby J. Rid.. Ron P. Smith & Ali Tasiran. Th.. Erik Melander . Political Gend.. J. Joseph Hewitt. A Crisis-Den.. Charles R. Boehmer & David Sob.. Karl R. DeRouen Jr & Shaun Gol.. Vally Koubi. War and Economic .. Yehudith Auerbach & Yaeli Bloc.. Eric Neumayer. Inequality and .. link to google search results.. imported to Mendeley?.. PDB.. 1OHO.. 1PK3.. 1RJC.. 1S7Y.. 1SB2.. 1SK0.. 1T2B.. 1T4R.. 1TB0.. 1TCU.. 1TI8.. 1TJR.. 1TL6.. 1TT9.. 1TTO.. 1TZ1.. 1U3H.. 1U6T.. 1U72.. 1U9Q.. 1UWA.. 1V9X.. 1VBJ.. 1VDN.. 1VGK.. 1VGP.. 1W6G.. 1W78.. 1W8U.. 1W9X.. 1WA9.. 1WBU.. 1WCY.. 1WEL.. 1WLM.. 1WNM.. 1WRY.. 1WV0.. 1WVL.. 1WY3.. 1WZ5.. 1WZL.. 1X32.. 1X37.. 1X5E.. 1X6B.. 1X7A.. 1X8C.. 1XKF.. 1XLN.. 1XO2.. 1XQQ.. 1XQX.. 1XRO.. 1XSF.. 1XSX.. 1XWR.. 1XY9.. 1XYR.. 1XYU.. 1XZ8.. 1Y0J.. 1Y1Q.. 1Y1U.. 1Y32.. 1Y3A.. 1Y3W.. 1Y4C.. 1Y8K.. 1YD6.. 1YF4.. 1YHG.. 1YIG.. 1YJI.. 1YJJ.. 1YKQ.. 1YLA.. 1YLR.. 1YN9.. 1YO8.. 1YOB.. 1YQ2.. 1YSH.. 1YSW.. 1YVI.. 1YXN.. 1YZE.. 1YZR.. 1YZS.. 1Z16.. 1Z4R.. 1Z73.. 1Z75.. 1Z92.. 1Z9G.. 1ZI9.. 1ZJ2.. 1ZKM.. 1ZL6.. 1ZND.. 1ZQ9.. 1ZR5.. 1ZRB.. 1ZRS.. 1ZWM.. 1ZX8.. 2A0J.. 2A1X.. 2A3L.. 2A4F.. 2A5D.. 2A77.. 2A78.. 2A8M.. 2A9M.. 2ACV.. 2ADJ.. 2AFT.. 2AV4.. 2AXY.. 2B0O.. 2B6A.. 2B7O.. 2BAK.. 2BE4.. 2BGY.. 2BH8.. 2BHM.. 2BLV.. 2BO7.. 2BRL.. 2BU1.. 2BUJ.. 2BV3.. 2BW2.. 2BYD.. 2BZ8.. 2C0X.. 2C1N.. 2C3D.. 2C3Q.. 2C43.. 2CR8.. 2CRL.. 2CVJ.. 2D2S.. 2ET4.. 2F8M.. 2FDS.. title.. article reference.. TreeBASE.. S1096.. S1153.. S1171.. S1191.. S1203.. S1212.. S1215.. S1223.. S1224.. S1225.. S1227.. S1228.. S1229.. S1230.. S1231.. S1232.. S1234.. S1235.. S1236.. S1237.. S1242.. S1243.. S1244.. S1247.. S1249.. S1250.. S1252.. S1253.. S1256.. S1257.. S1258.. S1260.. S1261.. S1262.. S1263.. S1265.. S1267.. S1268.. S1270.. S1271.. S1273.. S1274.. S1275.. S1276.. S1277.. S1278.. S1279.. S1281.. S1282.. S1284.. S1285.. S1290.. S1291.. S1292.. S1293.. S1294.. S1298.. S1301.. S1302.. S1303.. S1305.. S1306.. S1307.. S1309.. S1310.. S1311.. S1313.. S1314.. S1316.. S1319.. S1323.. S1324.. S1325.. S1326.. S1327.. S1330.. S1333.. S1334.. S1335.. S1336.. S1338.. S1339.. S1341.. S1343.. S1344.. S1347.. S1349.. S1350.. S1351.. S1352.. S1354.. S1355.. S1356.. S1358.. S1359.. S1360.. S1362.. S1363.. S1364.. S1368.. S1369.. S1372.. S1373.. S1375.. S1377.. S1378.. S1379.. S1381.. S1383.. S1384.. S1385.. S1386.. S1388.. S1389.. S1390.. S1392.. S1395.. S1400.. S1403.. S1413.. S1415.. S1416.. S1418.. S1419.. S1425.. S1430.. S1455.. S1458.. S1460.. S1463.. S1472.. S1485.. S1500.. S1512.. S1551.. S1567.. S1594.. S1601.. S1648.. S2116.. S2144.. (blank).. (blank).. Pangaea.. http://doi.pangaea.de/10.1594/PANGAEA.206394.. http://doi.pangaea.de/10.1594/PANGAEA.230042.. http://doi.pangaea.de/10.1594/PANGAEA.315658.. http://doi.pangaea.de/10.1594/PANGAEA.319950.. http://doi.pangaea.de/10.1594/PANGAEA.328911.. http://doi.pangaea.de/10.1594/PANGAEA.339110.. http://doi.pangaea.de/10.1594/PANGAEA.370797.. http://doi.pangaea.de/10.1594/PANGAEA.472208.. http://doi.pangaea.de/10.1594/PANGAEA.484677.. http://doi.pangaea.de/10.1594/PANGAEA.56129.. http://doi.pangaea.de/10.1594/PANGAEA.670929.. http://doi.pangaea.de/10.1594/PANGAEA.672035.. http://doi.pangaea.de/10.1594/PANGAEA.676688.. http://doi.pangaea.de/10.1594/PANGAEA.676892.. http://doi.pangaea.de/10.1594/PANGAEA.684703.. http://doi.pangaea.de/10.1594/PANGAEA.685594.. http://doi.pangaea.de/10.1594/PANGAEA.688263.. http://doi.pangaea.de/10.1594/PANGAEA.690658.. http://doi.pangaea.de/10.1594/PANGAEA.690848.. http://doi.pangaea.de/10.1594/PANGAEA.691304.. http://doi.pangaea.de/10.1594/PANGAEA.691478.. http://doi.pangaea.de/10.1594/PANGAEA.694086.. http://doi.pangaea.de/10.1594/PANGAEA.700959.. http://doi.pangaea.de/10.1594/PANGAEA.701279.. http://doi.pangaea.de/10.1594/PANGAEA.704257.. http://doi.pangaea.de/10.1594/PANGAEA.707898.. http://doi.pangaea.de/10.1594/PANGAEA.708249.. http://doi.pangaea.de/10.1594/PANGAEA.710774.. http://doi.pangaea.de/10.1594/PANGAEA.710788.. http://doi.pangaea.de/10.1594/PANGAEA.710795.. http://doi.pangaea.de/10.1594/PANGAEA.711337.. http://doi.pangaea.de/10.1594/PANGAEA.711520.. http://doi.pangaea.de/10.1594/PANGAEA.711534.. http://doi.pangaea.de/10.1594/PANGAEA.711655.. http://doi.pangaea.de/10.1594/PANGAEA.711656.. http://doi.pangaea.de/10.1594/PANGAEA.711985.. http://doi.pangaea.de/10.1594/PANGAEA.711998.. http://doi.pangaea.de/10.1594/PANGAEA.712921.. http://doi.pangaea.de/10.1594/PANGAEA.712938.. http://doi.pangaea.de/10.1594/PANGAEA.713701.. http://doi.pangaea.de/10.1594/PANGAEA.720961.. http://doi.pangaea.de/10.1594/PANGAEA.721804.. http://doi.pangaea.de/10.1594/PANGAEA.722600.. http://doi.pangaea.de/10.1594/PANGAEA.722622.. http://doi.pangaea.de/10.1594/PANGAEA.726861.. http://doi.pangaea.de/10.1594/PANGAEA.727523.. http://doi.pangaea.de/10.1594/PANGAEA.728138.. http://doi.pangaea.de/10.1594/PANGAEA.728219.. http://doi.pangaea.de/10.1594/PANGAEA.728220.. http://doi.pangaea.de/10.1594/PANGAEA.733691.. http://doi.pangaea.de/10.1594/PANGAEA.736818.. http://doi.pangaea.de/10.1594/PANGAEA.736977.. http://doi.pangaea.de/10.1594/PANGAEA.738239.. http://doi.pangaea.de/10.1594/PANGAEA.738240.. http://doi.pangaea.de/10.1594/PANGAEA.738241.. http://doi.pangaea.de/10.1594/PANGAEA.738242.. http://doi.pangaea.de/10.1594/PANGAEA.738246.. http://doi.pangaea.de/10.1594/PANGAEA.738255.. http://doi.pangaea.de/10.1594/PANGAEA.738263.. http://doi.pangaea.de/10.1594/PANGAEA.738265.. http://doi.pangaea.de/10.1594/PANGAEA.738279.. http://doi.pangaea.de/10.1594/PANGAEA.738282.. http://doi.pangaea.de/10.1594/PANGAEA.738377.. http://doi.pangaea.de/10.1594/PANGAEA.738441.. http://doi.pangaea.de/10.1594/PANGAEA.738561.. http://
!"
#!!"
$!!"
%!!"
&!!"
'!!"
(!!"
$!!'" $!!(" $!!)" $!!*" $!!+" $!#!"
,-./010"
.023040"
5-6"
./7"
7897"
:;<=20>0=?@AB4C"
5-696D"
E=4470C4"
F==0G"-HI=4CC"
cumulative use of 100 datasets, by repo
1) a new lease on life
Traditional research funding:$400k = 16 papers
At Dryad cost levels,at similar levels of reuse to GEO, $400k would facilitate 1000 reuse papers
A stellar Scientific ROI is in easy reach.
2) more impact per funding dollar
Piwowar, Vision, Whitlock (2011) Data archiving is a good investment. Nature 473, 285
http://researchremix.wordpress.com/2011/05/19/nature-letter/
a) data reused?b) all the data reused?c) pain worth the gain?
PLoS ONE, 2010: 83%
We have observed reuse of at 35% of GEO datasets submitted in 2005.
a) are data reused?b) are all the data reused?c) is the pain worth the gain?
http://www.flickr.com/photos/ryanr/142455033/
Study of attitudes, experiences
- online questionnaire- corresponding authors- 40 journals- 3 years
Data collection ongoing...please do not disseminate widely.
worried that...
worried that...
worried that...
worried that...
worried that...
http://www.flickr.com/photos/sunrise/35819369/
~70% in multivariate analysis
Gleditsch et al. 2003. Posting Your Data: Will You Be Scooped or Will You Be Famous?, International Studies Perspectives 4(1): 89–97.
Ioannidis et al. Repeatability of published microarray gene expression analyses. Nature Genetics 41, 149 - 155
Pienta et al. 2010. NSR Social Science Secondary Use. Michigan IR.
Henneken et al. 2011. Linking to Data – Effect on Citation Rates in Astronomy. ESO.
Sears 2011. Data Sharing Effect on Article Citation rate in Paleoceanography. AGU.
a) data reusedb) lots of the data reusedc) pain worth the gain
so what do we do about it?
http://www.flickr.com/photos/bfhoyt/4606049592/
Journal policies
Odds Ratio
0.25 0.50 1.00 2.00 4.00 8.00
Has journal policy0.95Count of R01 & other NIH grants
Authors prev GEOAE sharing & OA & microarray creation
NO K funding or P funding
Institution high citations & collaboration
Journal impact
Journal policy consequences & long halflife
NOT animals or mice
Instititution is government & NOT higher ed
Last author num prev pubs & first year pub
Large NIH grant
Humans & cancer
NO geo reuse + YES high institution output
First author num prev pubs & first year pub
Multivariate nonlinear regressions with interactions
Odds Ratio
0.25 0.50 1.00 2.00 4.00 8.00
Has journal policy0.95Count of R01 & other NIH grants
Authors prev GEOAE sharing & OA & microarray creation
NO K funding or P funding
Journal impact
Journal policy consequences & long halflife
Institution high citations & collaboration
NOT animals or mice
Instititution is government & NOT higher ed
Last author num prev pubs & first year pub
Large NIH grant
Humans & cancer
NO geo reuse + YES high institution output
First author num prev pubs & first year pub
Multivariate nonlinear regressions with interactions
High-impact journals
tend to have
a strong data-sharing
policy
JDAP
only 33% opt for embargos
Funder policies
if no consequences, no impact
Piwowar and Chapman. Journal of Informetrics 2010
http://www.nsf.gov/pubs/policydocs/pappguide/nsf08_1/gpg_2.jsp
Demonstrable impact
http://dx.doi.org/10.5061/dryad.18
http://www.icpsr.umich.edu/icpsrweb/ICPSR/studies/3131/utilization
...but then bring it back to the science
demonstrating that value will be the biggest win
... our first next steps ...
1. raise our expectations
http://www.flickr.com/photos/quinnanya/2055471833
2. raise our glasses
http://www.flickr.com/photos/tncountryfan/6233406182
(+ join in)
3. raise our voices
http://www.flickr.com/photos/imfphoto/6173673196/
http://www.flickr.com/photos/huzzahvintage/4577075021/
http://www.flickr.com/photos/supersam5/216868485/
thank youTodd Vision,
Mike WhitlockJonathan Carlson, Estephanie Sta Maria, Jason Priem, total-Impact and Beyond Impact
The open science online community and those who release their articles, datasets and photos openly
blog: ResearchRemix.wordpress.com@researchremix
http://www.flickr.com/photos/joshb/25983792
http://www.flickr.com/photos/joshb/25983792
http://www.flickr.com/photos/joshb/25983792
http://www.flickr.com/photos/joshb/25983792
http://www.flickr.com/photos/joshb/25983792
http://www.flickr.com/photos/commissariat/4829261601/in/faves-30112411@N02/
http://www.flickr.com/photos/joshb/25983792