![Page 1: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/1.jpg)
Research software best practices: Transparency,
credit, and citation
Alice Allen Astrophysics Source Code Library
ascl.net
![Page 2: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/2.jpg)
Research software
Integrity of research depends on transparency and reproducibility
“… anything less than release of actual source code is an indefensible approach for any scientific results that depend on computation...”
Ince, Hatton, & Graham-Cumming, The case for open computer programs, Nature, v. 482, Feb. 23, 2012
![Page 3: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/3.jpg)
Efforts Underway
• Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE)
• CodeMeta project • Force11 Software Citation Working Group • Center for Open Science's
Transparency and Openness Promotion (TOP) Guidelines
• Engineering Academic Software at Dagstuhl
![Page 4: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/4.jpg)
Force11 Software Citation Principles
• Importance • Credit and attribution • Unique identification • Persistence • Accessibility
https://peerj.com/articles/cs-86/
![Page 5: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/5.jpg)
Dagstuhl Manifesto on Citation
• I will make explicit how to cite my software.
• I will cite the software I used to produce my research results.
• When reviewing, I will encourage others to cite the software they have used.
https://dl.dropboxusercontent.com/u/11565521/dagstuhl-eas-manifesto-2016-12-02.pdf
![Page 6: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/6.jpg)
Astrophysics Source Code Library
(ASCL, ascl.net)
![Page 7: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/7.jpg)
![Page 8: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/8.jpg)
Number of code entries at year end, 2010 - 2016
124
374
567747
974
1179
1407
0
300
600
900
1200
1500
2010 2011 2012 2013 2014 2015 2016
![Page 9: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/9.jpg)
![Page 10: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/10.jpg)
No one can assume that valuable innovations will pop up magically in the public domain if their inventors received no reward for their labor and capital.
- Richard Epstein
![Page 11: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/11.jpg)
Cumulative number of citations to ASCL entries in ADS by year
33 102229
507
977
1375
0
200
400
600
800
1000
1200
1400
1600
2012 2013 2014 2015 2016 2017
![Page 12: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/12.jpg)
Citations by journal
MNRAS32%
ApJ23%
A&A10%
arXiv9%
AJ7%
Other19%
![Page 13: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/13.jpg)
Benefits of the ASCL Improves transparency of research
Aids in software discovery
Provides way to cite software separately from papers
Assigns DOIs for codes housed on ASCL
Reliability of data
![Page 14: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/14.jpg)
You can change the world! (Or at least a little piece of it!)
Release your code
Specify how you want your code to be cited
License your code
Register your code
Archive your code somewhere
![Page 15: Research software best practices: Transparency, credit ...ascl.net/.../uploads/2017/07/AllenA_EWASS2017ASCL.pdf · Alice Allen Astrophysics Source Code Library ascl.net . Research](https://reader035.vdocuments.us/reader035/viewer/2022070722/5ee433e7ad6a402d666d7bc8/html5/thumbnails/15.jpg)
Dagstuhl Manifesto on Citation
• I will make explicit how to cite my software.
• I will cite the software I used to produce my research results.
• When reviewing, I will encourage others to cite the software they have used.
https://dl.dropboxusercontent.com/u/11565521/dagstuhl-eas-manifesto-2016-12-02.pdf