software-native metrics: depsy lessons learned
TRANSCRIPT
![Page 1: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/1.jpg)
#3amconfSept2016
HeatherPiwowarandJasonPriem@ImpactStory
software-native metrics
![Page 2: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/2.jpg)
![Page 3: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/3.jpg)
![Page 4: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/4.jpg)
![Page 5: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/5.jpg)
depsy.org
![Page 6: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/6.jpg)
![Page 7: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/7.jpg)
10.1038/529115a
![Page 8: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/8.jpg)
https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
![Page 9: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/9.jpg)
depsy.org
![Page 10: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/10.jpg)
![Page 11: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/11.jpg)
![Page 12: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/12.jpg)
![Page 13: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/13.jpg)
![Page 14: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/14.jpg)
launched last November
....what did people think?
![Page 15: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/15.jpg)
![Page 16: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/16.jpg)
![Page 17: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/17.jpg)
![Page 18: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/18.jpg)
some areas we weren’t sure about, but feedback suggested we got right
![Page 19: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/19.jpg)
public profiles for everybody!
![Page 20: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/20.jpg)
an overall score, with equal weighting to 3 components
![Page 21: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/21.jpg)
downloads, log transformed vs ranked, and display for interprebility, with percentiles
![Page 22: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/22.jpg)
pagerankto weight or not to weight, displayed in interpretable way
![Page 23: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/23.jpg)
citations
![Page 24: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/24.jpg)
authorship weighting (committers vs pypi author vs maintainer)
![Page 25: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/25.jpg)
![Page 26: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/26.jpg)
and some big requests
![Page 27: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/27.jpg)
biggest one: pull in new data from GitHub
![Page 28: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/28.jpg)
expected:
more package library systems (esp bioconductor)
more languages (import detection complexity)
more platforms like bitbucket (esp to get commit history for authorship)
better deduplication (no orcid, alas)
things that aren't on a version control system at all (not happening)
![Page 29: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/29.jpg)
outstanding challenge:
deciding what is a research package (important b/c refset matters)
![Page 30: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/30.jpg)
future plans
![Page 31: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/31.jpg)
above, plus better text mining
![Page 32: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/32.jpg)
integrate better with libraries.io
![Page 33: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/33.jpg)
tighter integration with Impactstory
![Page 34: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/34.jpg)
https://impactstory.org/u/0000-0001-6728-7745
![Page 35: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/35.jpg)
![Page 36: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/36.jpg)
![Page 37: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/37.jpg)
![Page 38: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/38.jpg)
https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md
more Depsy details:
![Page 39: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/39.jpg)
thoughts?
tweet @depsy_org or via github issue.
![Page 40: Software-Native metrics: Depsy lessons learned](https://reader031.vdocuments.us/reader031/viewer/2022030305/5875e1e61a28ab7d5a8b53e7/html5/thumbnails/40.jpg)
thanks!