software-native metrics: depsy lessons learned

40

#3amconf Sept 2016 Heather Piwowar and Jason Priem @ImpactStory software-native metrics

Upload: heather-piwowar

Post on 21-Jan-2017

186 views

Category:

Science

2 download

Report

Download

Embed Size (px):

TRANSCRIPT

Page 1: Software-Native metrics: Depsy lessons learned

#3amconfSept2016

HeatherPiwowarandJasonPriem@ImpactStory

software-native metrics

Page 2: Software-Native metrics: Depsy lessons learned

Page 3: Software-Native metrics: Depsy lessons learned

Page 4: Software-Native metrics: Depsy lessons learned

Page 5: Software-Native metrics: Depsy lessons learned

depsy.org

Page 6: Software-Native metrics: Depsy lessons learned

Page 7: Software-Native metrics: Depsy lessons learned

10.1038/529115a

Page 8: Software-Native metrics: Depsy lessons learned

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

Page 9: Software-Native metrics: Depsy lessons learned

depsy.org

Page 10: Software-Native metrics: Depsy lessons learned

Page 11: Software-Native metrics: Depsy lessons learned

Page 12: Software-Native metrics: Depsy lessons learned

Page 13: Software-Native metrics: Depsy lessons learned

Page 14: Software-Native metrics: Depsy lessons learned

launched last November

....what did people think?

Page 15: Software-Native metrics: Depsy lessons learned

Page 16: Software-Native metrics: Depsy lessons learned

Page 17: Software-Native metrics: Depsy lessons learned

Page 18: Software-Native metrics: Depsy lessons learned

some areas we weren’t sure about, but feedback suggested we got right

Page 19: Software-Native metrics: Depsy lessons learned

public profiles for everybody!

Page 20: Software-Native metrics: Depsy lessons learned

an overall score, with equal weighting to 3 components

Page 21: Software-Native metrics: Depsy lessons learned

downloads, log transformed vs ranked, and display for interprebility, with percentiles

Page 22: Software-Native metrics: Depsy lessons learned

pagerankto weight or not to weight, displayed in interpretable way

Page 23: Software-Native metrics: Depsy lessons learned

citations

Page 24: Software-Native metrics: Depsy lessons learned

authorship weighting (committers vs pypi author vs maintainer)

Page 25: Software-Native metrics: Depsy lessons learned

Page 26: Software-Native metrics: Depsy lessons learned

and some big requests

Page 27: Software-Native metrics: Depsy lessons learned

biggest one: pull in new data from GitHub

Page 28: Software-Native metrics: Depsy lessons learned

expected:

more package library systems (esp bioconductor)

more languages (import detection complexity)

more platforms like bitbucket (esp to get commit history for authorship)

better deduplication (no orcid, alas)

things that aren't on a version control system at all (not happening)

Page 29: Software-Native metrics: Depsy lessons learned

outstanding challenge:

deciding what is a research package (important b/c refset matters)

Page 30: Software-Native metrics: Depsy lessons learned

future plans

Page 31: Software-Native metrics: Depsy lessons learned

above, plus better text mining

Page 32: Software-Native metrics: Depsy lessons learned

integrate better with libraries.io

Page 33: Software-Native metrics: Depsy lessons learned

tighter integration with Impactstory

Page 34: Software-Native metrics: Depsy lessons learned

https://impactstory.org/u/0000-0001-6728-7745

https://impactstory.org/u/0000-0001-6728-7745

https://impactstory.org/u/0000-0001-6728-7745

Page 35: Software-Native metrics: Depsy lessons learned

Page 36: Software-Native metrics: Depsy lessons learned

Page 37: Software-Native metrics: Depsy lessons learned

Page 38: Software-Native metrics: Depsy lessons learned

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

more Depsy details:

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

https://github.com/Impactstory/depsy-research/blob/master/introducing_depsy.md

Page 39: Software-Native metrics: Depsy lessons learned

thoughts?

tweet @depsy_org or via github issue.

Page 40: Software-Native metrics: Depsy lessons learned

thanks!

Water reform in a transaction costs world: concepts, metrics and lessons learned

Metrics: Lessons Learned - Killing your pre market product illusions

Metrics for MMP Development and Operations Lessons Learned: The Sims Online Larry Mellon GDC, Spring 2004

Lessons Learned while Exploring Cloud-Native Architectures ... · Lessons Learned while Exploring Cloud-Native Architectures for NASA EOSDIS Applications and Systems Dan Pilone ([email protected])

Copyright ©2000, Linda Burhansstipanov Native American Health Issues Lessons Learned from Community- based Interventions, and Overview of Native Cancer

Winter 2018 Kelseya - Montana Native Plant Society...For instance, I first learned about dyeing with native plants from a podcast, “Growing Color,” in which native dye expert Rebecca

FY2011 Naval Human Systems Integration … HSI processes through metrics, feedback, and lessons learned. These objectives will be used to categorize and track maturity metrics, challenges,

how Languages Are Learned - English Languageelteportfolio.weebly.com/.../7/3/3/6/7336182/how_langua… · Web viewHOW LANGUAGES ARE LEARNED. ... The learners are matched as native

Metrics Matter: Lessons Learned from the ABS

OPERATIONALIZING CLOUD NATIVE WITH KUBERNETES...Cornelia Davis, CTO, Weaveworks Cloud Native Security for Kubernetes in Practice Gadi Naor, CTO & Co-Founder, Alcide Beyond Metrics:

Native Voices, Native Healing · 2020-06-08 · Hawaiian culture helped to reconnect them to previously held or learned cultural experiences or knowledge using various cultural practices

E-Metrics: Lessons Learned from the ARL E-Metrics Project, Challenges and Opportunities

Metrics Lessons Learned Managing Risks Howard Hays, MD, MSPH Medical Informatics Consultant Carolyn Johnson, RPh, CAC

Lessons Learned: Deploying MicroservicesSoftware Product ... · Enter Artifactory 5! • Artifactory 5 objective was to take lessons learned from previous cloud-native work • First

Metrics and lessons learned for OO projects

Model Error Propagation via Learned Contraction Metrics

Software-Native metrics: Depsy lessons learned

Building for the User: Things Learned While Building Native Advertising Products

Performance Quality Metrics for Mobile Web and Mobile Native - Agile Testing Days 2014

Lessons Learned in Project Metrics · Lessons Learned in Project Metrics: Are Your Metrics Dumb or Smart? My Background •Project Manager and Trainer •>20 years IT experience on

39° 51' 05'' N 104° 40' 34'' W 39° 49' 06'' N 104° 52' 10'' W · ‹ Features learned by MMC ‹ Features learned by PCA+LDA Evaluated metrics: ‹ Correct classiﬁcation rate

From 0 to DevOps: Lessons Learned Moving from On-Prem to Cloud Native

Healthcare Benchmarks and Metrics February 2015 · PDF fileHealthcare Benchmarks and Metrics February 2015 ... and lessons learned by 119 healthcare companies related to ... 2015 via

IIIT Hyderabad Diversity in Image Retrieval: Randomization and Learned Metrics P Vidyadhar Rao MS by…

Lessons Learned in Native and How to Avoid Making the Same Mistakes - WTF Native NYC, 11/3/15

E-Metrics: Lessons Learned from the ARL E-Metrics Project ...acscinf.org/docs/meetings/226nm/presentations/226nm41.pdfAvg. Annual % Change Serial Unit Cost 7.7% Serial Expenditures

A Cloud Native Platform for Stateful Streamingibm/cloud-native-patterns. 2. The architecture of cloud native Streams ( 5), deep-dives on speciﬁc features ( 6), and lessons learned

Metrics for MMP Development and Operations Lessons Learned: The Sims Online

The National Library of Medicine’s Native America Outreach Portfolio: Overview and Lessons Learned

Agile Metrics - Lessons Learned from my FitBitfiles.meetup.com/2974112/Agile Metrics - Lessons Learned from My Fitbit.pdf · Agile Metrics - Lessons Learned from my FitBit . Goodhart’s

Lessons Learned while Exploring Cloud-Native Architectures for … · 2019. 8. 29. · Lessons Learned while Exploring Cloud-Native Architectures for NASA EOSDIS Applications and

Native Target Language Speaking Teachers’ Role and … · Native Target Language Speaking Teachers ... including teachers who had learned the target language as a foreign ... mainly

Assessing and reporting resilience of native vegetation using metrics of structure, composition and function

Fast Similiarity Search for Learned Metrics (2009)

StartUp Metrics Lesson Learned - LeanCamp Barcelona