altmetrics: an app review - e-liseprints.rclis.org/20008/1/altmetrics an app review -...
TRANSCRIPT
![Page 2: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/2.jpg)
Overview
• Current University Research Environment • Altmetrics: Definition and Services Primer
– Altmetric – ImpactStory – Plum Analytics
• How Can Libraries Use Altmetrics? • Limitations • Q&A
![Page 3: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/3.jpg)
The Current University Research Environment
• Traditional incentives for researchers reign – Publish or perish…and that’s it!
• Values journal articles and monographs over emerging forms of scholarship
• “Real world” worth not always taken into account (e.g. translational research (Deschamps, 2012; Hobin et al, 2012; Kain, 2008), popular relevance)
– Metrics are used to evaluate impact • Grants received • Awards won • Journal Impact Factor (JIF) of published work
![Page 4: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/4.jpg)
The Current University Research Environment
![Page 5: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/5.jpg)
The Current University Research Environment…is Changing
• “Peer review” is broader • Not just for journal articles anymore • Pre- and Post-publication peer review
• New findings reported more quickly, in a variety of forums
• Measures of impact are plentiful and instant • Impact can be tracked both inside and outside
of the academy • Feedback loop is shortened, accelerating research
(Konkiel & Noel, 2012)
![Page 6: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/6.jpg)
The Current University Research Environment…is Changing
![Page 7: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/7.jpg)
The Current University Research Environment…is Changing
Previously measured • Journal Impact Factor • Grant monies received • Awards
Potentially measured
Scholarly
Popu
lar
![Page 8: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/8.jpg)
Altmetrics How many times an output
– article, website, blog, dataset, grey literature, software, etc has been:
– Viewed (Publisher websites, Dryad) – Downloaded (Slideshare, publisher websites, Dryad) – Cited (PubMed, CrossRef, Scopus, Wikipedia, DOI, Web of
Science) – Reused/Adapted (Github) – Shared (Facebook, Twitter) – Bookmarked (Mendeley, CiteULike, Delicious) – Commented upon (Twitter, Mendeley, blogs, publisher
websites, Wikipedia, Faculty of 1000)
![Page 9: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/9.jpg)
Altmetrics
• Generally gather stats using COUNTER standards and open APIs
• Provide item-specific, up-to-the-minute glimpses of the impact of many types of scholarship (Neylon & Wu, 2009; Priem et al., 2010)
• Can help researchers filter information to find relevant research more quickly and easily (Neylon & Wu, 2009).
• More transparent than the closely guarded impact factor formula (Priem et al., 2010)
![Page 10: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/10.jpg)
Image: http://bit.ly/VmzSOV
Image: http://bit.ly/T6rEKf
Image: http://bit.ly/UHAVUU
![Page 11: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/11.jpg)
Altmetrics Services: a Primer
• Measure attention received by various types of research outputs
• Reports • Visualizations
![Page 12: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/12.jpg)
Caveats • Altmetrics should not be
used by non-peer policy makers to evaluate a researcher’s performance (Russell & Rosseau, 2002)
• Use in context and to supplement other evaluative techniques (Priem et al., 2010; Steele, Butler, & Kingsley, 2006)
Epson291 via http://bit.ly/PZBrxI
![Page 13: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/13.jpg)
• Freemium service – Free bookmarklet, limited use API; paid full-
service API, reports
• Aimed at commercial publishers • Tracks usage of traditional outputs:
– DOIs – PubMedIDs – arXiv IDs
Sources
![Page 14: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/14.jpg)
• Strengths – Context-based metrics – Free (limited use) API available – Boolean querying and filtering – Reports and visualizations available, can export
• Weaknesses – Aimed at commercial publishers, not libraries – Does not track non-traditional outputs
![Page 15: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/15.jpg)
![Page 16: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/16.jpg)
![Page 17: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/17.jpg)
![Page 18: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/18.jpg)
• Free service • Aimed at individual researchers • Tracks usage of:
– DOIs – PubMedIDs – URLs – Slideshare – Github – Dryad
Sources
![Page 19: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/19.jpg)
• Strengths – Flexible – Easy to implement – Fully Open API – Context-based metrics
• Weaknesses – Scalability (resource intensive to create reports) – Less technical support than competitors
![Page 20: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/20.jpg)
![Page 21: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/21.jpg)
![Page 22: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/22.jpg)
![Page 23: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/23.jpg)
![Page 24: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/24.jpg)
![Page 25: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/25.jpg)
• Paid service • Aimed at libraries
and institutions
• Measures “artifacts”: – articles – book chapters – books – clinical trials – datasets – figures – grants – patents – presentations – source code – videos
![Page 26: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/26.jpg)
• Usage - Downloads, views, book holdings, ILL, document delivery, software forks
• Captures - Favorites, bookmarks, saves, readers, groups, watchers
• Mentions - blog posts, news stories, Wikipedia articles, comments, reviews
• Social media - Tweets, +1's, likes, shares, ratings • Citations - Web of Science, Scopus, Google Scholar, Microsoft
Academic Search (Plum Analytics, 2012)
Sources:
![Page 27: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/27.jpg)
• Strengths – Largest and most diverse research outputs, sources of
metrics – Could potentially incorporate other library metrics (e.g. IR
pageview and download statistics)
• Weaknesses – No API available (for now)
![Page 28: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/28.jpg)
• View demo here: http://www.youtube.com/watch?v=pRnU8aJQQ0U
![Page 29: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/29.jpg)
How can librarians use altmetrics?
• Value added service – IRs, assessment reporting
• Determining value – Collection development, resource allocation
• Prove value to stakeholders – “Look at how much use our IR gets!” “Look at how
many faculty we serve, and the attention their work receives!”
• Teach information literacy skills to patrons (identifying experts in certain subject areas)
• Conduct/filter our own research
![Page 30: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/30.jpg)
Limitations
• Lack of author identifiers (disambiguation) • Low (or zero) metrics available for some items
(Piwowar & Priem, 2012) • Gaming (Abbott et al., 2010) • Little adoption among traditional publishers,
libraries, and university administrators.
![Page 31: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/31.jpg)
References • Abbott, A., Cyranoski, D., Jones, N., Maher, B., Schiermeier, Q., & Van Noorden, R. (2010). Metrics: Do
metrics matter? Nature, 465(7300), 860–2. doi:10.1038/465860a • Deschamps, AM. (2012). Recommendations for engaging basic scientists in translational research. ASBMB
Today. April 2012. Retrieved Oct 3, 2012 from http://www.asbmb.org/asbmbtoday/asbmbtoday_article.aspx?id=16446
• Kain, K. (2008). Promoting translational research at Vanderbilt University’s CTSA institute. Dis Model Mech. 2008 Nov-Dec; 1(4-5): 202–204. doi: 10.1242/dmm.001750
• Konkiel S & Noel R. (2012). Altmetrics and Librarians: How Changes in Scholarly Communication will affect our Profession. Presented at Indiana University Libraries In-House Institute, May 7, 2012. Retrieved from http://hdl.handle.net/2022/14471.
• Hobin JA, Deschamps AM, Bockman R, Cohen S, Dechow P, et al. (2012). Engaging basic scientists in translational research: identifying opportunities, overcoming obstacles. J Transl Med. 2012; 10: 72. Published online 2012 April 13. doi: 10.1186/1479-5876-10-72
• Neylon, C., & Wu, S. (2009). Article-Level Metrics and the Evolution of Scientific Impact. PLoS Biol, 7(11). • Piwowar, H., & Priem, J. (2012). ImpactStory. Retrieved September 26, 2012, from http://impactstory.it/ • Priem, J., Taraborelli, D., Groth, P., & Neylon, C. (2010). Alt-metrics: a manifesto. Retrieved October 26,
2010, from http://altmetrics.org/manifesto/ • Russell, J. M., & Rosseau, R. (2002). Bibliometrics and institutional evaluation. In R. Arvantis (Ed.),
Encyclopedia of Life Support Systems (EOLSS). Part 19.3: Science and Technology Policy (Vol. Part 19.3:, pp. 1–20). Oxford, UK: Eolss Publishers.
• Steele, C., Butler, L., & Kingsley, D. (2006). The publishing imperative: the pervasive influence of publication metrics. Learned Publishing, 19(4), 14. doi:10.1087/095315106778690751
![Page 32: Altmetrics: An App Review - E-LISeprints.rclis.org/20008/1/Altmetrics an App Review - OCLC...Altmetrics: An App Review Stacy Konkiel E-Science Librarian Indiana University skonkiel@indiana.edu](https://reader036.vdocuments.us/reader036/viewer/2022062921/5f04f4cc7e708231d4108b18/html5/thumbnails/32.jpg)
Q&A • Download this presentation at:
> http://hdl.handle.net/2022/586 < • Get in touch!
[email protected] @skonkiel