altmetrics and impact - committee on publication ethics donohue_presentations_final.pdfaltmetrics...
TRANSCRIPT
![Page 1: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/1.jpg)
Altmetrics and impact
Altmetric.com
Betsy Donohue VP, Publisher Business Development
COPE, 19th August 2015
![Page 2: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/2.jpg)
Altmetrics and impact
Getting credit where credit is due
Altmetric.com
Betsy Donohue VP, Publisher Business Development
COPE, 19th August 2015
![Page 3: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/3.jpg)
This talk
• Why are altmetrics of interest to authors, publishers & institutions?
• How are they used
• What are the benefits
• Things we’ve learned
• How are they abused
![Page 4: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/4.jpg)
Several different tools available
![Page 5: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/5.jpg)
You say tomato…
![Page 6: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/6.jpg)
![Page 7: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/7.jpg)
But there is another driver
![Page 8: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/8.jpg)
Bad news for researchers?
• You’re under pressure to justify
– Yourself
– Your research
• Both internally and externally
![Page 9: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/9.jpg)
Good news for researchers?
Funders and institutions are increasingly looking for or considering other types of:
• Impact
• Research output
• Contribution
![Page 10: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/10.jpg)
Altmetrics
Take a broader view of impact to help give credit
where credit is due
![Page 11: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/11.jpg)
Example: social & mainstream media
Blogs, reviews, comments Including Faculty of 1000, PubPeer, MathOverflow and the world’s largest curated index
of academic blogs.
Newspapers & magazines
International titles, both mainstream and niche.
Social media
![Page 12: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/12.jpg)
Example: policy documents
World Health Organization (WHO) “WHO policy on collaborative TB/HIV activities:
guidelines for national programmes and other stakeholders”
National Institute for Health and Care Excellence (NICE)
“Delivering Accident Prevention at local
level in the new public health system: Road safety policy and links to wider objectives”
Intergovernmental Panel on Climate Change (IPCC)
“Managing the Risks of Extreme Events and
Disasters to Advance Climate Change Adaptation”
![Page 13: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/13.jpg)
How people use altmetrics data
![Page 14: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/14.jpg)
![Page 15: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/15.jpg)
• To gauge the overall popularly of the article • 87% of respondents strongly agreed or agreed
• To discover and network with researchers who are interested in
the same area of their work • 77% strongly agreed or agreed
• To understands a paper’s influence on the scientific community • 66% strongly agreed or agreed
• To determine what journal to submit their next paper to • 60% of respondents strongly agreed or agreed
• To determine areas of research to explore • Only 37% of respondents strongly agreed or agreed
![Page 16: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/16.jpg)
Browsing by author
Browsing by department
![Page 17: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/17.jpg)
What are the benefits?
![Page 18: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/18.jpg)
For authors
• See who is talking about their work, and what they’re saying
• Better manage their online reputation – ensure work isn’t being misinterpreted
• Find evidence of influence and engagement for job and funding applications
![Page 19: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/19.jpg)
For institutions and funders
• Identify success stories to help develop future strategy
• Uncover developing fields
• Get the fuller picture of a researcher
![Page 20: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/20.jpg)
For publishers
• Monitor the success of marketing and PR activity
• Identify new audiences (or markets)
• Gathering evidence for future strategy decisions
• Support existing authors and institutional customers
![Page 21: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/21.jpg)
For editorial
• Encourage future submissions
• Track which content is of most interest and can possibly be repurposed
• Identify high profile authors to attract
• Discover potential reviewers
• Report back to editorial boards and society stakeholders
![Page 22: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/22.jpg)
Some things we’ve learned
![Page 23: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/23.jpg)
![Page 24: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/24.jpg)
People like to relate it to citations! Scholarly altmetrics correlate with citations. Public engagement / policy & practice altmetrics don’t.
![Page 25: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/25.jpg)
![Page 26: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/26.jpg)
![Page 27: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/27.jpg)
How people (ab)use altmetrics data
![Page 28: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/28.jpg)
"The more any quantitative social indicator (or even some qualitative indicator) is used for social decision-making […]
the more apt it will be to distort and corrupt the social processes it is intended to monitor.”
Donald Campbell, 1976
![Page 29: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/29.jpg)
Altmetric score
Quantifying attention
http://support.altmetric.com/knowledgebase/articles/83337-how-is-the-altmetric-score-calculated
![Page 30: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/30.jpg)
Why score at all? To allow ranking
![Page 31: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/31.jpg)
![Page 32: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/32.jpg)
![Page 33: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/33.jpg)
![Page 34: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/34.jpg)
![Page 35: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/35.jpg)
Gaming the system
![Page 36: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/36.jpg)
Gaming?
• Alice asks her friends to retweet her.
![Page 37: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/37.jpg)
Gaming?
• Bob likes Alice’s paper. He shares it with all his friends and asks them to retweet him.
![Page 38: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/38.jpg)
Gaming?
• Alice pays $5 for 100 retweets
![Page 39: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/39.jpg)
Four types of suspicious attention
![Page 40: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/40.jpg)
![Page 41: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/41.jpg)
What can be done?
• Make underlying data available, visible
• Only track sources that can be audited
– Some interesting sources fail this test e.g. downloads and private Facebook activity
• Automatically flag up suspicious activity, then manually curate
• Have a standard process in place to deal with gamed articles, notify the journal
![Page 42: Altmetrics and impact - Committee on Publication Ethics Donohue_presentations_final.pdfAltmetrics and impact Altmetric.co m Betsy Donohue VP, Publisher Business Development COPE, 19th](https://reader030.vdocuments.us/reader030/viewer/2022040111/5e5c1f4f4f9dab375846221b/html5/thumbnails/42.jpg)
In future
• Educate on responsible use of metrics
• Work with institutional and publisher partners to increase awareness
• Newly-launched Altmetric Ambssadors program to help spread the word