1

Practical Uses of Altmetrics

Andrea Michalek

President, co-founder Plum Analytics

@amichalek | @plumanalytics

Tell the Story.

3

Our Approach to Metrics

• Citations

• Usage

• Captures

• Mentions

• Social Media

ALLmetrics

4

Journal citations are the current state of

Scholarly Measure

4

Journal

Impact Factor

3.161

5

Citation Based Metrics

• Thomson Reuters JCR/Web of Science

– Journal Impact Factor (JIF)

– Eigenfactor

• Elsevier Scopus

– SCImago Journal Rank Indicator (SJR)

– Source Normalized Impact per Paper (SNIP)

• Google Scholar

– Google Journal Metrics

6

No Single Tool – Captures all

Citations

Citations of a book in Bar-Ilan, J. (2010) Citations to the “Introduction to

informetrics” indexed by WOS, Scopus and Google Scholar.

Scientometrics, 82(3), p.504

7

Photo credit: https://www.flickr.com/photos/infomastern/15021713702

8

2-5years

Idea

Blog Post?

years

Grant

Conference

3-5years

Video

Citations

Metrics timeline:

From Idea to Impact

It can take at least 2 - 5 years

from idea to a published

peer-reviewed journal article

Before PlumX After PlumX

Due to the pace of scholarly

publishing, it takes another 3 - 5

years from the time the work is

published to get to critical mass

of citation counts

From idea to measurable

citation counts can take

5 - 10 years

Metrics

available

immediately

citation counts

presentation view

share

save reference

bookmark

PDF download

click

video play

dataset download

citation counts

tweet

Publication

9

Samples of PlumX Metrics Sources

• Amazon

• Bit.ly

• CrossRef

• Delicious

• Dryad

• dSpace

• EBSCO

• ePrints

• Facebook

• figshare

• Github

• Goodreads

• Google+

• Medwave

• Mendeley

• PLOS

• PubMed Central

• Reddit

• Research

Blogging

• Scopus

• SlideShare

• SourceForge

• Stack Overflow

• Twitter

• USPTO

• Vimeo

• Wikipedia

• Worldcat (OCLC)

• YouTube

10

All Types of Research Artifacts

• Articles

• Blog posts

• Book chapters

• Books

• Cases

• Clinical Trials

• Conference

Papers

• Data Sets

• Figures

• Government Docs

• Grants

• Interviews

• Letters

• Media

• Patents

• Posters

• Presentations

• Reports

• Source Code

• Theses / Dissertations

• Videos

• Web Pages

11

MetricsCategories

USAGE(clicks, downloads, views,

library holdings, video plays)

CAPTURES(bookmarks, code forks, favorites,

readers, watchers)

MENTIONS(blog posts, comments, reviews,

Wikipedia links)

SOCIAL MEDIA(+1s, likes, shares, tweets)

CITATIONS(PubMed Central, Scopus,

patents)

12

USAGE

• Is anyone reading our work?

• Did anyone watch our videos?

• Usage is the #1 stat researchers want to know after

Citation counts

• PlumX is the only product that includes Usage

clicks, downloads,

views, library holdings,

video plays

13

• Captures indicate that someone wants to come back

to the work

• Early indicator of future citations

bookmarks, favorites,

readers, watchers

CAPTURES

14

• This category measures people truly engaging with

your research

• Automatically uncover the conversations about your

research

• Discover feedback, opinions, etc.

blog posts,

comments, reviews,

Wikipedia linksMENTIONS

15

• Social media measures how well a researcher is

promoting their work

• This is especially important for early career

researchers to measure and understand

• Track the buzz and attention around your research

output

+1s, likes, shares,

tweets

SOCIAL MEDIA

16

• Citations still a standard of long-term impact

• Including citations enables side-by-side analysis with

other metrics categories

PubMed Central,

Scopus, patentsCITATIONS

5 Categories in Action –

Example Article

Article level

metrics are the

building blocks

for PlumX

18

Plum X Summary

CATEGORIZE MEASURE ANALYZE

• By metrics type

• By type of output

• By YOUR

categories (e.g.

department,

subject, grant)

Group research

outputs your way

• PlumX platform

automatically

gathers metrics

about each

category for each

artifact

See impact at a

glance

• Through

Dashboards and

Analytics

Discover your

research stories

There’s a new way

to tell the story

Practical Uses of

Altmetrics at the

University of Pittsburgh

Timothy DeliyannidesDirector, Office of Scholarly Communication and Publishing

University Library System

University of Pittsburgh

Practical Uses of Altmetrics, a Webinar presented by

Plum Analytics and Library Journal

February 11, 2015, 1:00PM EST

WHY ALTMETRICS?

Goals of the program

Serve the Pitt community

– Track impact of documents in the institutional repository

– Custom researcher profiles for a small pilot group

– Full rollout to all University researchers forthcoming

Serve our publishing clients

– Embed PlumX Widget in all journals and repositories

– Demonstrate impact of published articles and preprints

– Help integrate altmetrics with Open publishing platforms

Why altmetrics?

More comprehensive

– Citations, usage, social media

Covers impact of online behavior

– Because scholars increasingly

work online

Measures impact of nontraditional scholarly formats

Measures impact immediately

– Because citation counts take years to

appear in literature

Pitt and PlumX

http://plu.mx/pitt

Pitt was Plum’s first customer (2012)

Integrated with: – Institutional Repository (d-scholarship.pitt.edu)

– 4 subject-based repositories

– 37 Open Access journals

ALTMETRICS AND THE

INSTITUTIONAL REPOSITORY

OPEN ACCESS and IMPACT:

A Tale of Two ETDs

IN THE POPULAR MEDIA:

a new large-bodied

oviraptorosaurian therapod

THE PLUMX

RESEARCHER PROFILE

ALTMETRICS AND

SUBJECT-BASED

REPOSITORIES

ALTMETRICS AND JOURNAL

PUBLISHING

PlumX at Pitt:

http://plu.mx/pitt

THANK YOU

Tim Deliyannides

tsd@pitt.edu

@deliyannides

Office of Scholarly Communication and Publishing

http://www.library.pitt.edu/oscp @OSCP_Pitt

ALTMETRICS & THE RESEARCH WORKFLOW:

INTEGRATING UTILITY

ROBIN CHAMPIEUX

SCHOLARLY COMMUNICATION LIBRARIAN

ORCID: 0000-0001-7023-9832

@ARCSCON

RESEARCH INTENSIVE, ACADEMIC MEDICAL CENTER

$356 MILLION IN GRANTS & AWARDS

2,800 STUDENTS

2,608 FACULTY

I _ P A _ T

Build a more complete understanding

of the impact of OHSU research.

Track the tools being used to share

scientific information.

Identify communities we’re engaging.

Provide impact data for invisible

contributions.

WHY?

LESSONS

LEARNED

Our outreach and delivery was contextually disconnected from research workflows and daily activities.

Data struck most researchers as interesting, but not particularly useful or about the science.

A NEW (PRACTICAL)

APPROACH

Validity

Utility

Integration

Using Quantitative Breadcrumb to Tell

Qualitative Stories of Impact

OCTRI Pilot Project Awards:

Tweeters by Influence

18,801 Followers

10,762 Followers

10,412 Followers 9,267 Followers

2,355 Followers

Evidence of Prestige Attention

But, more importantly, evidence of

clinical attention

From Listing to Articulating Impact:

Altmetrics & the NIH Biosketch

Scientific Contributions

Citations

Social Media

FINDING THE STORY IN DIFFERENT PLACES

Thank You.

ROBIN CHAMPIEUX

SCHOLARLY COMMUNICATION LIBRARIAN

ORCID: 0000-0001-7023-9832

ADVANCING RESEARCH COMMUNICATION &

SCHOLARSHIP

A New Conference, April 26 – 28, Philadelphia

@ARCSCON

commons.pacificu.edu/arcs