1

TIR Monitoring & Evaluation: tracking usage & impact

Ina Smith

Presented during the Annual DATAD Conference, 24-26 August 2016, AAU & Lupane State

University, Bulawayo, Zimbabwe

Agenda

• Why & What is M&E?• Bibliometrics/Alternative metrics/Item level

metrics/Article level metrics• Tools

Why Monitoring & Evaluation (M&E)?• Management tool• Informs strategic planning, direction• Assist with performance evaluation: institutional,

departmental, individual• Process that helps improve performance and

achieve results• Goal: to improve current and future management of

resources, outputs, outcomes and impact• Assess performance of IR

Evaluation• Systematic & objective examination re the

relevance, effectiveness, efficiency and impact of activities in the light of IR and OA objectives• From evaluation provide recommendations• Establish the return on investment

Monitoring• Continuous assessment • Aim: provide all stakeholders with early detailed

information on the progress or delay of the ongoing assessed activities• Determine if outputs, deliveries and schedules

planned have been reached so that action can be taken to correct the deficiencies as quickly as possible

Bibliometrics• Citation analysis & Publication analysis• Statistical analysis of published scientific output

(articles, books and more)• Analyse citations: number, disciplines, individuals,

self-citations etc.

Alternative metrics• Altmetrics manifesto http://altmetrics.org/manifesto/ • Article/item level metrics• Assess use of item on item level• Item = data set, video clip, article, thesis, image,

dissertation and more• Look beyond counting and emphasize semantic

content like usernames, timestamps, and tag

Try It!

DSpace Statistics

DSpace Statistics

DSpace Statistics

DSpace Statistics

DSpace Statistics

http://centaur.reading.ac.uk/32621/

Try It!

Add to your IR for free! Today!https://www.altmetric.com/products/free-tools/institutional-repository-badges/

http://plumanalytics.com/plumx-leverages-dspace-communities-for-simple-integration/

https://plu.mx/uwa-au/a/-27uGJrEP7EwUSBQUnw0ofmo0navWCq__TX-eUXJTE8/?display-tab=summary-content

http://facpubs.tourolib.org/publications/faculty/aruoma-okezie

Altmetric

PlumX

http://d-scholarship.pitt.edu/17829/

Try It!

Google Scholar Profile: IndividualGoogle Scholar Citations provide a simple way for authors to keep track of citations to their articles. An author can check who is citing his/her publications, graph citations over time, and compute several citation metrics. The author can also make his/her profile public, so that it may appear in Google Scholar results when people search for the researcher name, e.g. robin crewe

Also create a Google Scholar Profile for your IR!

Google Scholar Profile: IR

Number of c

itations

per item

Set up alerts for new items addedto

profile, citations to items in profile

https://impactstory.org/

Impactstory for individual researchers

http://v1.impactstory.org/CarlBoettiger

http://analytics.google.com

Google Analytics for IR

http://analytics.google.com

Piwik

SUNScholar Piwik

Activity• Login with your Gmail account for your IR:

gmail.com• Go to https://

scholar.google.co.za/intl/en/scholar/citations.html • Create a Google Scholar profile for your IR• Add items to the profile to track

Try It!

Showcase stats, report on it …

Demo Only

Thank you!Ina SmithSciELO Planning Manager, ASSAfina@assaf.org.za