ramp: repository analytics and metrics portal€¦ · improving the reported use and impact of ir...
TRANSCRIPT
![Page 1: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/1.jpg)
Kenning Arlitsch, Dean @kenning_msuPatrick OBrien, Semantic Web Research Director @sempob
RAMP:
Repository Analytics and Metrics Portal
Accurately measuring use of institutional repositories
OCLC RLP MeetingLondon, UK, March 8, 2017
![Page 2: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/2.jpg)
Agenda
1. A New Reporting Model2. Accuracy of Analytics Reporting Tools
Page TaggingLog file
3. RAMPNew Prototype Web Service for IR reporting
![Page 3: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/3.jpg)
A New Reporting Model
Page Type Definition Examples
Citable Content Downloads
Non-HTML scholarly content that may be formally cited in the research process
● Publication (.pdf)● Presentation (.ppt)● Data Sets (.csv)
Item SummaryHTML pages to help user decide to download the full publication
● Title & Abstract● Item Metadata
AncillaryHTML pages that provide general information or navigation
● Search Results● Browse by Author● Statistics
![Page 4: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/4.jpg)
![Page 5: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/5.jpg)
![Page 6: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/6.jpg)
![Page 7: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/7.jpg)
![Page 8: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/8.jpg)
Accuracy of Analytics Reporting Tools
![Page 9: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/9.jpg)
Two Classes of Web Analytics
HTML
Analytics Service (SaaS)1Log Files
2Page Tagging{JavaScript}
![Page 10: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/10.jpg)
Page Tagging
Page Tagging does not track non-HTML CCD
HTML
Non-HTML
![Page 11: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/11.jpg)
Show Google Scholar direct link graphic
![Page 12: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/12.jpg)
Google Analytics use in academic libraries
Tested 279 academic library websites ARL DLF OCLC-RLP
90% US libraries contained Google tracking code
![Page 13: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/13.jpg)
Data set: Jan 5 - May 17, 2016 (n = 134 days)
Study Participant IR Platform URL
Montana State University ScholarWorks DSpace scholarworks.montana.edu
McMaster University MacSphere DSpace macsphere.mcmaster.ca
University of New Mexico LoboVault DSpace repository.unm.edu
University of Utah USpace CONTENTdm uspace.utah.edu
![Page 14: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/14.jpg)
Most IR activity is Citable Content Downloads
![Page 15: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/15.jpg)
Most IR Activity Unreported by Google Analytics
![Page 16: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/16.jpg)
Page Tagging does not track non-HTML Citable Content Downloads
Non-HTML
Search Analytics
Does!
![Page 17: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/17.jpg)
Typical Page Tagging (GA) Data Types
Page Type Analytics
Pages Events
Citable Content Downloads - ✅
Item Summary ✅ -
Ancillary ✅ -
![Page 18: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/18.jpg)
Montana Method Includes Google Search Console
Page Type Analytics Search
Console
Pages Events Search Analytics
Citable Content Downloads - ✅ ✅
Item Summary ✅ - -
Ancillary ✅ - -
![Page 19: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/19.jpg)
GA Ancillary Page Views and Item Summary Page Views vs CCD
![Page 20: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/20.jpg)
All four IR using Google Analytics
Page Type Analytics Search
Console
Pages Events Search Analytics
Citable Content Downloads
- 26,355 562,933
Item Summary 284,303 - -
Ancillary 201,793 - -
CCD Tracking Improvement
2,000%
![Page 21: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/21.jpg)
Montana Method Challenges
❖ Missing non-Google direct link CCD events ● Yahoo● Bing● Email● FB
❖ GSC limits time and access● Moving 90-day window● Granular data = programing skills to access API
![Page 22: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/22.jpg)
RAMP: Repository Analytics & Metrics Portal
![Page 23: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/23.jpg)
RAMP - Repository Analytics and Metrics Portal
Cloud Web service Currently accessible and free No training or configuration required Consistent method and terminology Benchmarking across time and organization Request access - [email protected]
![Page 24: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/24.jpg)
RAMP institutions as of March 3, 2017
Currently tracking over 86,000 digital items from 7 IR and capturing over 10,000 CCD per day that were previously invisible.
![Page 25: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/25.jpg)
![Page 26: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/26.jpg)
![Page 27: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/27.jpg)
PublicationsPublished:Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler, and Susan Borda. “Undercounting File Downloads from Institutional Repositories,” Journal of Library Administration, vol. 56, no. 7, 2016
Forthcoming:Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler. “RAMP: Repository Analytics and Metrics Portal: A Prototype Web Service that Accurately Counts Item Downloads from Institutional Repositories,” Library Hi Tech, v35n1, March 2017
Proposal funded by IMLS:”Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital Repositories” - scholarworks.montana.edu/xmlui/handle/1/8924
![Page 28: RAMP: Repository Analytics and Metrics Portal€¦ · Improving the reported use and impact of IR Author: Kenning Arlitsch, Patrick OBrien Subject: DLF Forum, Milwaukee, WI Keywords:](https://reader035.vdocuments.us/reader035/viewer/2022070710/5ec69620d214a964453cbb17/html5/thumbnails/28.jpg)
Undercounting Research Team
❖Montana State University●Kenning Arlitsch, Dean @kenning_msu●Patrick OBrien, Semantic Web Research Director @sempob●Leila Sterman, Scholarly Communication Librarian @calamityleila
❖OCLC Research●Jeff Mixter, Software Engineer @jeffmixter
❖University of New Mexico●Jonathan Wheeler, Data Curation Librarian