usage data for electronic resources wraps/frip presentation april 24, 2007 gayle baker, maribeth...
TRANSCRIPT
![Page 1: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/1.jpg)
Usage Data for Electronic Resources
WRAPS/FRIP PresentationApril 24, 2007Gayle Baker, Maribeth Manoff, Eleanor Read
![Page 2: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/2.jpg)
MaxDatahttp://web.utk.edu/~tenopir/imls/index.htm
“Maximizing Library Investments in Digital Collections Through Better Data Gathering and Analysis”
Funded by Institute of Museum and Library Services (IMLS) 2005-2007
![Page 3: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/3.jpg)
MaxData Project Purpose
Evaluate and compare methods of usage data collection and analysis
Develop cost/benefit model to help librarians select appropriate method(s) for electronic resource usage assessments
![Page 4: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/4.jpg)
MaxData Project Teams
UT Libraries: COUNTER data from vendors, link resolver, database usage logs, federated search engine
David Nicholas et al. (Ciber): deep log analysis on OhioLINK journal usage data
Carol Tenopir and Donald King: readership surveys at UT and four Ohio universities
![Page 5: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/5.jpg)
FRIP Equipment Award(Fall 2005)
Requested PC with extra capacity for handling data HP LaserJet Printer Microsoft Office 2003 Professional Archival DVDs
$2477 Consulted with David Ratledge Housed in faculty study in Hodges
![Page 6: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/6.jpg)
Project File Sharing
Account (Usestat) on library server for project files for UT Libraries team
BlackBoard group site for MaxData team
![Page 7: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/7.jpg)
Presentations
Charleston 2005 (GB, ER/project intro) ER&L 2006 (GB/vendor data issues) Lib Assessment 2006 (ER, MM/combining data) Charleston 2006 (GB/vendor data results) ER&L 2007 (GB/vendor data survey) ELUNA 2007 (MM/SFX data) ALA/ACRL/EBSS 2007 (MM/data presentation) Charleston 2007 (all 3/comparing data types)
![Page 8: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/8.jpg)
Publications
“MaxData: A Project to Help Librarians Maximize E-Journal Usage Data.” In Usage Statistics of E-Serials (summer 2007)
“All That Data: Finding Useful and Practical Ways to Combine Electronic Resource Usage Data from Multiple Sources.” Library Assessment Conference Proceedings (May 2007)
Article on vendor data survey results in Learned Publishing (due June 1, 2007)
![Page 9: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/9.jpg)
The Usage Data Challenge
Vendor-supplied data Other data
![Page 10: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/10.jpg)
Vendor Reports: Background
Vendor-supplied data primary source of e-journal usage information
Project COUNTER helpful, but… Manipulation may be required to
compare use among vendors
![Page 11: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/11.jpg)
Vendor Reports: Consolidating
COUNTER Journal Report 1 (JR-1) Data from each vendor combined in
Excel spreadsheet Facilitates additional analyses
Sorting by selected fields Subject analysis Cost per use calculations
![Page 12: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/12.jpg)
COUNTER: JR1 Format
![Page 13: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/13.jpg)
Vendor Reports: Challenges
Inconsistencies in data fields Journal title (articles, upper/lower case, extra
information) ISSN (with and without hyphen)
Time consuming to fix ScholarlyStats, SUSHI, ERMS may help
![Page 14: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/14.jpg)
Survey: Purpose
How much effort is involved in working with vendor-supplied use data?
How are the data used? What data are most useful in managing
electronic resources?
![Page 15: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/15.jpg)
Survey: Subjects
Sent to Library Directors at Carnegie I and II research institutions (360+)
April 2006 92 respondents
![Page 16: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/16.jpg)
Number of Vendors Providing Usage Reports
![Page 17: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/17.jpg)
Reports for Different Types of Resources
![Page 18: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/18.jpg)
Purpose for Reviewing and/or Analyzing Vendor Data
![Page 19: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/19.jpg)
Number of Hours Processing Usage Reports in 2005
![Page 20: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/20.jpg)
Percentage of Time Processing Vendor Data
![Page 21: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/21.jpg)
Biggest Challenges
Lack of consistency / standards (61) Takes too much time (27)
COUNTER standards help but… (14)
![Page 22: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/22.jpg)
Most Useful Statistic(s)
Number of full-text downloads (67) Number of searches (41) Number of sessions (27) COUNTER statistics (26) Number of turnaways (17) Other (17)
![Page 23: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/23.jpg)
Other (Local) Data
UT – database “hits” recorded from database menu pages
Federated search system (MetaLib) statistics
Some libraries using proxy server logs Link resolver (SFX) data
![Page 24: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/24.jpg)
Link Resolver Data
SFX includes a statistical module with a number of “canned” reports
For journal level data, one report in particular (“Requests and clickthroughs by journal and target”) is analogous to COUNTER JR1
![Page 25: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/25.jpg)
SFX “Request” and “Clickthrough” Data
UT student searching in an SFX “source” discovers an article of interest Clicks on FindText button Article is available electronically in Journal
A, Package Y and Z – “Request” statistic recorded for each
Student chooses link to Journal A in Package Y – “Clickthrough” statistic recorded
![Page 26: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/26.jpg)
SFX “Clickthroughs” vs. JR1 “Full-Text Article Requests”
Clickthrough is less specific, does not measure actual download
But, clickthrough is a “known quantity,” not dependent on package interface
SFX report as a useful supplement to JR1, comparing trends and patterns
SFX contains data not in JR1 reports, e.g., non-COUNTER packages, open access journals, backfiles
![Page 27: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/27.jpg)
Formatting the SFX Report
Report from SFX is not formatted like JR1, does contain data elements Request to software vendor: Include in
statistical module Incorporate into ERMS Manual or programming approach,
depending on time and expertise available
![Page 28: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/28.jpg)
Other Useful Link Resolver Reports and Data
Unmet user needs Journals “requested” with no electronic
full-text available Interlibrary loan requests
Unused full-text report Overlap reports Subject categories
![Page 29: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/29.jpg)
Conclusions So Far
Collecting, consolidating and analyzing vendor data is time-consuming and difficult
Survey of electronic resource librarians indicates many do not have enough time
Acquiring data from local systems provides consistency, also requires time and effort
Libraries face difficult decisions about what methods are most practical and useful
![Page 30: Usage Data for Electronic Resources WRAPS/FRIP Presentation April 24, 2007 Gayle Baker, Maribeth Manoff, Eleanor Read](https://reader036.vdocuments.us/reader036/viewer/2022062421/56649e2b5503460f94b190bf/html5/thumbnails/30.jpg)
Into the Future
Present selected data sets to subject librarians to see what they find useful
Investigate usefulness of new COUNTER standards
Will SUSHI solve our problems? ERMS? Compare our findings with those of the
other MaxData teams