![Page 1: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/1.jpg)
Measurement of use and impact of electronic information services
Dr Angela ConyersEvidence Base
Birmingham City [email protected]
![Page 2: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/2.jpg)
NESLi2 deals
UK national deals negotiated by JISC Collections on behalf of the higher and further education communities
• 17 major scholarly publishers
• Libraries decide which deals to take up
![Page 3: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/3.jpg)
Evidence Base
• NESLi2 study for JISC Collections 2004-5• Evidence Base Publisher Deal Project 2006-9• Low and non take up of NESLi2 deals for JISC
Collections 2007• Assessing the value of the NESLi2 deals 2008• Evidence Base individual library consultancy
projects • JISC Journal Usage Statistics Portal (JUSP)
![Page 4: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/4.jpg)
NESLi2 Study for JISC Collections
• 4 NESLi2 publishers
• 17 university libraries
• Robust methodology developed
• NESLi2 deals generally favourable -challenged some preconceptions!
(http://www.ebase.bcu.ac.uk/docs/jiscnesli2summaryeb.pdf)
![Page 5: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/5.jpg)
Evidence Base Publisher Deal Project
• 20 university libraries
• 10 NESLi2 publishers
• Templates for detailed analysis including: Usage range, price band, subject category,
subscribed and unsubscribed titles, trends over time, cost metrics….
![Page 6: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/6.jpg)
Evidence Base Publisher Deal Project
• Have greatly enjoyed being a part of this project, I have learnt so much and gained much confidence in report generating and presenting this to senior staff
• We have found the project interesting and have enjoyed participating. It has certainly provided us with some new techniques to employ when conducting our own value for money analysis.
![Page 7: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/7.jpg)
Low and non take up of NESLi2 Deals
Survey of 121 university libraries
Three key reasons for low take up:
• not good value for money • deal not appropriate to our users• offers too complicated and time-consuming to
work out
![Page 8: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/8.jpg)
Assessing the value of the NESLi2 deals
A guide to help libraries, especially smaller libraries, assess value before purchase and when deciding on renewal.
http://www.jisc-collections.ac.uk/Reports/Assessing-the-value-of-NESLi2/
![Page 9: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/9.jpg)
What are we doing this for?
Financial data
• to inform purchasing decisions
• to demonstrate that the deal offers good value for money
Usage statistics
• to inform renewal decisions
• to demonstrate how the deal is being used
![Page 10: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/10.jpg)
![Page 11: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/11.jpg)
2750 journals
for the price of ????
![Page 12: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/12.jpg)
Yield Method
Yield provides a measure of the price per £ of acquiring additional unsubscribed titles
Yield per £ = list price of unsubscribed titles
e-access fee
![Page 13: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/13.jpg)
Calculating Yield
Three figures needed:• Costs of maintaining existing subscriptions:
base price or content fee (the ‘subscribed titles’ cost)
• Costs of e-access to all other titles in the deal (the ‘unsubscribed titles’ cost)
• Cost of buying all the titles in the deal on the open market
![Page 14: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/14.jpg)
Working out the yield
Publisher deal X – 1,000 titles with a total list price of £250,000. E access fee £10,000 including VAT
Library A – 100 subscribed titles at cost of £25,000
Yield per £ = £225,000 (£250,000 - £25,000)
£10,000
= £22.50 For each £ of the e-access fee, the Library gets £22.50
worth of journals.
![Page 15: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/15.jpg)
Cost per titleDeal with 1,000 titles
Type of Library Number of subscribed titles
Total cost (subscribed titles plus e-access fee)
Cost per title (n=1000)
Large 100 £22,000 £22
Medium 50 £11,000 £11
Small 10 £4,200 £4.20
![Page 16: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/16.jpg)
Average cost per request
Type of library Average cost per request
Average cost per request for unsubscribed titles
Average cost per request for subscribed titles
Large £0.74 £0.13 £1.48
Medium £0.81 £0.37 £1.62
Medium £1.13 £0.51 £1.54
Small £0.30 £0.09 £0.94
![Page 17: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/17.jpg)
Usage: subscribed and non-subscribed titles
50-75% of total requests have sometimes come from titles available in the deal to which the libraries did not previously have access
![Page 18: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/18.jpg)
Looking at nil usage 1
Type of library
No. of titles with nil use – incl. % No.of priced titles with nil use-incl %
Large 431 19% 64 4% Large 340 15% 27 1% Large 312 14% 44 2% Medium 464 21% 77 3% Medium 609 27% 148 7% Medium 531 24% 123 6% Small 952 43% 493 22% Small 623 37% 567 37% Small 764 40% 567 26%
![Page 19: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/19.jpg)
Looking at nil usage 2
Type of library
No. of titles with nil use – incl. % No.of priced titles with nil use-incl %
Large 106 20% 62 16% Large 111 21% 67 17% Large 94 17% 38 9% Medium 137 25% 61 15% Medium 82 18% 39 11% Medium 115 22% 65 16%
![Page 20: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/20.jpg)
Library comments
• Bundled deals are value for money – nil use is negligible; particularly when ‘unpriced’ titles are removed from the equation
• Value for money: Cost/download ratio highlighted return on investment
• Figures show substantial & sustained annual growth in usage
![Page 21: Measurement of use and impact of electronic information services Dr Angela Conyers Evidence Base Birmingham City University angela.conyers@bcu.ac.uk](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649e425503460f94b35403/html5/thumbnails/21.jpg)
Adding extra data
To measure the full value and impact of a deal, the following data needs to be combined with usage statistics:
• List prices
• Subscribed titles
• Subject categories