beyond usage: measuring library outcomes and value
DESCRIPTION
Beyond Usage: Measuring Library Outcomes and Value. Carol Tenopir University of Tennessee [email protected]. QQML May 2011. purchase or exchange value: what one is willing to pay for information in money and/or time, and - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/1.jpg)
Center for Information and Communication Studies
Beyond Usage: Measuring Library Outcomes and Value
Carol TenopirUniversity of Tennessee
QQMLMay 2011
![Page 2: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/2.jpg)
Center for Information and Communication Studies
![Page 3: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/3.jpg)
Center for Information and Communication Studies
1.purchase or exchange value: what one is willing to pay for information in money and/or time, and
2. use value: the favorable consequences derived from reading and using the information.
In the information context economist Machlup described 2 types of value:
![Page 4: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/4.jpg)
Center for Information and Communication Studies
1) Implicit value (i.e., usage, downloads)2) Explicit value (i.e., interviews)3) Derived values (i.e., ROI)
Value (exchange or use) can be measured in many ways:
![Page 5: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/5.jpg)
Center for Information and Communication Studies
University of Tennessee-Knoxville Downloads
![Page 6: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/6.jpg)
Center for Information and Communication Studies
• Purpose• Outcomes• Return on Investment (ROI)
Going beyond implied value to show…
![Page 7: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/7.jpg)
Center for Information and Communication Studies
Methods for measuring valueUsage Citations
Focus groups
Return on Investment
Perceptions
Experiments Critical incident
Contingent
valuation
Observations
Conjoint measurement
Interviews
![Page 8: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/8.jpg)
Center for Information and Communication Studies
Surveys by Tenopir & King 1977-Present Surveys of academic faculty in US and
Australia (2004-6) and UK (2011) Measure purpose, outcome, and value Include all reading (from library and not) Exchange and use value
![Page 9: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/9.jpg)
Center for Information and Communication Studies
“The following questions in this section refer to the SCHOLARLY ARTICLE YOU READ MOST RECENTLY, even if you had read the article previously. Note that this last reading may not be typical, but will help us establish the range of patterns in reading.”
Surveys by Tenopir & King, 1977-Present Critical incident of last reading
![Page 10: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/10.jpg)
Center for Information and Communication Studies
Principal purpose of reading (Faculty in U.S. and Australia, 2004-2006, n=1433)
51%
9%11%
9%
20%
Research
Teaching
CurrentAwarenessProposals
Other
![Page 11: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/11.jpg)
Center for Information and Communication Studies
Source of reading by purpose of reading by faculty (Faculty in U.S. and Australia, 2004-2005, n=1412)
ResearchTeaching
Current Awareness
5%
5% 5%
11%
37%
38%
3%3%
30%
47%
7%
10%
3%
50%
18%
14%
7%
9%Library provided
Personalsubscription
Open Web
Colleagues
SchooldepartmentsubscriptionOther
![Page 12: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/12.jpg)
Center for Information and Communication Studies
Readings for research or writing• More likely to be rated “absolutely
essential”• More likely to be found by searching• More likely to be from e-sources• More likely to be after the first year of
publication• More likely to be from the library
![Page 13: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/13.jpg)
Center for Information and Communication Studies
Outcomes of Journal Article Reading (2004-6, 2011)
1st inspire new thinking or ideas (55%) (54%)
2nd improve results (40%) (38%)
3rd narrow/broaden/change the focus (27%) (28%)4th resolve technical problems (12%) (10%)
5th save time or other resources (12%) (9%)
6th aid in faster completion (7%) (5%)
7th assist or result in collaboration/joint research (6%) (4%)
![Page 14: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/14.jpg)
Center for Information and Communication Studies
Last Information Source Used for Work (2011)
Journ
al art
icle
Confer
ence
proc
eedin
g
Web
site
Magaz
ine ar
ticle
Book o
r boo
k cha
pter
Person
al co
ntact
79.0%
1.6% 2.2% 0.5%
13.2%3.5%
n=984
![Page 15: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/15.jpg)
Center for Information and Communication Studies
Source of Article (2011)
5.1%
66.1%
4.5% 2.3%9.4% 5.9% 2.2% 4.6%
n=1067
![Page 16: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/16.jpg)
Center for Information and Communication Studies
Source of Book
Bough
t it
Librar
y coll
ectio
n
Interl
ibrary
loan
Depart
ment o
r sch
ool
Collea
gue,
autho
r, etc
.
Free or
adva
nce
Other
38.6%
25.6%
1.8% 2.4%
10.7%14.4%
6.6%
![Page 17: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/17.jpg)
Center for Information and Communication Studies
Did you obtain your article from a print or electronic source?
Elec-tronic; 85.6%
Print; 14.4%
All sources
Electronic, 93%
Print; 7%
Library subscription
![Page 18: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/18.jpg)
Center for Information and Communication Studies
E-Collections improve efficiency, writing, and research
“E-access is essential for
scientific writing”
“I could not do the kind of research or
teaching I do without these resources.”
“[e-access] saves me a lot of time which can be used for more extensive
reading.”
![Page 19: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/19.jpg)
Center for Information and Communication Studies
Derived measuresReturn on Investment (ROI) is a quantitative
measure expressed as a ratio of the value returned to the institution for each monetary unit
invested in the library. For every $/€/£ spent on the library,
the university received ‘X’ $/€/£ in return.
Demonstrate that library collections contribute to income-generating activities
![Page 20: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/20.jpg)
Center for Information and Communication Studies
9 Institutions in 8 Countries
![Page 21: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/21.jpg)
Center for Information and Communication Studies
ROI Findings
• 13.2:1 to 15.5:1ResearchSTM
• 1.3:1 to 5.6:1Research &
TeachingSTM/Hum/SS
• Under 1:1Teaching & ResearchHum/SS
![Page 22: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/22.jpg)
Center for Information and Communication Studies
Value and ROI goes beyond direct monetary return: Libraries help…
• …attract & retain outstanding faculty• Faculty who publish more read more• Faculty who receive awards read more• Library is main source of article readings
• …foster innovative research & reputation• For every article cited, 27-40 more are read• A doubling in article downloads, from 1 to 2 million, is statistically
associated with dramatic increases in research productivity**
• **Research Information Network. 2009. E-journals: their use, value and impact. Report prepared by Research Information Network.
![Page 23: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/23.jpg)
Center for Information and Communication Studies
Lib-Value: Multiple institutions using multiple methods to measure multiple values for multiple
stakeholders
![Page 24: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/24.jpg)
Center for Information and Communication Studies
Ebooks Special Collections
Information Commons
Journal Collections Value and ROI Teaching and
Learning
Reading and Scholarship Tools
Website and Value
Bibliography
Current Projects
![Page 25: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/25.jpg)
Center for Information and Communication Studies
Comprehensive Library Value Study• Economic (private)
– What is the value to an individual to use the library resources?
• Social (public)– What is the value to the institution of the library?
• Environmental (externality)– What is the value of the environmental savings of library
provision of electronic resources? – Have libraries gone green without knowing it?
![Page 26: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/26.jpg)
Center for Information and Communication Studies
Preliminary Faculty Survey Results
ActivityAverage last 30
days% of
respondents Physical Visits 2.9 visits 73%Remote Visits 14.2 visits 88%
Average Total Resources Used: in-person visit to the library 7.3 uses 80%
remotely online 14.9 uses 89%
![Page 27: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/27.jpg)
Center for Information and Communication Studies
Average Time of UseIn person Remote online
64 minutes 60 minutes
![Page 28: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/28.jpg)
Center for Information and Communication Studies
Anticipate change..New Scholarly Endeavors
That Cut Across the Library’s Functional Areas
Research Social / Professional
Teaching / Learning
Scho
larly
End
eavo
rs
Functional Areas
E-science
CollaborativeScholarship
InstitutionalRepositories
![Page 29: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/29.jpg)
Center for Information and Communication Studies
What we can show so far…• Academic library e-collections help faculty be
productive and successful• Libraries help generate grants income• E-collections (books, journals, etc.) are valued
by faculty and students
![Page 30: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/30.jpg)
Center for Information and Communication Studies
Some final thoughts on measuring value
![Page 31: Beyond Usage: Measuring Library Outcomes and Value](https://reader031.vdocuments.us/reader031/viewer/2022013004/56816267550346895dd2d3ff/html5/thumbnails/31.jpg)
Center for Information and Communication Studies
For further information: [email protected]
http://libvalue.cci.utk.edu