methods for proving academic impact at the administrative ... 2018 confere… · a dvd from the...
TRANSCRIPT
![Page 1: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/1.jpg)
Telling our story:Methods for proving academic
impact at the administrative level
Florida Library Association 2018 Annual Conference
Craig Amos, Penny Beile, Bob Dugan, Kirsten Kinsley
![Page 2: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/2.jpg)
Seven strategies for effectively communicating the library’s value in supporting student success
Penny Beile, University of Central Floridapennybeile.academia.edu
![Page 3: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/3.jpg)
1. Understand the language
![Page 4: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/4.jpg)
2. Conduct institutional environmental scan
• University-specific
• Performance Based Funding – Metric 3, cost of
college; Metric 4, 4 year graduation rate; Metric 5,
Academic progress rate
• Preeminence
• All FL higher education institutions
• FL Statute 1004.085, Textbook affordability report
• Mission and Goals
• Strategic Planning
• Campus initiatives
![Page 5: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/5.jpg)
3. Identify stakeholders
![Page 6: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/6.jpg)
4. Craft your narrative
• Define your metrics in support student success
…varies by institution.
• Where to find information if you haven’t collected it
at your institution.
• Textbook affordability – Lumen Learning Impact
Calculator at http://impact.lumenlearning.com/
• Academic library impact – ACRL and OCLC
visualization dashboard at
http://experimental.worldcat.org/valresearch
![Page 7: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/7.jpg)
5. Tell your story
• FCTL and IT&R newsletters
• Subject Librarian newsletters
• UCF President -> report to the BOG
• Vice Pres of Instructional Resources & Technology
• VP of IKM and Strategic Initiatives
• VP of Center for Distributed Learning
• Dean of College of Undergraduate Studies
• VP of Student Development and Enrollment Services
• Office of Student Success, EAB SSC
• Foundations of Excellence, transfer students
• Visitors (Gates Foundation, others)
![Page 8: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/8.jpg)
6. Show up to the table
In addition to University administrators… disseminate
to and through additional channels:
• SACS reaffirmation reports; QEP initiatives
• New deans
• Program reviews
• Faculty department meetings
• Student academic support units
• Faculty development T&L institutes
![Page 9: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/9.jpg)
Libraries support student success
7. Repeat
![Page 10: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/10.jpg)
Seven strategies of highly effective library advocates:c
1. Understand the language2. Conduct environmental scan3. Identify campus stakeholders4. Craft your narrative5. Tell your story6. Show up to the table7. Repeat
![Page 11: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/11.jpg)
Acknowledgements• Slide 3 and 14: Mulvihill, Rachel; Beile, Penny. “Correlating Use of Library Services
with Student Success, and What We Learned Along the Way,” 2017 LOEX Conference, Lexington, KY, May 2017.
• Slide 4: FL BOG PBF Model, http://flbog.edu/board/office/budget/_doc/performance_funding/2018-19%20Benchmarks.pdf and FL TA legislation, http://www.leg.state.fl.us/statutes/index.cfm?mode=View%20Statutes&SubMenu=1&App_mode=Display_Statute&Search_String=1004.085&URL=1000-1099/1004/Sections/1004.085.html
• Lumen Learning Impact Calculator, http://impact.lumenlearning.com/ and ACRL VAL /OCLC dashboard, http://experimental.worldcat.org/valresearch
• Slide 20: Turner, Anna (FCTL), deNoyelles, Aimee (CDL); Raible, John (CDL); Beile, Penny; Gause, Rich; Norris, Sarah. “Free up your Class! Course Redesign through Textbook Affordability,” Faculty Center for Teaching and Learning Summer Faculty Development Conference, Orlando, FL, May 2018.
• Slide 21: Florida Virtual Campus. 2016. 2016 Student Textbook and Course MaterialsSurvey: Results and Findings. http://www.openaccesstextbooks.org/pdf/2016_Florida_Student_Textbook_Survey.pdf
• Slide 23: Fischer, Hilton, Robinson, and Wiley. (2015). A Multi-institutional study of the impact of Open Textbook adoption on the learning outcomes of post-secondary students. Journal of Computing in Higher Education, 22. https://link.springer.com/article/10.1007%2Fs12528-015-9101-x
![Page 12: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/12.jpg)
Examples from recent presentations to University administrators and other campus stakeholders follow:
![Page 13: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/13.jpg)
The value of libraries.Students who use the library have better academic outcomes.
![Page 14: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/14.jpg)
25,336 studentsAbout 40% of student enrollments
Average 2.64 timesServices used 1 to 70 times by student
66,860 interactionsAcross five library service points
Fall 2014-Fall 2015: Student use of five library services
![Page 15: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/15.jpg)
End of semester GPA
3.20
3.05
2.00
2.50
3.00
3.50
Library Users Library Nonusers
![Page 16: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/16.jpg)
Grade distribution
48.18
32.07
14.14
3.05 2.55
42.61
32.93
16.13
3.99 4.35
0
10
20
30
40
50
60
A B C D F
Per
cen
tage
of
Stu
den
ts
Library Users Library Nonusers
![Page 17: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/17.jpg)
Library study: On the horizon
• Work with IKM to create a data visualization dashboard
• Continue data collection; automate data submission
• Expand number of library interaction points
• Ultimately, hope that data will “roll up” for institution-wide analysis of student behaviors and academic success
• Program improvement; create collaborations with pertinent campus partners for seamless support across academic life cycle
![Page 18: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/18.jpg)
Textbooks cost…. sometimes a lot.The problem and the promise.
![Page 19: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/19.jpg)
![Page 20: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/20.jpg)
How do you think
students responded:
If all of your college books
were free, how would you
spend the saved money?
“Many dollar banknotes” created by Jericho is licensed under CC BY 3.0
![Page 21: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/21.jpg)
2016 UCF student survey results, n=1,975
% of students indicating that, due to textbook costs, they “frequently” or “occasionally”:
• 53% did not buy the textbook
• 21% did not register for a specific course
• 20% took fewer courses in general
• 19% earned poor grade due to not buying textbook
• 9% dropped and 6% withdrew from a course
2016 Student Textbook and Course Materials Survey: Results and Findings. (2016). FloridaVirtual Campus. http://www.openaccesstextbooks.org/pdf/2016_Florida_Student_Textbook_Survey.pdf
![Page 22: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/22.jpg)
“I really like using a free online textbook and think it made things a lot easier and a lot less financially stressful on me. Textbook cost is a huge burden on college students—the cost of a $50 textbook pays for my groceries for a week or two, gas for a month, my entire utility bill.”
- UCF student
Random student photo
![Page 23: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/23.jpg)
Promise of affordable textbooks
• Higher GPA
• Increased retention
• Greater satisfaction
• Increased enrollment intensity
• Reduced time to graduation
• Decreased student debt
Fischer, Hilton, Robinson, and Wiley. (2015). A Multi-institutional study of the impact of Open Textbookadoption on the learning outcomes of post-secondary students. Journal of Computing in Higher Education,22. https://link.springer.com/article/10.1007%2Fs12528-015-9101-x
![Page 24: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/24.jpg)
Grassroots efforts: faculty, librarians, IDs
By course level, Summer 2016-Spring 2018
![Page 25: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/25.jpg)
COS, 257,357
CAH, 138,062
RCHM, 34,093
COPHA, 18,849
COS CAH RCHM COPHA
Potential savings by college
![Page 26: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/26.jpg)
TA: On the horizon
• Continue to work with faculty to locate high quality, low or no cost course materials
• Form university-wide committee with stakeholder representatives
• Institute a print textbook reserve collection
• Streamlined access to booklist for analysis
• Create a public-facing web site
• Seek funding for faculty incentives
• Continued research, data collection
![Page 27: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/27.jpg)
“Proving” UWF Libraries’ Stories to Academic Affairs
Bob Dugan
Dean of Libraries & Special Assistant to the Provost
May 25, 2018
![Page 28: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/28.jpg)
Presentation Charge
Collect, analyze and present data that has positive impact on academic performance goals.
• Student success
• Retention
• Graduation rates
![Page 29: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/29.jpg)
UWF Libraries’ Perspective
We are of the mind that
“student success affects retention, and both
affect graduation rates.”
That is, the libraries focus on addressing student
success in order to affect retention and
graduation rates.
![Page 30: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/30.jpg)
Textbook Program
• Started in Fall 2015 with the libraries purchasing all course-required print textbooks for the 1000-2000 level courses.
• Added 3000 level courses in Spring 2016.
• Added 4000 level courses for Fall 2016.
• Addresses student success by • increasing affordability for students
• affecting pedagogy (students can be prepared for class even if they cannot afford the textbook).
![Page 31: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/31.jpg)
Textbook Program
Semester
Courses
Included Number of Texts
Semester Circulation
Total
Fall 2015 1000 & 2000 157 1,457
Spring 2016 1000-3000 493 2,565
Summer
2016 1000-4000 573 508
Fall 2016 1000-4000 1,437 7,206
Spring 2017 1000-4000 1,488 7,949
Summer
2017 1000-4000 1,582 1,802
Fall 2017 1000-4000 1,833 7,287
Spring 2018 1000-4000 1,978 8,571
![Page 32: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/32.jpg)
Textbook Program
• FY2017 (latest full year)• Purchased 883 textbooks at $79,333 (already had
many of the textbooks from previous semesters).
• Average cost = $89.84.
• Textbooks borrowed 16,957 times.
• Transaction value = $1,523,417.
![Page 33: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/33.jpg)
“We Listen to You” Institutional Effectiveness• Addresses student success by demonstrating to
them that we will respond to their requests when we can.
• Methods of data collection: • Staff observations
• Data (e.g., circulation; building usage)
• Students talking with staff at the public service desks
• “Sounding Board”
• On the sidewalks
• Social media.
![Page 34: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/34.jpg)
“We Listen to You” Institutional Effectiveness
• Sample of what we did as a result of listening:• Longer hours open; from 81 in 2010 to 112 by 2015 (with fewer staff)• Comfortable furniture (soft seating)• Mobile furniture (tables and chairs on wheels)• Lending all sorts of equipment, such as graphing calculators and “Skype Kits”• Installed more electrical outlets; acquired phone charging workstations• Doubled the number of desktop computer workstations• Installed dual monitors on as many desktop computer workstations as possible• Added SmartBoards for peer collaboration
• In an April 2018 fund-raising letter, students identified equipment lent by the libraries as one of three factors important to their success.
![Page 35: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/35.jpg)
“Not a Snapshot ….”• Ongoing web-based survey to relay their
satisfaction with library services.
![Page 36: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/36.jpg)
Benchmarking with Peers -ACRLMetrics• Comparison measures we can communicate upwards for context.
FY2015 Peers: Percentage of
Expenditures by Major Category -
Sorted on % of Operating
Expenditures on Library Materials
% of Operating
Expenditrures on
Library Materials
% of Operating
Expenditures
on Staff
% of Operating
Expenditures on
Other Expenses
Rowan University 59.32% 37.57% 3.12%
University of South Dakota 49.89% 43.08% 7.03%
University of Arkansas at Little Rock 48.29% 45.19% 6.52%
East Tennessee State University 45.10% 43.07% 11.83%
Average 41.94% 52.16% 5.90%
Western Carolina University 41.47% 53.01% 5.52%
Median 37.49% 55.60% 6.91%
University of West Florida 34.03% 58.57% 7.39%
Valdosta State University 33.09% 58.99% 7.92%
Stephen F Austin State University 29.68% 65.17% 5.16%
University of West Georgia 29.24% 70.26% 0.50%
Missing peers: Indiana State University and University of Massachusetts - Lowell
![Page 37: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/37.jpg)
Part of the Story: Everyone Has a Financial Perspective
• Financial metrics can help explain library value by relating usage in terms of financial perspectives that stakeholders understand.
• because, every one has a financial perspective.
• There are several approaches for looking at library financial value:
• money and time • cost-benefit analysis (alternative courses of action) • actual and potential value.
![Page 38: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/38.jpg)
Explaining the Story: Value of Usage -- A Financial Proxy
• A formula for the value of usage is a variant of the calculation of the production of a commodity:
• Value = Quantity (of the commodity produced) multiplied by the Price Unit (of the commodity) as V = Q x P
• A variant of production of a commodity recognizes the value of a library benefit (resource or service) as evidenced by its use.
• Value of usage = Measured Output (of a service) multiplied by the Assigned Price (per unit) as Vu = MO x AP
• A very simple example • The number of articles downloaded (the output is measured by a counter) • Multiplied by the cost per article (may use the commercial unit cost)
• If 10,000 articles were downloaded, and the assigned price was $15.00 per article,
the value of usage is $150,000.
![Page 39: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/39.jpg)
“Well, We Actually Have ROIs”
• We use value of usage for calculating Return on Investment for stakeholders.
• Institutional ROI for Academic Affairs and Board of Trustees
• Student perspective
![Page 40: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/40.jpg)
Institutional ROIUWF University Libraries: Return on Investment
FY2017 Outputs and Expenditures
revised: 2017 November 27
Number of Value per
Activity Occurances Occurance Total Value Notes
Students studying in the Pace Library 454,405 $442.91 $20,126,077 average annual cost per hour to open = $442.91; figure 10% of gate count stayed one hour
Students borrowing
a book from the general collection 23,823 $14.95 $356,154 we considered the book as used; used books are 20% of the average cost of a new book ($74.76)
a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented
an e-book from the collection 46,011 $2.00 $92,022 average Kindle e-book is $10; we used 20% of that cost even though the e-books are academic based and thereby costlier
a course-required print textbook on reserve 16,486 $89.84 $1,481,102 library purchased 883 course-required print textbooks for the 1000-4000 level courses @ $79,332.73
Students borrrowing a laptop 12,272 $300.00 $3,681,600 hardware and installed software
Students asking reference questions at the Pace Library 12,102 $13.36 $161,683 cost to answer a reference question during FY2016
Individual research consultations with reference librarian 1,463 $25.00 $36,575 lasting at least 20 minutes; Georgia Tech charges $75/hour for library fee-based research services
Library instruction sessions conducted 229 $56.25 $12,881 number of library instruction sessions at Pace; use the cost of a research consultation;
average library instruction session = 45 minutes
Students using a day study carrel 8,715 $6.00 $52,290 day carrels are loaned for 6 hours/per use. The average asking rental rate
per sq ft/year for office properties in Pensacola as of August 2016 was $12.86. Calculate a $1/hour.
Database use from off-campus 494,842 $2.25 $55,670 estimate that 5% of occurances saved the student from driving 30 miles roundtrip to the library; saved 1 gallon of gas
TOTAL VALUE $26,060,664
University direct FY2017 expenditure for UWF University Libraries $3,878,763
Return on Investment $6.72 for each dollar invested in the University Libraries, it returned $ 6.72 in direct measured services to students
![Page 41: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/41.jpg)
Student Return on Investment
![Page 43: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/43.jpg)
Telling our story: Methods for Proving the Effect of Library Usage on First-Time-In-College Student Academic Success
Kirsten Kinsley
FACRL & FLA May 25, 2018
Orlando, FL
![Page 44: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/44.jpg)
Once upon a time. . .
“Move-In Day” at Ohio Northern University photo by Ken Colwell 8/20/2011 is licensed under CC 2.0
a librarian wanted to
know if the frequency of
library visits and
duration of library stay
over the course
of semester influenced
first-time-in-college
students’ success.
![Page 45: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/45.jpg)
Astin’s Model for Student Involvement
Input Variables
• Demographic
Characteristics: Gender,
Race, Citizenship, Age,
Parent Income Level, Mother
& Father Education Levels
• Pre-college Academic
Variables: High School GPA,
ACT, Transfer Credit
Environmental Variables
• Library Visit Frequency & Duration
(Treatment variables)
• Major, Class, Military Status, Athlete,
Current Load, Matriculation Year,
Housing, CARE
Outcome Variables
• First-term GPA
• First-year Retention Rate
![Page 46: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/46.jpg)
CharactersStudents
6,380 First-Time-In-College (FTIC) students who matriculated in Fall 2014 and Fall 2015 semesters
Data Sources
Matching C-Cure System: card-swipe
data from two major libraries with
student input data from FSU’s Office of Institutional Research (OIR)
Audience- students, parents, campus and library administration, donors, state legislature, Florida Board of Governors, etc.
![Page 47: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/47.jpg)
An aside…stakeholder lingo• Florida FTIC Students: have never attended a post-
secondary college or university or have earned <12 hours of college credit.
• Retention: measured for FTIC students by their “persistence between the first and second year at college” (Kuh, Cruce, Shoup, Kinzie & Gonyea, 2008, p. 555)*
• Frequency: number of library visits in the first semester
• Duration: sum of hours spent in library in the first semester
![Page 48: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/48.jpg)
Superhero
Jingying Mao – Graduate Student & Statistical Analyst
• Cleaned data (matched each person who came in each time had to be matched with their swipe out).
• She applied the Generalized Propensity Score method –gave us a more rigorous approach to measuring library impact on student academic success
![Page 49: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/49.jpg)
Generalized Propensity Score
• Continuous treatment variables: frequency & duration
• Reduces self-selection bias (since we can’t use a random sample)
• Estimate the effect of a treatment by accounting for the covariates that predict receiving the treatment
![Page 50: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/50.jpg)
Frequency vs. First-term GPA
First-term GPA is minimized at 3.19 when the FTIC student only visits the library 3 times in his/her first semester.
*Black dotted lines are 95% confidence bands based on 1,000 bootstrap replications.
Threshold
![Page 51: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/51.jpg)
Frequency vs. First-year Retention
When the student only visits the library 15 times in his/her first semester, he/she will have lowest first-year retention rate at 93.89%.
Threshold
![Page 52: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/52.jpg)
Duration vs. First-term GPA
First-term GPA is minimized at 3.18 when the FTIC student only spends 1 hour in the library during his/her first semester.
Threshold
![Page 53: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/53.jpg)
Duration vs. First-year Retention
The minimum retention rate is achieved at 93.84% when the FTIC student only spends 21 hours in the library during his/her first semester.
Threshold
![Page 54: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/54.jpg)
Conclusions• Library usage has a positive effect on FTIC students first-term
GPAs and first-year retention rates past a certain threshold of frequency and duration.
• GPS is a good methodology to use because it:
• Minimizes self-selection bias
• Estimates the potential outcome (GPA & retention rate) at every possible value of library usage (frequency & duration)
![Page 55: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/55.jpg)
Limitations
• Definition of library usage as number and length of visits is broad.
• Only consider the physical usage of library, ignoring the digital usage of library.
• Cannot assure that students are studying while they are in the library.
• Not able to obtain all possible covariates that influence student’s library usage frequency and duration.
![Page 56: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/56.jpg)
Moral of the story…
If you spend time in the library over the course of your first year in college and you visit often and you stay for long periods of time, you are probably more likely to have higher grades and stay in school.
Just because you have a great story to tell, doesn’t mean you know precisely know how to leverage it for the students’ good or to donors or to other stakeholders (FLBOG).
![Page 57: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/57.jpg)
A happy ending?
• No money magically came to the library to stay open longer hours because the Provost found out that FTIC students who come to the library often and stay longer hours have better grades and stay at school.
• We probably need to tell our first-year students this at orientation.
• Call on your Marketing and Communications Superheroes.
• Storytelling and Statistics Working Group at FSU
• National Institute of Corrections Webinar in August
• FSU College of Criminology and Criminal Justice is bringing lots of grant money using the same methodology to research intervention effects on reducing recidivism
![Page 58: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/58.jpg)
Epilogue: Stay tuned!
Other stories to tell• Students from different majors need the library
more?
• Combined with other library usage and services• E-resource data
• Equipment checkout
• Instruction
• Outreach activities/Engagement
You can tell this story too!
![Page 59: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/59.jpg)
CreditsAstin, A. W. (1970). The Methodology of Research on College Impact, Part One.
Sociology of Education, 43(3), 223–254. https://doi.org/10.2307/2112065
Hirano, K., & Imbens, G. W. (2004). The Propensity Score with Continuous
Treatments. In A. Gelman & X.-L. Meng (Eds.), Applied Bayesian Modeling and
Causal Inference from Incomplete-Data Perspectives (pp. 73–84). John Wiley &
Sons, Ltd. Retrieved from
http://onlinelibrary.wiley.com/doi/10.1002/0470090456.ch7/summary
Imai, K., & Dyk, D. A. van. (2004). Causal Inference With General Treatment
Regimes. Journal of the American Statistical Association, 99(467), 854– 866.
https://doi.org/10.1198/016214504000001187
Mao, J., & Kinsley, K. (2017). Embracing the Generalized Propensity Score
Method: Measuring the Effect of Library Usage on First-Time-In-College Student
Academic Success. Evidence Based Library and Information Practice, 12(4), 129-
157. https://doi.org/10.18438/B8BH35
![Page 60: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/60.jpg)
Selected BibliographyAstin, A. W. (1993). What matters in college? : four critical years revisited (1st ed.). San Francisco: Jossey-
Bass.
Cox, B., & Jantti, M. (2012). Discovering the impact of library use and student performance. Deputy Vice-Chancellor (Academic) - Papers, 1–9.
FSU Factbook 2014-15 First-Time-in-College (FTIC) Admission Statistics 2006-2014. (n.d.). Retrieved from http://www.ir.fsu.edu/Factbooks/2014-15/Admission_Statistics.pdf
FSU Factbook 2015-16 First-Time-in-College (FTIC) Admission Statistics, 2006-2015. (n.d.). Retrieved from http://www.ir.fsu.edu/Factbooks/2015-16/Admission_Statistics.pdf
Kot, F. C., & Jones, J. L. (2014). The impact of library resource utilization on undergraduate students’ academic performance: A propensity score matching design. College & Research Libraries, crl14–616.
Kramer, L. A., & Kramer, M. B. (1968). The college library and the drop-out. College & Research Libraries, 29(4), 310–312.
Kuh, G. D., & Gonyea, R. M. (2003). The Role of the Academic Library in Promoting Student Engagement in Learning. College & Research Libraries, 64(4), 256–282. https://doi.org/10.5860/crl.64.4.256
Pascarella, E. T., Terenzini, P. T., & Terenzini, P. T. author. (1991). How college affects students : findings and insights from twenty years of research (1st ed.). San Francisco: Jossey-Bass Publishers. Retrieved from http://catdir.loc.gov/catdir/description/wiley037/90046068.html
Soria, K. M., Fransen, J., & Nackerud, S. (2013). Library use and undergraduate student outcomes: New evidence for students’ retention and academic success. Portal: Libraries and the Academy, 13(2), 147–164.
![Page 61: Methods for proving academic impact at the administrative ... 2018 Confere… · a DVD from the Media Collection 2,305 $2.00 $4,610 average cost for each DVD if rented an e-book from](https://reader033.vdocuments.us/reader033/viewer/2022042911/5f41ff53e303cb38207c4484/html5/thumbnails/61.jpg)
Selected Bibliography cont.Soria, K. M., Fransen, J., & Nackerud, S. (2014). Stacks, Serials, Search Engines, and Students’ Success: First-
Year Undergraduate Students’ Library Use, Academic Achievement, and Retention. The Journal of Academic Librarianship, 40(1), 84–91. https://doi.org/10.1016/j.acalib.2013.12.002
Soria, K. M., Fransen, J., & Nackerud, S. (2017). Beyond Books: The Extended Academic Benefits of Library Use for First-Year College Students. College & Research Libraries, 78(1), 8–22. https://doi.org/10.5860/crl.78.1.8
The Value of Academic Libraries: Library Services as a Predictor of Student Retention | Murray | College & Research Libraries. (n.d.). Retrieved June 12, 2017, from http://crl.acrl.org/index.php/crl/article/view/16541