integrating assessment and planning: path to improved library effectiveness wanda dole, donna rose,...
TRANSCRIPT
![Page 1: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/1.jpg)
Integrating Assessment and Planning: Path to Improved
Library Effectiveness
Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of
Arkansas at Little Rock
Seattle, WA, August 2008
![Page 2: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/2.jpg)
Outline
• Introduction
• Strategic Planning
• Assessment
• Two case studies – K-State University– UALR
• Conclusions
![Page 3: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/3.jpg)
Introduction
• “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998)
• Our response:– Yes, in the area of library planning
![Page 4: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/4.jpg)
Who we are
• Dole– Planning and assessment: interests since Library
School (UIUC)– Strategic Planning (PSU, SUNY SB, WU, UALR)
Assessment (SUNY SB, WU)
James, Martin, Rose– some previous experience with strategic planning or
assessment
![Page 5: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/5.jpg)
Literature
• Strategic Planning : vast
• Assessment: vast
• Integrated approach: little
![Page 6: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/6.jpg)
Characteristics of Strategic Planning
Strategic Planning links library’s priorities to
-Priorities of the parent institution
-Needs of library users
-Allocation of resources
![Page 7: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/7.jpg)
![Page 8: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/8.jpg)
Assessment
• Input/Output Measures– Operating budgets– Collections, staffing, facilities
• Statistical analysis– Bibliometrics– Benchmarking
![Page 9: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/9.jpg)
Assessment
• Outcomes measurement– Response to call for accountability in higher
education– Difficult to do
• Service Quality/User Satisfaction– ARL New Measures
![Page 10: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/10.jpg)
![Page 11: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/11.jpg)
Organizational Change
• Changing a culture requires the constant redesign of the infrastructure and frame of reference that that define appropriate and inappropriate values, expectations and activities. Covey (2002, 163)
• Strategic planning can do this
![Page 12: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/12.jpg)
Our Earlier Work Compared Planning and Assessment at
• K-State• Research Extensive
• 23,000+ student• 2000+ faculty• 57 librarians• 49 support staff• $14.1 million
operating budget
• UALR• Doctoral/Research• 12,000 students• 800+ faculty• 13 librarians• 25 support staff• $4.8 million operating
budget
![Page 13: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/13.jpg)
Strategic Planning
• K State – Strategic Planning
Preceded Assessment
• UALR– Assessment Preceded
Planning
K-State’s plan is available:Kansas State
![Page 14: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/14.jpg)
Strategic Planning at UALR
• 1970s, 80s, 90s– Planning, mainly brainstorming– Top-down– Unstructured approach– No assessment
![Page 15: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/15.jpg)
Strategic Planning at UALR
• August 2006, strategic planning retreat– Outside consultant– Broad participation of library faculty & staff– Development of mission & vision statements
• 2006 – present– Working groups revised mission & vision– New groups formed to develop goals &
strategies
![Page 16: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/16.jpg)
![Page 17: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/17.jpg)
Strategic Planning at UALR
• July 2007, 2nd retreat-Working groups ALL agree that planning must include assessment
-Assessment plan formed• Focus groups, fall 2007• LibQUAL+®, spring 2008
• July 2008, 3rd retreat-Results of Assessment shared
-Facilities to be focus for 2008-2009
![Page 18: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/18.jpg)
![Page 19: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/19.jpg)
UALR Focus Group Reports
• 35 participants, faculty and students• Concepts
– Library as place– Library as services– Library as people
• Questions– What is working– What needs improvement
![Page 20: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/20.jpg)
Focus Group Responses
• Culture of good will
• Consumer mind sets
• Integration of services
• Interest in setting and facilities
• Interest in collections
![Page 21: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/21.jpg)
LibQUAL+® Results
• 794 responses and 280 comments – students, faculty and staff
• Generally, satisfied with library staff and services
• Identify areas where more assessment should be done
• Self-study grids – focus group and LibQUAL+®
![Page 22: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/22.jpg)
![Page 23: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/23.jpg)
![Page 24: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/24.jpg)
What Users say Needs Improvement
AssessmentTool
What DidWe Do?
When? If nothing why?Negative forces?
Is it working?
•Computer terminals too crowded
•Need more electrical outlets
Focus Group
2007- 2008LibQUAL+®
•Computer lab was doubled in size to provide additional computers and ADA resources
•Beginning of new fiscal year
•Students appear to be pleased with changes
•Update furniture and décor (6 comments)
•Floor fans noisy
Focus Group
2007-2008LibQUAL+®
•Furniture for three public areas has been ordered•Continued to run fans to assist in controlling humidity
•Beginning of new fiscal year•This is an ongoing activity
•Furniture not received yet, Will observe to see how it received by patrons•Continue to receive complaints
•Poor lighting(3 comments)
Focus Group -2007 •Nothing at this time, needs more study
•Map showing where the rooms are and how to get there (2 comments)
•Room numbering is confusing
Focus Group -2007 •Under discussion
•Nothing at this time
UALR Assessment Grids
![Page 25: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/25.jpg)
![Page 26: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/26.jpg)
![Page 28: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/28.jpg)
UALR: Integrated Approach
• What worked?– Data confirmed some assumptions
• Facilities need improvement
• What didn’t work?– No impact on Training Task Force– Waiting for data delayed planning
• Collections Task Force
![Page 29: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/29.jpg)
Conclusions
• Integrated assessment and strategic planning– Not much in the literature
• K-State – 1982-1999, planning alone – 1999-present, assessment and planning
• UALR – 2006 to present, integrate assessment and
planning
![Page 30: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/30.jpg)
Conclusions
• “Are we any closer to knowing whether performance measures lead to library effectiveness than when the debate began 25 to 30 years ago?” Cullen (1998)
• Our response:– Yes, in the area of library planning– Assesment data helped us to be effective in
improving library faciltites
![Page 31: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/31.jpg)
Questions
• Is the combination of strategic planning & assessment a new approach?
• Is it an example of the Culture of Assessment? (Lakos & Phipps)
• Have other libraries done the same things?
• Had the same results?
![Page 32: Integrating Assessment and Planning: Path to Improved Library Effectiveness Wanda Dole, Donna Rose, Maureen James, Suzanne Martin, University of Arkansas](https://reader036.vdocuments.us/reader036/viewer/2022062511/551aa3e1550346856e8b46a2/html5/thumbnails/32.jpg)
Questions? Comments?
• Thank you!