project outcome panel: user experiences & lessons learned · 2017 plans. project outcome &...

55
Project Outcome Panel: User Experiences & Lessons Learned June 15, 2017

Upload: others

Post on 31-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Project Outcome Panel:

User Experiences & Lessons Learned

June 15, 2017

Page 2: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Today’s Speakers

Julianne RistDirector of Public

Services

Jefferson County

(Colo.) Public Library

Emily PlagmanProject Manager

Public Library

Association

Carrie HerrmannLibrary Director

Boone County (Ky.)

Public Library

Amy MikelCoordinator of

School Outreach

Brooklyn (N.Y.)

Public Library

Page 3: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

What we will cover today

▪ Project Outcome Speed Summary

▪ Panelist Libraries

− Boone County, KY

− Jefferson County, CO

− Brooklyn, NY

▪ Wrap-up & Questions

Page 4: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

If yes – click “Raise Hand” icon

Poll:

Do you consider yourself as being

“new” to Project Outcome?

Page 5: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

About Project Outcome

Page 6: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Surveys for 7 Service Areas

Page 7: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Dummy Data

Page 8: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Webinar Archives

How to Successfully Roll Out Project Outcome in Your Library

Page 9: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Project Outcome Roadmap

Page 10: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Community of Practice

www.projectoutcome.org

Page 11: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Carrie HerrmannLibrary Director

Boone County (Ky.)

Public Library

Page 12: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

www.bcpl.org

Project Outcome

Boone County (Ky.) Public Library

Page 13: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

Boone County Public Library

Northern Kentucky

Population: 126,000+

Fastest Growing County in Kentucky

5 locations + 1 under construction

Community Center on Wheels

Operating Budget: $7,911,958

FTE Staff: 102 (Total 148)

Page 14: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

Why BCPL Measures Outcomes

• Strategic Plan/Goals

• Improve/Build Partnerships

• Funding Concerns

Page 15: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

How Project Outcome Works

Project Outcomes

Identify Measurement Need & Goals

Survey a Program

Understand & Analyze Results

Communicate Findings

and/or Make Changes

Page 16: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

Have a Plan

• Who decides which programs to survey?

• Who decides when to survey?

• Who administers the surveys to customers?

• Who enters the data?

• Who reviews the data and prepares it for use?

Page 17: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

We MeasuredEarly Childhood Literacy

• Storytime

• Parent/Child Development

• Every Child Ready to Read/School Ready Libraries

• Reading in general

Page 18: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Early Childhood Literacy

Page 19: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Early Childhood Literacy

Page 20: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

We Measured Education/Lifelong Learning for Retired Adults

• Homebound Delivery

• Programs at Nursing Homes/Retirement Centers/Senior Centers

Page 21: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Homebound Delivery

Page 22: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Homebound Delivery

Page 23: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Retired Adult Outreach Programs

Page 24: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

What We Learned:Retired Adult Outreach Programs

Page 25: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Boone County Public Library

Contact MeCarrie Herrmann

[email protected]

859-292-3387

Follow me at:

LinkedIn https://www.linkedin.com/in/carrie-herrmann-3929758/

Twitter https://twitter.com/CarrieHerrmann

Page 26: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

What questions do you have for Carrie?

Please share your questions in chat

Page 27: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Jefferson County

(Colo.) Public Library

Julianne RistDirector of Public Services

Page 28: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Population of Service Area: 578,101

Annual Operating

Expenditures: $31,388,971

Number of Libraries: 10

FTE Staff: 208

About JCPL

Page 29: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Evidence Based Decision Making

Page 30: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Programs that have used Project Outcome

LibLab Kits

▪ Grant reporting

▪ Pilot Evaluation

▪ Type of kits to add

Page 31: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Programs that have used Project Outcome

Summer Reading 2016

▪ Over 1000 responses

▪ Changes to program

▪ Credibility when reporting to the Board

▪ Stories that enhance the data

▪ 2017 plans

Page 32: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Project Outcome & Strategic Planning

2017 Strategic Priority:

1000 Books Before Kindergarten

▪ Pilot evaluation

▪ System-wide implementation Fall 2017

▪ Long-term tracking

▪ Combined with school data – impact on

community

Page 33: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Strategic Planning

▪ Establish baselines for programs

▪ Used for success measures

▪ Tracking for larger community goals

▪ Benchmarking

▪ Impact on patron’s lives

▪ Credibility

▪ Expertise

Page 34: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Long-Range Planning

Triad of tools

▪ Edge Initiative

▪ Impact Survey

▪ Project Outcome

Creates a culture of constant

▪ Evaluation

▪ Measurement

▪ Reporting

Page 35: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Contact information:

Julianne Rist

director of public services

Jefferson County Public

Library

10200 W. 20th Avenue

Lakewood, CO 80215

p 303.275.2236

[email protected]

Contact Info

Page 36: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

What questions do you have for Julianne?

Please share your questions in chat

Page 37: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Brooklyn (N.Y.)

Public Library

Amy MikelCoordinator of

School Outreach

Emily PlagmanProject Manager

Public Library

Association

Page 38: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Project

Outcome

For Individual

Projects

Page 39: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Big Library, Big Changes

Brooklyn Public Library

• One of three public library systems in New York City

• 58 branches, serving 2.5 million residents

• 46% of residents speak a language other

than English at home

• Rapid growth: 100+ new staff hired

over past three years (and still hiring)

Page 40: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Early Adopter

Why Project Outcome?

• BPL does not have an “official” in-house

outcome measurement system

• Opportunity to pilot for a stand-alone project

overseen by one individual

• Adopted June 2015

Page 41: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Piloting Outcomes

Visit bklynlibrary.org/teacherlab for more info

Teacher Lab: Library & Research Skills course

• Designed to help educators feel more confident

finding resources for their classrooms

• Summer four-day course

• Online course launches July 2017

… plus, professional learning workshops

offered year-round

Page 42: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Process & Results

Using Surveys

• Report: Education/Lifelong Learning

• Every educator workshop and course

surveyed as of August 2015

• Attendees must complete paper survey

before receiving their certificate of

attendance (professional credit)

Page 43: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Feedback

Page 44: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

What worked well?

Ease

• Adaptable for an individual project within BPL

• Surveys easy to create & easy to take

• Simple dashboard to enter and generate reports

Consistent Results

• “Teaching to the test”

• All workshops evaluated against the same scoring system

• Affirmation of project goals

Page 45: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Grant Award (October 2016)

IMLS Sparks! Ignition Grant for Teacher Lab

Reviewer Feedback

“Ongoing program evaluation will be conducted through ALA's

Project Outcome Tool Kit. I felt that the utilization of this

existing measurement tool was a strength of the proposal.”

“It's great that Project Outcome is being used to assess Teacher

Lab as it's a free and open resource for all libraries to use.”

“The ongoing evaluation using PLA's Project Outcome toolkit

guarantees a high standard in language around the indicators

and process.”

Page 46: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Evolving Data Collection

Page 47: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Questions?

Amy Mikel

Coordinator of School Outreach

[email protected]

Teacher Lab Info

www.bklynlibrary.org/teacherlab

IMLS Grants and Funding

www.imls.gov/grants

Page 48: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Wrap-up &

Questions

Emily PlagmanProject Manager

Public Library

Association

Page 49: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Join Us @ ALA Annual

Page 50: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Next Webinar

Project Outcome Two-Year Updates & Discussion

July 20, 1-2 PM Central

Page 51: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Page 52: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Community of Practice

www.projectoutcome.org

Page 53: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

If you haven’t already…

• Sign up on the Project Outcome website

• Browse free training resources

• Continue the conversation on Community of Practice

• Create your surveys!

www.projectoutcome.org

Page 54: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Questions?

Please share your questions in chat

Page 55: Project Outcome Panel: User Experiences & Lessons Learned · 2017 plans. Project Outcome & Strategic Planning 2017 Strategic Priority: ... • Online course launches July 2017 …

Thank you!