using outcomes evaluation for building support samantha becker, mlis, mpa research project manager...

30
USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Upload: camron-wiggins

Post on 16-Jan-2016

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

USING OUTCOMES EVALUATION FOR BUILDING SUPPORTSamantha Becker, MLIS, MPAResearch Project ManagerUniversity of Washington Information School

Page 2: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

WELCOME!Thank you for being here .

4/26/2012 2

Page 3: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

About your presenter

Seattle, WA

Samantha Becker, MLIS, MPAResearch Project [email protected]

http://www.flickr.com/photos/43553042@N00/5030228469

4/26/2012 3

Page 4: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Goals for today’s webinar• Learn new ways of using your evaluation efforts to mobilize support and bolster organizational sustainability by:• Developing messages to policy audiences• Preparing internal audiences and supporters• Building partnerships to leverage resources

4/26/2012 4

Page 5: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

LEVERAGING EVALUATIONGet more out of what you’re already doing

4/26/2012 5

Page 6: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Recycling is not just for office supplies

4/26/2012 6

Reuse, recycle, repurpose

Page 7: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Uses of evaluation

74/26/2012

Page 8: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

99

88

77

66

55

44

33

22

11

The basics of evaluation

Evaluation team

Needs assessm

ent

Theory of

change

Logic model

Evaluation

questions

Indicators

Data sources

Analysis plan

Reflective

practice

8

Page 9: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

• Define the outcomes you are trying to achieve in terms of important and high-value impact areas:• Outcomes: What do clients need to do or have that they

don’t now?• Impact: How will being able to do or have those things

improve their lives or community?

The needs assessment

4/26/2012 9

Statement of need

Call to action

Struggle to succeed

Moving ahead

ReinvestingThe nonprofit story arc

Page 10: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

The theory of change• What kinds of activities need to occur in order to achieve outcomes?

• How are those outcomes accomplished through your organization?

4/26/2012 10

Statement of need

Call to action

Struggle to succeed

Moving ahead

ReinvestingThe nonprofit story arc

Page 11: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

The logic model

4/26/2012 11

The struggle to succeed: turning straw into gold

Page 12: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Indicators give weight to the logic model

12

Page 13: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

PUTTING IT TOGETHERThree tasks for sustainability

4/26/2012 13

Page 14: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

1. Messaging

4/26/2012 14

Start with the basics

Page 15: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Messaging about value• Use your logic model and indicators to talk about what happens at your organization:• What resources do you offer? (inputs)

• What is special or unique?• What do you have more of?

• What do you do? (activities)• Conduct programs• Deliver services• Provide training or classes

• Who do you reach and what do they do?(outputs)• Clients• Participants• Agencies/other organizations

4/26/2012 15

Page 16: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Breakdown input costs• Budget = $18m/year

• Break it down to show per capita and shorter time span/units• $11.7 m/year• $22.53 per client/year• $1.88 per client/month

4/26/2012 16

Make comparisons• Providing [all these activities/outcomes] costs less than…

Page 17: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Make your outputs interesting…

4/26/2012 17

But keep minimal

• Training hours provided

• Number of classes taught

• Number of clients served

vs.

Page 18: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Bridging your activities: articulating a theory of change

Theory of change

• Express how you see your activities as creating change in your clients to bridge what you do with what you want to accomplish for the community

4/26/2012 18

Page 19: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

2. Preparing supporters

4/26/2012 19

Page 20: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Preparing your supporters• Use your indicator data to prepare supporters• Make sure they understand the data and can present it accurately

• Provide supporting material• Prepared reports about outcomes from your evaluation

surveys• 2-page fact sheets to leave with potential supporters• Testimonials and quotes from interviews and focus groups

with clients

• Staff, board members, advocates should be trained before going out to talk to potential funders

• Practice telling stories & giving 2 minute “elevator” speeches

4/26/2012 20

Page 21: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Messaging that works with policy makers• Focus on the outcome indicator data you have collected• Don’t spend a lot of time on activities or outputs

• Be prepared to tell stories of at least 3 clients who have achieved your organization’s ultimate goal• Focus on high level outcomes and how your organization

contributed to your client’s success

• Remember: Stats (from your indicators)+ Stories (from your interviews)= Successful advocacy

4/26/2012 21

Page 22: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

3. Build partnerships using your logic model

4/26/2012 22

• Link your efforts to the goals of other community based organizations

• Show how your organization contributes to common policy goals and that working together can extend the reach of both partners

• Show how your organization relieves some burden on the partner

Page 23: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Additional benefits partnerships• Loops back to effective messages for policy makers• Shows that you are serious about sustainability• Provides evidence that you are most interested in your

clients’ outcomes and your contribution to important impacts

• Develops new supporters • Turns potential competitors into allies• Extends your network

Page 24: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Pitfalls to partnerships• “Shadow mandates”

• Partners that don’t contribute• Organizations that quietly use your resources but don’t

acknowledge or reciprocate

But… there is a way of shining light on your shadows and turning them into productive partnerships.

Page 25: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Use your logic model with others to show how your organization shares common goals

Example: Workforce Development Community technology

1.Workforce development clients use community technology to look for and apply for jobs

2.Clients get jobs

3.Workforce is improved

12

3

Workforce Development Agency

Community Technology

Situated Logic Model

4/26/2012 25

Page 26: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Searching for compatibility• How are you compatible?

• (IMPACT LEVEL) You both care about helping people become economically self-sufficient (healthy families, literacy, etc)

• How do you complement each other?• (OUTCOME LEVEL) They have expertise in resume

preparation and job-searching; you have expertise in basic computer skills training and using the Internet

• (INPUT LEVEL) You have space; they have a van• How can a partnership bring out the best in both of you and help your clients achieve better outcomes?• (ACTIVITY LEVEL) You can provide basic computer skills

training and open lab time for their clients to practice technology skills

• (ACTIVITY LEVEL) They can provide more expert support specifically on job-seeking and train your staff on online job-seeking resources

4/26/2012 26

Page 27: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Constructive attitudes• We are all trying to do good works!• We aren’t competitors • There will never be enough money or time• We are striving for effectiveness and efficiency• How can we amplify our value? (1+1=3)

4/26/2012 27

Page 28: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

LAST THOUGHTSThinking in performance management

4/26/2012 28

Page 29: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

Performance management done well…• Fosters a culture of Organization Learning • Fosters Intentionality, Clarity, and Specificity• Helps clarify goals of services• Prevents mission creep• Gets staff involved • Frames successful advocacy and partnerships• Is integrated into org (not just one person’s job)

4/26/2012 29

Page 30: USING OUTCOMES EVALUATION FOR BUILDING SUPPORT Samantha Becker, MLIS, MPA Research Project Manager University of Washington Information School

THANK YOU!

4/26/2012 30