nonprofit insights part 3 - bkd · nonprofit insights part 3 establishing measurable outcomes...
TRANSCRIPT
10/15/2019
1
Nonprofit InsightsPart 3 Establishing Measurable Outcomes
October 16, 2019
To Receive CPE Credit• Individuals
Participate in entire webinar Answer polls when they are provided
• Groups Group leader is the person who registered & logged on to the webinar Answer polls when they are provided Complete group attendance form Group leader sign bottom of form Submit group attendance form to [email protected] within 24 hours of webinar
• If all eligibility requirements are met, each participant will be emailed their CPE certificate within 15 business days of webinar
10/15/2019
2
Presenter Dan PraterSenior Managing [email protected]
Doing good must be supported by facts
https://leadingwithtrust.com/2017/07/02/broken-trust-3-steps-to-repair-regain-the-trust-youve-lost/
The Age of Assumed Virtue Is Gone
10/15/2019
3
70%
54%
50%
Very important that organizations have evidence that its programs are effective
Expect good ratings from watchdogs
Very important that organizations spend low amount on overhead/admin
Chronicle of Philanthropy 2015
Data Influences Nonprofit Investment
In a crowded market, the public wants to supportsuccessful organizations that have sound business
practices for sustainability
• Know where they are going (vision & strategic plan)• Manage to outcomes (impact & demonstrated results)• Understand their true costs & funding needs• Know if they are making progress & how to adjust if not
This means donors want to support nonprofits that
10/15/2019
4
https://lutheranfamilyservice.org/content/uploads/2016/11/pulled-in-different-directions-700x350.jpg
• Limited available resources• Ever-increased demand for services• Growing competition (CSR,3LC)
The Problem: Our Real World
We add more programs/services,
which is subtracting from our core
• Poor fit
• Distraction
Our Response? Add & Subtract
10/15/2019
5
DOB Effect
We’re aren’t necessarily efficient or effective, we settle for just
DoingOur Best
Copyright 2017, Insight Partners Consulting, LLC
The Consequence: Limited Impact
We collect data only for reporting purposesWe collect data because the foundation won’t give us money unless we do
We collect data to help determine if our programs & services truly make a difference in our clients’ lives & in their communities
Data Collection Approach
10/15/2019
6
1. Resiliency & Flexibility
2. Culture of High Performance
3. Culture of Learning & Innovation
Are you willing to adapt to changes in consumer? Attitudes, growing competition, technology changes? What are your strategies to make this happen?
What is your organization’s capabilities for doing this?(internal & external)
How will your organization know if progress is made?Are you innovative in your problem-solving?
The New Normal for Nonprofit Groups
https://en.wikipedia.org/wiki/The_Pew_Charitable_Trustshttps:www.pinterest.com/pin/300685712598404690/?lp=true
en.wikipedia.org/wiki/File:Bill_%26_Melinda_Gates_Foundation_logo.svgz
Nation’s Largest: Shift in Funding Approach
10/15/2019
7
Limited staff time
Insufficient finances resources
Limited staff expertise
Knowing where to find external help
No support from org leadership
Funders ask for wrong data
Not having staff who believe inimportance of data collection
71%
61%
39%
29%
19%
15%
12%
SOURCE: state of evaluation.org
Only 1/3 of Nonprofits Measure Outcomes –Why?
Activity = What you do
ActivityWe feed hungry kids before school
OutcomeImproved health (not hungry)Better behaviorBetter gradesHigher graduation rate
Outcome = Result of the activity
Outcome vs. Activity
10/15/2019
8
An outcome is a promise delivered
It tells donors, community partners, volunteers, that
We told you we were going to do ...We closely monitored & evaluated the work ...We can say for sure that it worked
Your trust & investment paid off!https://www.safecorhealth.com
Outcomes
Activity Assessment- served 100 youth during camp- provided 1,500 hours of tutoring - 9 out of 10 youth attended art classes
Outcome Assessment- 75% of campers increased knowledge of local history- 50% increased math grades by one grade level- 25% fewer youth reported being bullied last year
We did these things & because
we did them
These things happened
Outcome vs. Activity
10/15/2019
9
STRATEGIES
IMPACT
GOALS
Make sure there is alignment with goals/activities & impact
Use data to make important changes to or correct their programs & services so they are the most
effective possible
Use data to tell the story of their work
Impact-Driven Organizations
Complete Timely
Reliable Accurate
Four Measures of Quality Data
10/15/2019
10
Set benchmark indicators as reference points to evaluate
progress toward reaching goals.
When it comes to determining how efficiently your organization operates, few things are as helpful as accurate, relevant performance indicators that
can show you exactly how well you’re doing
What are factors causing issue/problem?Was there a change? How much?Difference between beginning & end?
https://www.vectorstock.com/royalty-free-vector/bullseye-and-arrow-icon-vector-10310999
Benchmarking Indicators: Defining Success
• What factors lead to & keep people in poverty?• What must be addressed to improve their lives?
10/15/2019
11
Example of measuring/tracking
indicators of success
Personal photo taken by Dan Prater
Example of measuring/tracking
indicators of success
10/15/2019
12
Reduce services to conduct evaluation, if that’s what it takes
Do not reduce services to conduct impact evaluation
Programs lacking hard evidence that they generate the level of change desired, must be eliminated or scaled back even if it requires serving fewer people/needs (to free up time & funds for the evaluation)
YES NO
Is it ethical to have people enroll in our programs & use our services if we are not 100% sure they
are highly effective? Or as good as they should be?
Accountability: Know if it truly has a positive impact
Learning: Determine what works/what does not
Ethics: Not measuring impact is a form of injustice
10/15/2019
13
Mission
Vision
Values
or get swept away by the forces of our sector & world
We lose sight of who we are, why we exist,what we do
Build a Firm Foundation
› What is the ultimate goal or desire?
› How does change happen?
› What part of that can we impact?
› What change are we aiming for?
› What will it take to make that change?
Theory of Change – “Change process”
Vision – “Why”
Mission – “What we do”
Outcomes – “To what degree”
Logic Model – “How”
The Path Toward Impact
10/15/2019
14
We love indicators!
Miles per gallon
Politicianapproval ratings
Amazon.comcustomer reviews
Passing yardsinterceptionscompletion rate
https://cdn.vox-cdn.com/thumbor/qfq_CuLus9jWa_MVDmiPbOPsvpA=/0x0:2896x1930/1200x800/filters:focal(1752x391:2214x853)/cdn.vox-cdn.com/uploads/chorus_image/image/62833302/usa_today_11818040.0.jpg
We Live in a Data-Crazy Society
Do not attempt to measure
1. Things you don’t do
2. Things you don’t need to know
3. Things beyond your control
Word of Caution
10/15/2019
15
Before Program/Service After Program/serviceProgram/Service Delivered
Control group: How did those who did not receive your servicescompare to those who did receive your assistance?
Have things changed over time?
What was situation before, then what was situation after program?
Traditional Type of Evaluation
Mission Statement
is expressed as an ...
Outcome
which is expressed as an ...
Indicator
which is an
Item for a survey
From Mission to Survey Questions
10/15/2019
16
‘if-then’ relationships that express the program’s THEORY OF CHANGE
IF then IF then
If-then relationships
IF then
Theory of Change
Method Purpose
Questionnaires &surveys
Quick, easy way to gather info from people in non-threatening way.
Interviews Go deeper than surveys, learn about deeper feelings, follow up on answers to surveys
Reviewapplications/forms
Look for important or significant findings
Observations View activities as they occur
Focus groups Explore topics in-depth, get reactions & suggestions
This is an overview of major methods
Gathering Data
10/15/2019
17
The ultimate reason you should bemeasuring outcomes & effectiveness
is to better serve your clients & community
Questions?
10/15/2019
18
bkd.com | @BKDLLP @BKDNFP @BKDHigherEd @Dan_Prater
The information contained in these slides is presented by professionals for your information only & is not to be considered as legal advice. Applying specific information to your situation requires careful consideration of facts & circumstances. Consult your BKD advisor or legal counsel before acting on any matters covered
Thank you!
BKD Thoughtware®
• Webinars, seminars & articles
• Many are CPE-eligible
10/15/2019
19
BKD, LLP is registered with the National Association of State Boards of Accountancy (NASBA) as a sponsor of continuing professional education on the National Registry of CPE Sponsors. State boards of accountancy have final authority on the acceptance of individual courses for CPE credit. Complaints regarding registered sponsors may be submitted to the National Registry of CPE Sponsors through its website: www.nasbaregistry.org
Continuing Professional Education
CPE Credit
• CPE credit may be awarded upon verification of participant attendance
• For questions, concerns or comments regarding CPE credit, please email the BKD Learning & Development Department at [email protected]
10/15/2019
20
bkd.com | @BKDLLP @BKDNFP @BKDHigherEd @Dan_Prater
The information contained in these slides is presented by professionals for your information only & is not to be considered as legal advice. Applying specific information to your situation requires careful consideration of facts & circumstances. Consult your BKD advisor or legal counsel before acting on any matters covered
Thank you!