assessing the capacity of community coalitions to advocate for change
DESCRIPTION
Research has shown that high-capacity coalitions are more successful in effecting community change. While a number of coalition assessment tools have been developed, documentation is scarce regarding how they are implemented, how the results are used, and whether they are predictive of coalition success in collaborative community change efforts. Developed for a health promotion initiative of a major health foundation, this tool is designed to assess coalition progress in eight key areas across twelve different community coalitions, over the course of a three year initiative. On May 21, 2013, Veena Pankaj, Kat Athanasiades, Ann Emery, and Johanna Morariu gave a presentation titled "Assessing the Capacity of Community Coalitions to Advocate for Change." The panel was hosted by the Advocacy Planning and Evaluation Program (APEP) at the Aspen Institute in Washington, DC. The session focused on a coalition assessment tool that was designed by Innovation Network to assess changes in coalition capacity over time. Presenters shared lessons learned from the first year of the initiative about developing and deploying the assessment tool, as well as what these tools can--and can't--tell you about a coalition's capacity in conducting community change work. In addition presenters shared how information collected from this assessment can be communicated back to the coalitions using data visualization approaches to effectively communicate the data.TRANSCRIPT
Veena PankajKat AthanasiadesAnn EmeryJohanna Morariu
Assessing the Capacity of Community Coalitions to Advocate for Change
Advocacy Evaluation Breakfast SeriesHosted by the Aspen Institute
Washington, DCMay 22, 2013
Veena PankajDirector [email protected]
Kat AthanasiadesAssociate [email protected]
Ann EmeryAssociate [email protected]
Johanna MorariuDirector [email protected]
www.innonet.org | @InnoNet_Eval | #CATeval
About Us
#CATeval@InnoNet_Eval@KatAthanasiades@AnnKEmery@J_Morariu
Let’s Connect
www.innonet.org | @InnoNet_Eval | #CATeval
What’s the first thing to come to mind when you hear
advocacy evaluation?
www.innonet.org | @InnoNet_Eval | #CATeval
What’s the first thing to come to mind when you hear
coalition assessment?
www.innonet.org | @InnoNet_Eval | #CATeval
How does this session relate toyour work and interests?
www.innonet.org | @InnoNet_Eval | #CATeval
Agenda
1 Background
2 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applicationswww.innonet.org | @InnoNet_Eval | #CATeval
Agenda
12 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applications
Background
www.innonet.org | @InnoNet_Eval | #CATeval
Agenda
12 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applications
Background
www.innonet.org | @InnoNet_Eval | #CATeval
Snapshots
DevelopedImplemented
Report
Aug 2012
Sept2012
Jan 2013
Development & Implementation2
Oct2012
www.innonet.org | @InnoNet_Eval | #CATeval
Seven categories of CATBasic Functioning and Structure
Ability to Cultivate and Develop Champions
Coalition Leadership
Ability to Develop Allies and Partnerships
Development & Implementation2
Reputation and Visibility
Ability to Learn from the Community
Sustainability
www.innonet.org | @InnoNet_Eval | #CATeval
Vetting processKansas Health Foundation staff
GEO Place-Based Community of Practice
Kansas Advisory Committee
Development & Implementation2
Healthy Communities Initiative Technical Assistance
team
Coalition members
www.innonet.org | @InnoNet_Eval | #CATeval
Development & Implementation2
56 coalition members
12 TA providers
68 total responses
www.innonet.org | @InnoNet_Eval | #CATeval
Agenda
12 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applications
Background
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
Report SnapshotsMemos
www.innonet.org | @InnoNet_Eval | #CATeval
Overall Scores
Reporting to Stakeholders3
Community 6Community 4Community 9Community 8Community 2
Community 11Community 7
Community 12Community 3Community 5
Community 10Community 1
29%
40%
55%
64%
66%
68%
69%
70%
77%
79%
80%
81%
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
1-page Community Snapshots
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
Memos
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
0% 20% 40% 60% 80% 100%
Series3
52%
Basic Functioning and Structure
Allies and Partnerships
Champions
Reputation and Visibility
Learn from Community
Coalition Leadership
Sustainability
Overall
Community Members
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
0% 20% 40% 60% 80% 100%
Basic Functioning and Structure
Allies and Partnerships
Champions
Reputation and Visibility
Learn from Community
Coalition Leadership
Sustainability
Overall
TA Providers
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
0% 20% 40% 60% 80% 100%
Series3Basic Functioning and Structure
Allies and Partnerships
Champions
Reputation and Visibility
Learn from Community
Coalition Leadership
Sustainability
Overall
Community Members
TA Providers
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
Report
Region?Time in coalition?Time in community?Engagement?Number of members?Number of new members?
www.innonet.org | @InnoNet_Eval | #CATeval
Reporting to Stakeholders3
More time in coalition
More coalition members
Higher scores
www.innonet.org | @InnoNet_Eval | #CATeval
Agenda
12 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applications
Background
www.innonet.org | @InnoNet_Eval | #CATeval
This survey is too long for busy people.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
I hadn’t thought about us collecting feedback on whether the community is satisfied with our work because we are so busy doing the work… Very interesting question.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
The initial mission, vision, and values are defined but under development.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
Our monetary resources are limited to the planning grant monies.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
These questions… are good questions for us to have as a guide for our work.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
Realistically, many of these points cannot be accomplished within a year, but it is a goal to strive towards.
—Coalition member
Strengths & Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention
Strengths4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention
Strengths4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention
Strengths4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention
Strengths4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention
Strengths4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time
Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time
Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time
Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus might change over time
Challenges4
www.innonet.org | @InnoNet_Eval | #CATeval
Agenda
12 Development & Implementation
3 Reporting to Stakeholders
4 Strengths & Challenges
5 Summary & Applications
Background
www.innonet.org | @InnoNet_Eval | #CATeval
Materials
www.innonet.org
Where We’ve Been
www.innonet.org | @InnoNet_Eval | #CATeval
Assessing the Capacity of Community Coalitions to Advocate for Change
Thank You!
Veena PankajDirector [email protected]
Kat AthanasiadesAssociate [email protected]
Ann EmeryAssociate [email protected]
Johanna MorariuDirector [email protected]
www.innonet.org | @InnoNet_Eval | #CATeval