cccb evaluation toolkit: overview and update on progress angela moore, mph 2009 ncccp & npcr...
TRANSCRIPT
CCCB Evaluation Toolkit: Overview and Update on
Progress
Angela Moore, MPH2009 NCCCP & NPCR Collaborative
MeetingApril 16, 2009
An Outline…
Why do we need an evaluation toolkit?What is an evaluation toolkit?How is it being developed?Where are we now?What are our next steps?
Why do we need a toolkit?
Call to Action
CCCB Funding Opportunity AnnouncementsCCCB Strategic PlanNACDD Evaluation WorkshopsNational Comprehensive Cancer Control Evaluation Framework
3. Communication
4. Technical Assistance and
Training
Programs and Activities
Focused Across the Cancer Continuum(per CCC
Framework)
Evaluation Plan Review
To abstract information on what
programs are evaluating and where they need additional
guidance
Specific Tasks for each Activity
Performance Measures Pilot
To develop and pilot performance
measures for CCC programs
Outputs
Evaluation Toolkit/Primer
Menu of Outcomes
Uniform Performance
Measures/ Indicators
Descriptive analysis of content of
programs’ cancer plans
Identified training needs and provide effective training and
TA to programs
Short-term Outcomes (<1 year)
Intermediate Outcomes(1-3 years)
Enhanced program capacity
for --planning
--evaluation--program
improvement
Sustained implementation of
CCC activities
CCC Conceptual Framework Specific to Current Evaluation Tasks
Cancer Plan IndexTo describe plans to know how to provide better guidance to
programs
Improved effectiveness of
cancer prevention and control
practice
Established performance management system that
drives fiscal decision making and accountability
and that stimulates program improvement
Ultimate Outcomes
(beyond 3 years)
B1b
C
1c
A
1a
Review of Evaluation Plans
Review of CCC evaluation plans was conducted to assess the status of evaluation expertise.
In 2008, a total of 40 CCC programs submitted evaluation plans that underwent descriptive and content analyses.
What did we learn?
Evaluation plans are in various stages of development– majority of evaluation plans address some but
not all of evaluation components specified in FOA
– many of the evaluation plans do not state the focus of the evaluation
Opportunity for technical assistance– CCCB should provide guidance and resources
around evaluation planning—a toolkit on evaluation!
Review of evaluation resources
Identification of resources external and internal to CDC – CDC & External Evaluation
Resources_granteecopy.xls
Conducted a cursory review
10 common elements
Common elements mapped to CDC Framework for Program Evaluation
Informed the development of our toolkit
What did we learn?
What is an evaluation toolkit?
What it is
A resource to help all CCCB programs effectively plan for and implement evaluations
It is a document that will provide programs with guidance on CDC expectations with respect to evaluation.
It is informed by:
• an understanding of what the programs currently know and an understanding of existing evaluation resources
• stakeholder input
What it isn’t
Document that encompasses all current evaluation theories, approaches, and applications
A prescription for conducting CCC evaluation
Proposed Content
Toolkit OverviewEvaluation Primer Program Specific Evaluation Guidance– Review of program purpose & grantee
evaluation requirements– Practical evaluation guidance based on CDC
Framework
Tools & TemplatesFor Further Study
How is it being developed?
Core steps for development
Gathering stakeholder input – Core CDC-RTI workgroup– Program Advisory workgroup
Development of content based on CDC eval framework
Pilot testing
Core steps for dissemination
In-service for CCCB Program Consultants
Disseminate to program directors
Training
Plan for future evaluations to inform expansion/enhancements/modifications
Where are we now?
So far…
Review existing documents:
•CCC Evaluation Plan Review
•Review of Existing Resources
Gather stakeholder input from DCPC and DCPC program staff (Winter 2009)
Convening CDC-RTI core workgroup
What are our next steps?
Proposed Timeline
Draft Toolkit Outline (Winter 2009)
Draft Toolkit Sections (Winter/Spring 2009)
Pilot Toolkit Sections with DCPC programs (Summer 2009)
Finalize Toolkit (Fall/Winter 2009)
Questions?
Thoughts?