week 3 - engagement and etypes (2015-11sept)
DESCRIPTION
SW evaluationTRANSCRIPT
Reading Guide
Evaluation Types & PerspectivesSW 740September 11, 2015
and replace those words with a picture, chart or diagram. Then apply a consistent treatment to your graphics to give your whole presentation a unified look so that your audience is attracted to, rather than distracted from, your message.21. Engage StakeholdersWHOAREYOURSTAKEHOLDERS
The first rule is: Treat your audience as king.45StakeholdersThose organizations and individuals who care about either the program or the evaluation findings
In general, anyone who has something to gain or lose from the program
WHATARETHEIRQUESTIONS
ConcernsInterestsCommitmentsThe first rule is: Treat your audience as king.6
Your audience deserves to be treated like royalty. Design a presentation that meets their needs, not just yours.7How are SWs uniquely qualified to engage stakeholders?
ActiveListening
Along the way weve discovered9so it sounds like you need.2. Describe the program2. Describe the Program/InterventionMission and goalsWhat are the objectives?What are the activities?What is the program?Have they assessed outcomes?What do they believe about their program?
2. Describe the Program/InterventionSources of information for this step:StakeholdersBrochuresPrevious evaluations, annual reportsOriginal funding sources (policies, acts, RFPs)Personnel
Did we forget anyone?2. Describe the Program/InterventionMore to come Unit 2, Situational AnalysisUnit 3, Logic Model3. Focus the evaluation design3. Focus the evaluation designUnderstand the possible perspectives that drive the evaluationUnderstand possible types of evaluation that may be neededUnderstand the interventions readiness for the evaluation (Wk 5)
Evaluation perspectivesGLORIAIf you went before county commissioner, how would you present findings to your stakeholders?AccountabilityCritical for this type of presentation to attract attention to stakeholdersDevelopmentalKnowledge
What do you now know about evaluation perspectives?
17Stepney & Rostila articleWhat evaluation perspectives did they discuss?How are these perspectives used?Which perspectives are you most familiar with?Why are these perspectives important to know?Government accountability office Exciting GAO Report
Child and Family Services Reviews Federal DCFS Reviews
AccountabilityJill
AccountabilityConnected with benchmarks and reporting requirementsConnected policy and funding
Examples: GPRA, GAO, SAMHSA, Child Welfare Reviews
From this perspective, is it research or evaluation?
Gloria
Pick up conversation about research/evaluation discuss RTCs
How would the evaluation be impacted according to this perspective, what is the role of the evaluator?Very specific questions and answers, may not get to overall program improvement/outcomes
19Family Resource Center funding
County Agency yearly reports to county commissioners
Grant Applications& Reports to Funders
Developmental Evaluation in Practice
Descriptive processTrendsResponding to changing needsJill
What do you know about this perspective?
Gloria
Discuss work with public guardians office
What are the implications for evaluation from this perspective?May have a hard time reporting outcomes to funders, may be more focused on processFocuses on program improvement
21KnowledgeEmerging questions
ReadinessProchaska & DiClemente: Stages of changeTo change: for exercise
232.1.10.b AssessmentC27 Assess client system readiness for changeAdditional perspectivesContinuous Monitoring vs. Project ApproachContinuous MonitoringData collection is integrated into programProvides immediate and ongoing feedbackBuy-in from staffRecommended changes are feasible
Project ApproachData collection is done once or periodically Provides a reportLacks buy-in from staffRecommendations may not be feasible or relevant
What perspective is this from?What is the role of the evaluator here?gloria27Why should I care about these perspectives?Jill28Evaluation teamStakeholder engagementEvaluation DesignTimingReportingInformation disseminationAnything else?IMPLICATIONSJILL29
You are the evaluatorA colleague has told the community center director that he needs to prove his worth.You are brought in to help do so.What do you do?
GroupsWhat questions do you need to ask the director?Who are the stakeholders?What additional steps can you take?