gear project process evaluation. overview of gear evaluation components outcomes multi-component...
TRANSCRIPT
GEAR projectGEAR project
Process Evaluation
Overview of GEAR Evaluation ComponentsOverview of GEAR Evaluation Components
Outcomes Multi-component internal evaluation
External evaluator: Prof. Carol Hagemann-White, University of Osnabrück, DE
External Evaluation
InternalEvaluation
EFFECTIVENESS EVALUATION
Teachers’ Seminar
Teachers’ Seminar
pre- and post- training questionnaires test the teachers’ training effectiveness
post- training questionnaires assess seminar’s procedures and identify potential
facilitators/barriers for future implementation
pre- post- and follow-up questionnaires (intervention & control group)
test the effectiveness of GEAR Workshops in classes
pre- post- and follow-up questionnaires (teachers implementing workshops)
test the impact of GEAR Workshops in classes
post- training questionnaires (students & teachers) assess workshops’ procedures and identify potential
facilitators/barriers for future implementation
PROCESS EVALUATION
EVALUATION OF MASTER GEAR PACKAGE
TEACHER’S MANUAL & STUDENTS’ HANDOUTS EVALUATION
OutlineOutline
Overview
Aim & Objectives
Method
Schedule of Process Monitoring Reporting
Monitoring Tools
OverviewOverview
Monitoring data collection:Baseline data: activities to be implemented at specific times, available budget per activityData Source documents: agreed work plan and contractual budgetPerformance targets: implementation of all planned activities, on time, within the provisioned budgetTool for data collection: process monitoring checklistsFrequency of data collection: every 3 or 6 months respectivelyInvolved parties: External Evaluator, Coordinator & Partners
Data flow
Data synthesis & reporting Coordinator will undertake synthesis of data provided by all partners, as follows:
Monitoring of activities: every 3 monthsMonitoring of expenditures: every 6 monthsMonitoring of dissemination activities: every 6 months
Final reporting: External Evaluator
Template 1
Template …
Template 8
Coordinator to Partners
1st Process Evaluation Form
… Process Evaluation Form
8th Process Evaluation Form
Partners to Coordinator
1st Process Evaluation Report
… Process Evaluation Report
8th Process Evaluation Report
Coordinator to External Evaluator
Final Report
based on the 8
Process Reports
Coordinator All Partners Coordinator ExternalEvaluator
AIM & ObjectivesAIM & Objectives
AimMonitoring & tracking of the implementation progress Timely identification of potential deviations/ problems Decision making & undertaking corrective actions Smooth implementation
Secondary ObjectivesSystematic, consistent and reliable information on project progressFacilitation of the project’s reporting
MethodMethod
Method Measure actual results against expected results
Continuous comparison among actual performance
AND
work plan scheduled activities execution time table timely execution of the activities budget implementation according provisions expected quality quality of final deliverables
Schedule of Process Monitoring ReportingSchedule of Process Monitoring Reporting
DurationThroughout the project
8 Process evaluation reportsEvery 3-month period
No Sent template
Progress report
Content of Progress report
1st 5.2.2010 26.2.2010 Implementation progress + Financial report
2n
d30.4.2010 31.5.2010 Implementation progress + Dissemination
report
3rd 31.7.2010 31.8.2010 Implementation progress + Financial report
4th 31.10.2010 30.11.2010 Implementation progress + Dissemination report
5th 31.1.2011 28.2.2011 Implementation progress + Financial report
6th 30.4.2011 31.5.2011 Implementation progress + Dissemination report
7th 30.7.2011 31.8.2011 Implementation progress + Financial report
8th 30.9.2011 30.11.2011 Implementation progress + Dissemination report
Feb 10 May
10Aug 10
Nov 10
Feb 11 May 11
Aug 11
Nov 11
G E A R A G A I N S T I P V - I M P L E M E N T A T I O N
Dec 09Grant
Agreement
Dec 11Final
Report
Oct 10Final
Report
Monitoring ToolsMonitoring Tools
8 Process Monitoring Checklists
Structure: 3 distinct sessions / checklist:
“GENERAL EVALUATION” its items will be unchanged throughout the project
“DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY YOUR ORGANIZATION“
its items will be modified according to the work plan
“DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY THE COORDINATOR“
its items will be modified according to the work plan