Download - Policy class 6-200214_043023
-
8/12/2019 Policy class 6-200214_043023
1/13
Session 6
-
8/12/2019 Policy class 6-200214_043023
2/13
Questions about the evaluations
Describe the program (goals and activities)
Describe the evaluation1. Who were Stakeholders?
2. Who conducted the evaluation?3. What kind of evaluation was it (input, process,
outcome, impact)?4. What research design was used?
5. Who was the sample?6. What types of data were collected?7. How did they analyze the data?8. What did they find?
-
8/12/2019 Policy class 6-200214_043023
3/13
Evaluation of the Healthy Village Program in
Kapit District, Sarawak, Malaysia
The program: What were the programs goals andstrategy?
Goals: Broaden traditional health activities; encourageinter-sectoral collaboration; more health screeningespecially non-communicable diseases, accidents andinjuries, environmental hygiene and communicabledisease.
Activities: Food preparation, fire safety, smoking (must
go outdoors, no smoking signs, fines, encourageexercise, well-person clinics, self-exam and otherscreening; adequate ventilation and other fireprevention measure; rubbish disposal; education onsafe food handling, remove stray animals;
-
8/12/2019 Policy class 6-200214_043023
4/13
Describe the evaluation
1. Who were Stakeholders?Kapit Health Office, WHO, villages, villageleaders
2. Who conducted the evaluation?University of Sydney, University of Queensland,Kapit Division of Health, WHO
3. What kind of evaluation was it (input, process,outcome, impact)? Outcome
4. What research design was used?
One shot case studyCollected retrospective data; nobaseline data
Concerns about Selection biasstudy conducted 2 years after program started
-
8/12/2019 Policy class 6-200214_043023
5/13
5. Sample
March/April 2003 12 longhouses in Kapit district
10 study longhouses and 2 comparison~ 20 interview/village
subjects chosen because spoke English and/or availability
1 Focus group/village; authorities, ~8 subjects, interviewguide
observation to confirm other information6. What types of data were collected?
participant observation and key informantinterviews
interview checklistsemi-structured
7. How did they analyze the data?narrative description (no tables, quotes, etc)
8. What did they find5/10 completed some changes in all program areasDescriptive data on program elements
additional findings: partnerships,
-
8/12/2019 Policy class 6-200214_043023
6/13
Evaluation of the School Supplementary
Feeding Program in Peninsular Malaysia
Describe the program (goals and activities)
improve health and nutritional status of children
1. prevent malnutrition
2. education children on food selection
3. encourage parent, teachers, and public participation4. strength health and nutrition programs in schools
Objectives of the study:
a. To evaluate the financial management and budget disbursement
of SSFP
b. To evaluate the management of food preparation in SSFP
c. To observe the types and acceptance of the food served to
supplemented school children
d. To evaluate the nutrient content of food served
-
8/12/2019 Policy class 6-200214_043023
7/13
Describe the evaluation1. Who were Stakeholders?
2. Who conducted the evaluation? 3 universities
3. What kind of evaluation was it?
implementation (inputs, process, some outcome)
4. What research design was used?
cross-sectional5. Who was the sample?
129 schools (participation rate, urban/rural)
matched samples, parents
6. What types of data were collected?questionnaires to parents, staff, interviewadministrators, nutritional content
7. How did they analyze the data?
descriptive data tables
-
8/12/2019 Policy class 6-200214_043023
8/13
What did they find: Problems
a. Delay in receiving budget has led to loss of interestin food preparation by the food operators.
b. Food is sometimes prepared and portioned outtoo early, resulting in cold food being served.
c. An inferiority feeling is experienced by somechildren as this program is meant for poorchildren.
d. Unsatisfactory water supply and insufficient basicfacilities in some schools, made preparation
difficult.e. Teachers involved in managing the program
experienced increased work load.
-
8/12/2019 Policy class 6-200214_043023
9/13
Recommendations
a. Need to revise the income criteria as the currentincome level of RM150 is no longer applicable.
b. The allocated budget per child needs to be revised in
tandem with price increase of ingredients.
c. Budget should be received so the program can start
off at the beginning of the term.
d. The SSFP should be given to all children for schools
with a total population of 150 students and below.e. Schools should be given freedom to modify menus if
necessary to enhance food acceptance.
-
8/12/2019 Policy class 6-200214_043023
10/13
Preliminary Evaluation of the STRIDE
Program
Describe the program (goals and activities)
Preventive drug education program
Enhance interpersonal skills and developresilience of students through physical andhealth education curriculum
12 lectures, physical activities, role playing
New curriculum for 3 months + 3-day camp
-
8/12/2019 Policy class 6-200214_043023
11/13
Describe the evaluation
1. Who were Stakeholders?
Ministry of Education
National Narcotics Agency
Institute for Medical Research
Police Department
2. Who conducted the evaluation?
Universities plus Ministry
3. What kind of evaluation was it?
Outcomeknowledge (not actual use)
4. What research design was used?
pre-post (before/after)
-
8/12/2019 Policy class 6-200214_043023
12/13
5. Who was the sample?9 schools from 3 states (purposive; high
prevalence)stratified cluster random sampling (random
classes)
N= 301 students (75% matched at post-test)6. What types of data were collected?
pretested questionnaires15 objective dichotomous questions
7. How did they analyze the data?
SPSS and statistical tests8. What did they find?
Mostly positiveSome surprising negative impactsInconsistent qualifications of trainers
Problem with timing during school day
-
8/12/2019 Policy class 6-200214_043023
13/13
Evaluation in Malaysia
Malaysian Evaluation Society
http://mes.org.my/home/
Briefing on Performance Management and
Program Evaluation in the Malaysian
Government
http://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdf
http://mes.org.my/home/http://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://mes.org.my/home/http://mes.org.my/home/