policy class 6-200214_043023

8/12/2019 Policy class 6-200214_043023

1/13

Session 6

8/12/2019 Policy class 6-200214_043023

2/13

Questions about the evaluations

Describe the program (goals and activities)

Describe the evaluation1. Who were Stakeholders?

2. Who conducted the evaluation?3. What kind of evaluation was it (input, process,

outcome, impact)?4. What research design was used?

5. Who was the sample?6. What types of data were collected?7. How did they analyze the data?8. What did they find?

8/12/2019 Policy class 6-200214_043023

3/13

Evaluation of the Healthy Village Program in

Kapit District, Sarawak, Malaysia

The program: What were the programs goals andstrategy?

Goals: Broaden traditional health activities; encourageinter-sectoral collaboration; more health screeningespecially non-communicable diseases, accidents andinjuries, environmental hygiene and communicabledisease.

Activities: Food preparation, fire safety, smoking (must

go outdoors, no smoking signs, fines, encourageexercise, well-person clinics, self-exam and otherscreening; adequate ventilation and other fireprevention measure; rubbish disposal; education onsafe food handling, remove stray animals;

8/12/2019 Policy class 6-200214_043023

4/13

Describe the evaluation

1. Who were Stakeholders?Kapit Health Office, WHO, villages, villageleaders

2. Who conducted the evaluation?University of Sydney, University of Queensland,Kapit Division of Health, WHO

3. What kind of evaluation was it (input, process,outcome, impact)? Outcome

4. What research design was used?

One shot case studyCollected retrospective data; nobaseline data

Concerns about Selection biasstudy conducted 2 years after program started

8/12/2019 Policy class 6-200214_043023

5/13

5. Sample

March/April 2003 12 longhouses in Kapit district

10 study longhouses and 2 comparison~ 20 interview/village

subjects chosen because spoke English and/or availability

1 Focus group/village; authorities, ~8 subjects, interviewguide

observation to confirm other information6. What types of data were collected?

participant observation and key informantinterviews

interview checklistsemi-structured

7. How did they analyze the data?narrative description (no tables, quotes, etc)

8. What did they find5/10 completed some changes in all program areasDescriptive data on program elements

additional findings: partnerships,

8/12/2019 Policy class 6-200214_043023

6/13

Evaluation of the School Supplementary

Feeding Program in Peninsular Malaysia


improve health and nutritional status of children

1. prevent malnutrition

2. education children on food selection

3. encourage parent, teachers, and public participation4. strength health and nutrition programs in schools

Objectives of the study:

a. To evaluate the financial management and budget disbursement

of SSFP

b. To evaluate the management of food preparation in SSFP

c. To observe the types and acceptance of the food served to

supplemented school children

d. To evaluate the nutrient content of food served

8/12/2019 Policy class 6-200214_043023

7/13

Describe the evaluation1. Who were Stakeholders?

2. Who conducted the evaluation? 3 universities

3. What kind of evaluation was it?

implementation (inputs, process, some outcome)


cross-sectional5. Who was the sample?

129 schools (participation rate, urban/rural)

matched samples, parents

6. What types of data were collected?questionnaires to parents, staff, interviewadministrators, nutritional content

7. How did they analyze the data?

descriptive data tables

8/12/2019 Policy class 6-200214_043023

8/13

What did they find: Problems

a. Delay in receiving budget has led to loss of interestin food preparation by the food operators.

b. Food is sometimes prepared and portioned outtoo early, resulting in cold food being served.

c. An inferiority feeling is experienced by somechildren as this program is meant for poorchildren.

d. Unsatisfactory water supply and insufficient basicfacilities in some schools, made preparation

difficult.e. Teachers involved in managing the program

experienced increased work load.

8/12/2019 Policy class 6-200214_043023

9/13

Recommendations

a. Need to revise the income criteria as the currentincome level of RM150 is no longer applicable.

b. The allocated budget per child needs to be revised in

tandem with price increase of ingredients.

c. Budget should be received so the program can start

off at the beginning of the term.

d. The SSFP should be given to all children for schools

with a total population of 150 students and below.e. Schools should be given freedom to modify menus if

necessary to enhance food acceptance.

8/12/2019 Policy class 6-200214_043023

10/13

Preliminary Evaluation of the STRIDE

Program


Preventive drug education program

Enhance interpersonal skills and developresilience of students through physical andhealth education curriculum

12 lectures, physical activities, role playing

New curriculum for 3 months + 3-day camp

8/12/2019 Policy class 6-200214_043023

11/13

Describe the evaluation

1. Who were Stakeholders?

Ministry of Education

National Narcotics Agency

Institute for Medical Research

Police Department

2. Who conducted the evaluation?

Universities plus Ministry

3. What kind of evaluation was it?

Outcomeknowledge (not actual use)


pre-post (before/after)

8/12/2019 Policy class 6-200214_043023

12/13

5. Who was the sample?9 schools from 3 states (purposive; high

prevalence)stratified cluster random sampling (random

classes)

N= 301 students (75% matched at post-test)6. What types of data were collected?

pretested questionnaires15 objective dichotomous questions

7. How did they analyze the data?

SPSS and statistical tests8. What did they find?

Mostly positiveSome surprising negative impactsInconsistent qualifications of trainers

Problem with timing during school day

8/12/2019 Policy class 6-200214_043023

13/13

Evaluation in Malaysia

Malaysian Evaluation Society

http://mes.org.my/home/

Briefing on Performance Management and

Program Evaluation in the Malaysian

Government

http://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdf
http://mes.org.my/home/http://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://www.agc.gov.my/pdf/pekeliling/pelbagai/Performance_Management.pdfhttp://mes.org.my/home/http://mes.org.my/home/

policy class 6-200214_043023

Documents