Developing SEA Change’s Evaluation Plan

Annual Members’ Meeting Track A

November 10, 2011

Purpose of the Session

• To develop parts of an evaluation plan for the second year of SEA Change

• To provide participants with a participatory M&E planning experience

Agenda• Review the stages of M&E and the steps for

M&E planning• Conduct a stakeholders’ analysis• Define the purpose of the evaluation• Develop key evaluation questions• Identify data sources and collection methods• Discuss next steps

Collect InformationReport & Use

the Results

Plan the Evaluation

Analyze & Interpret Information

Stages of M&E

Engage Stakeholders

Engage Stakeholders

Reasons for Participatory Evaluation• Obtain better quality data• Because the evaluation will be more relevant,

more likely to have the results used• Foster greater ownership• Develop evaluation capacity

An evaluation plan is your roadmapAn evaluation plan is your roadmap

(University of Wisconsin-Extension, Program Development & Evaluation)(University of Wisconsin-Extension, Program Development & Evaluation)

Steps to M&E Planning1. Describe the project2. Identify major stakeholders and their information

needs and uses3. Define the M&E purpose(s)4. Formulate M&E questions and indicators5. Identify sources of information and data collection

methods6. Determine ways to analyze the M&E data7. Decide how to report and facilitate the use of the

M&E results

Step 2: Evaluation Stakeholder Analysis

Major StakeholderGroups

What information do they need from the evaluation?

How will they use the results of the evaluation?

Step 3: Define the Purpose(s) of the Evaluation

How will the information be used?

Underlying purpose =Underlying purpose =

Common Purposes for M&E To be accountable and report to:• Donors• Program participants and community members• Government

To improve program (re)design, planning and implementation

To obtain additional resources To advocate for particular issues To acknowledge and celebrate our successes Other ???

Step 3: Define Our Evaluation Purposes In your work groups, write a purpose statement:

“We are conducting an evaluation of SEA Change in order to obtain information that will be used to:

– – – –

Steps to M&E Planning Describe the project Identify major stakeholders and their information

needs and uses Define the M&E purpose(s)1. Formulate M&E questions and indicators2. Identify sources of information and data collection

methods3. Determine ways to analyze the M&E data4. Decide how to report and facilitate the use of the

M&E results

Step 4: Formulate Evaluation QuestionsWhat are Evaluation questions?

• Information needs stated as questions• State what aspects or topic of the project will

be addressed in the evaluation

Provide:FocusClarity

Time to focus, focus, focus . . .

(University of Wisconsin-Extension, Program Development & Evaluation)(University of Wisconsin-Extension, Program Development & Evaluation)

Step 4: Formulate Evaluation Questions

What are typical types of evaluation questions?

Use the Logic Model

• What project activities have been implemented? Have they been implemented as planned? If not, why not?

• To what extent have expected outcomes been achieved?

Step 4: Formulate Evaluation Questions

Other types of evaluation questions:

• Efficient use of resources?• Effective in achieving project objectives? • Is the project relevant?• Are the activities and/or outcomes

sustainable?• To what extent has the project achieved

its expected impact?

Step 5: Decide Sources of Information and Data Collection Methods

Where will the information come from to answer the evaluation questions?

What methods will be used to collect that information?

Data Collection PlanProject Element or Topic Evaluation Question Data Source and

Collection Method

Next Steps

• Sign up for the Evaluation Committee, if you’re interested

• How should be share this with the rest of the CoP?

• How should we share this with Track B?