E-101 Section 7October 24, 2012

Assessing the Performance of an Education System

Situating Ourselves in the Course (1 minutes) Discussion of the readings (10 minutes)

Reimers & McGinn, Informed Dialogue Kremmerer, Utilizing Education and Human Resource Sector

Analyses OECD’s Education at a Glance (2011)

David Section Leading (45 mins) Logical Framework (30 minutes) Housekeeping & Questions (5 minutes)

Agenda

1• Introduction to Comparative and International Education

2• The Process of Policy Analysis

3• Education Policy Options

Course Overview

1• Introduction to Comparative and International Education

2• The Process of Policy Analysis

Course Overview

– Week 6 – How Education Policy is Made

– Week 7 – Assessing the Performance of an Education System

– Week 8 – Policy and Program Evaluation

Summary

Case Studies from Informed Dialogue

Summary

Kremmerer

Summary

Education at a Glance

David Section Leading

Program Theory

“Program theory…refers to the mechanisms that mediate between the delivery (and receipt) of the program and

the emergence of the outcome of interest. The operative mechanism of change isn’t the program activities per se

but the response that the activities generate.”

- Carol Weiss, Evaluation, p. 57

You will be reading a section of this book for next week.

Program Theory

For each program, there may be multiple pathways to the intended outcome.

GOAL: More 6-year-olds in school

From Program Theory to Implementation to Evaluation

Logical Frameworks can help you to organize:

Design Implementation Evaluation

Developed by USAID in the 1960s Vary slightly, but always include: 4 x 4

Narrative Summary, Indicators, Means of Verification, and Assumptions

Logical Frameworks

Project StructureObjectively Verifiable Indicators

Means of Verification

Important Assumptions

Goal:

Purpose:

Outputs:

Activities:(Inputs)

Logical Frameworks

Project StructureObjectively Verifiable Indicators

Means of Verification

Important Assumptions

Goal

Purpose

Outputs

Activities(Inputs)

IF

IF

IF

AND

AND

AND

THEN

THEN

THEN

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal:

Purpose: To increase the number of primary school graduates.Outputs:

Activities:(Inputs)

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in XX country.Purpose: To increase the number of primary school graduates.Outputs:

Activities:(Inputs)

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in Somalia.Purpose: To increase the number of primary school graduates.Outputs: By abolishing school fees, expect to see more children enrolling in primaryActivities:(Inputs)

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in Somalia.Purpose: To increase the number of primary school graduates.Outputs: By abolishing school fees, expect to see more children enrolling in primaryActivities: Abolishing school fees.

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in Somalia.Purpose: To increase the number of primary school graduates.Outputs: By abolishing school fees, expect to see more children enrolling in primaryActivities: Abolishing school fees.

All primary schools no longer requires fees.

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in Somalia.Purpose: To increase the number of primary school graduates.Outputs: By abolishing school fees, expect to see more children enrolling in primaryActivities: Abolishing school fees.

All primary schools no longer requires fees.

Poll families to ask what fees exist.

Logical FrameworksProject Structure Objectively Verifiable

Indicators Means of Verification Important Assumptions

Goal: Develop human capacity in Somalia.Purpose: To increase the number of primary school graduates.Outputs: By abolishing school fees, expect to see more children enrolling in primaryActivities: Abolishing school fees.

All primary schools no longer requires fees.

Poll families to ask what fees exist.

Primary can be funded without fees.

Appendix

Sector Analysis: What is it?

Sector Review: summary of the state of the sector Sector Assessment: success of the sector in meetings

certain goals Sector Analysis: (most comprehensive) includes review

and assessment (above), and also describes sector needs, constraints, and opportunities for improvement.

(Kremmerer, 1994)

Sector Analysis: What is it?

Tries to answer questions relating to: External efficiency Internal efficiency Access & equity Administration & supervision Costs & financing

(Pigozzi & Cieutat, 1998)

Sector Analysis: What is it?

The contents of a sector analysis may include:1. Synthesis2. Economic & Financial Analysis3. History, Structure & Management Capacity4. Analysis by Sub-Sectors:5. Special Studies6. A list of background documents

(Pigozzi & Cieutat,1988)

Sector Analysis: Steps

I. InitiationII. Formation of the National Steering CommitteeIII. Determination of the scope of the analysisIV. Formation of the subsector teamsV. Formation of the technical analysis teamVI. Instrumentation and collection of dataVII. Preliminary analysis of dataVIII. Discussion of preliminary findingsIX. Collection of any additional dataX. Formulation of draft recommendationsXI. Discussion of draft recommendationsXII. Revision and prioritization of recommendations.

(Kremmerer, 1994)

Opposition sectors Support sectors Opposition sectorsExternal acto

rs

Sectorpositi

on

Anti-system Legal Opposition

Ideological support

Core support

Ideological support

Legal Opposition

Anti-system

The GovernmentSoci

al sectors

Political

parties

Pressure grou

ps

Political Mapping: An Example

Political Mapping: An Example

Stakeholder Map: An Example