1

Participatory Monitoring and Evaluation

Dann Sklarew, GEF IW:LEARN

LAC Regional Workshop on Public Participation

in

Transboundary Waters Management

Montevideo, Uruguay, 6-9 December 2006

2

Objectives

Define key terms for Monitoring and Evaluation

Participatory M&E

Introduce new GEF expectations for M&EConsider who should be involved in M&EConsider Stakeholders’ M&E expectations

Introduce a proposal for increased participation in M&E for GEF Projects

Vet tools for PM&E

3

DefinitionsIndicators – quantitative or qualitative measures of level of attainment towards objectives in meaningful and practical way. (see references in Chapter 9 of Handbook)

Monitoring – collection of indicator information before (baseline), during (progress) and through after (impact) project implementation.

Reported annually to GEF

Evaluation – Independent assessment of progress towards achieving outputs and success in realizing expected results (impacts).

Reported to GEF midway through big projects and at end of all projects.

Participatory Monitoring and Evaluation (PM&E) –ongoing consultation with stakeholders to determine what should be monitored, incorporates many perspectives into how to do, interpret and apply learning from M&E.

Might not be reported to GEF, but must be reported to stakeholders to sustain mandate, ownership, transparency and local benefits from any project or interventions.

Monitoring and Evaluation Plan – strategic plan for collecting and “digesting” data to derive and measure change in M&E indicators – or even PM&E indicators throughout the project (and beyond). Also include plan for M&E of implementation of Stakeholder Involvement Plan.

So, what are GEF’s Expectations? AND

WHAT ARE YOUR STAKEHOLDERS’ EXPECTATIONS?

7

New Type of GEF IW M & E Indicator: Catalytic Impact Indicators

• New requirement to report on catalytic impacts of GEF projects during Replenishment cycles.

• Need to record and project spin-off catalytic results:– new conventions, treaties, protocols, legal reforms– catalysis in IAs: internalized in CAS or by new partnerships – with IAs & multilateral & bilateral organizations– results from GEF IW learning activities

8

•In order to utilize the framework as a tracking tool for Replenishment results/targets, an Annual Scorecard for each project will submitted. Part A: annual results (last 12 months) and Part B: cumulative results (since beginning of project).

•For all projects, agencies would also annually report on implementation progress (% of scheduled disbursement; delivery of outputs in line with original schedule; co-financing on schedule) to contribute to a portfolio characterization.

•Two tracking tools will be maintained for results reporting for Replenishment purposes by the IW Task Force: a Coverage Indicator Tracking Tool, and a Results Indicator Tracking Tool (with annual and cumulative tables – see attached example).

9

GEF IW Scorecard Template—GEF IW Scorecard Template—Annual Report of Results Annual Report of Results

to Contribute to the Tracking Toolsto Contribute to the Tracking ToolsPart A: Annual Results Report

quantitative; or 0-1 / 0-3 rating

I. Process Indicators:

______: _____; ______;

II. Stress Reduction Indicators:

______; ______; ______;

III. Catalytic Impact Indicators:

______; _____: ______:

IV. Implementation progress:

outputs; % disbursement; co-fin.

Part B: Cumulative Results Report

Roll ups of progress toward the different types of indicators listed in Part A / logframe on a cumulative basis for the life of the project.

I. _____; ______; ______;

II. _____; ______; _____;

III. _____; ______; _____;

IV. _____; ______; _____;

Subcommittee formed to develop the

Template for the Scorecard

10

Participatory M&E

Who should be involved?

What do they want to monitor and evaluate?

When to involve them in M&E planning and implementation, practically speaking?

What tools should be used? (see p. 152 / pgna. __)

11

Una Propuesta de ustedes…

A proposal from you…

12

M&E Plan for Participation

What are appropriate indicators for good participation?

How to evaluate “unacceptable” levels of indicators…? E.g.,

gender min. vs. gender balancedisparity across partner nations in capacity or intent to monitor participation

Final comments?

13

Participatory M&E in action..

14

Qualitative Indicators (Gender Participation?)