1. Sanitation and Hygiene in Asia Practitioners Workshop, Rajendrapur , 31 Jan - 3 Feb 2012 Supporting local government in 5 Asian countrieson sustainable sanitation & hygiene for allMethodology for Performance Monitoring Christine Sijbesma on behalfof the whole SSH4A team1

2. Contents BhutanThe SSH4A project NepalPerformance MonitoringVietnamFramework LaosSome preliminary resultsMethodological lessons Cambodia 3. SSH4A project 2 year project to support local governments toprovide Sustainable Sanitation and Hygiene for All 5 Asian countries: Bhutan, Cambodia, LaoPDR, Nepal, Vietnam Cooperation National and Local Gvts, SNV WASH Asiaand IRC Asia Region Financial support Civic Society Fund, AusAid and DGIScore funding for SNV and IRC knowledge centres 4. Goal, targets, strategyIn brief: Support local governments within their own frameworks toimprove rural sanitation & hygiene through a holistic approach Enhanced access of 122,000 rural people and 120 schools tosanitation and hygiene Duration in countries: June 2010 to Dec 2011 (18 months) Learning approach: learn by doing, monitoring and from eachother Focus on equity, sustainability and faster progress at scale 5. Five linked components Learning & sharingBetween components 6. Performance Monitoring Framework 5 common performance indicators in Civic Society WASH Fund:# additional people with access to safe water (not in SSH4A)# additional people with access to basic sanitation# additional locations with hand washing facilities and soap# additional schools with water sanitation & hand washing facilities# additional water and sanitation service providers monitoredindependently 7. Qualitative Information System (QIS) Developed by IRC and WSP for World Bank as participatorygender and poverty sensitive project evaluation. Specific objective to quantify qualitative data on quality ofservices, participation of women and thepoor, sustainability, empowerment, etc. Gradually developed into a participatory monitoringmethodology at scale. Used in India, Indonesia, Nepal, SriLanka, Vietnam, Laos, Bhutan, Cambodia, Kenya, SouthAfrica, Colombia, Peru, etc. 8. Quantified qualitative indicatorsProgress towards/in: Sanitary toilets in HHs and schools # toilets used in an increasingly hygienic way in HHs & schools # HHs & schools with increasingly adequate facilities forhandwashing with soap # Local sanitation enterprises (already numerical) Degree of female involvement in sanitation enterprises Level and quality of sanitation services Existence & quality of localized Behaviour ChangeCommunication (BCC) program at relevant admin. level(s) 9. Quantified qualitative indicatorsProgress in governance: Multi-stakeholder cooperation in sector Pro-poor support mechanisms for sanitation Degree of influence of women/ excluded groups/ very poor Capacity of government and NGOs to facilitate quality CLTS atcommunity level & monitor & manage progressLearning and Sharing: numerical, qualitative (no. & type ofpresentations, workshops, meetings, gender of participants, etc. ) 10. Measuring progress beyondODF and JMP (san) : Source: Antoinette Kome, WASH team leader Asia Region, Nepal 11. Observations Cambodia (pilot 2 prov., 6 villages)Baseline Mid term0 No toilet/ open defecation 14% 7%1 Toilet but human faeces are not contained and areaccessible for human contact and contact by other animals 59%7%(=unimproved toilet)2 Benchmark: Toilet + human faeces contained + inaccessiblefor human contact and contact by other animals (=14%24%improved sanitation) (pit and slab)3 Toilet + human faeces contained in such a way that it is inaccessible for human contact and contact by other7%15% animals + no flies or rodents going in and out.4 Toilet + human faeces contained in such a way that it is inaccessible for human contact and contact by other animals + no flies or rodents going in and out + human faeces are contained in such a way that it cannot 6% 48% contaminate surface- or ground-water. 12. Measuring equity on genderObservation & reporting for 2 meetings: community and WASH ScorecommitteeNo participation of women in meetings0Females attend the meetings, but do not speak1Females attend + speak, but not listened to2Females attend + speak + listened to, but do not influence decisions 3Females attend + speak + listened to + influence decisions 4Reasons for score:In same way: equity for poor and gender in SMEsIntended action: 13. Beyond MDG and JMP: total progress for toilet access and useAggregated data from 4 of 5 countries Source: A. Kome, SNV 14. Progress Ind. 3a: handwashing observations(without Laos) Source: A. Kome, SNV 15. Capacity development for good quality CLTSNepal mid-term outcomes Source: A. Kome, SNV 16. PitfallsCannot be developed behind deskScales are programme and culture specificShould measure outcomes, not inputs or outputsSteps must be incremental; no gaps, no overlapsNo 2 or 3 combined options in one stepAvoid undefined concepts and subjective terms, e.g. clean 17. Pitfalls (2)Proper sampling methods and size required forrepresentative dataScales themselves must be pre-tested and piloted in the fieldReasons for scores are crucial for analysisIs extractive without local discussions & use for actionIf designed and used without expertise, data can be spurious 18. On-going progress, next steps Integration into national programs: Bhutan scaled up from 4 sub-districts to 1 and now 2 full districts Cambodia Laos Nepal : scaled up to one of 5 regions Vietnam: third province started Other ESAs come in to support at country level For near future aim for programmatic approach with multiple ESAs Methodological review done to enhance rigor of monitoring methodand data (available c. February 2012 19. More information, documents, photo story womenmasons etc. e:Sustainable sanitation and hygiene for allhttp://www.irc.nl/page/57188