Australasian Evaluation Society Conference 2011

Influencing best practice in Aboriginal programs through strengths based

evaluation approaches.

Margaret Scott, Senior Consultant WestWood Spice, Sydney

margaretscott@westwoodspice.com.au

Introduction

• Need to build evidence base • Need to capture successes• Need to build capacity• Need to influence service managers, non-

Aboriginal workers, funders and policy makers and community

• Need for appropriate approaches to legitimise Aboriginal ways of working

Context

• Services and programs • Settings - mainstream & Aboriginal community

controlled• Partnerships between services - variable• Different ways of working needed• Mismatch with mainstream protocols,

frameworks, indicators

Case studies

• MRAMSA Review of mental health and social and emotional well-being services.

• Capacity building review of NSW aboriginal Sexual Health Worker Network

• Review of SSWAHS Aboriginal Chronic Disease Program.

• Evaluation of Aboriginal Legal Access Program• Evaluation of Walgan Tilly – Aboriginal Chronic

Disease Program.

Aboriginal workers – the vital links

• Ways of working– community engagement, outreach,

informal/indirect, cultural/community protocols• Cultural & community knowledge • Conduits to services, advocates for community• Multiple roles, community expectations• Racism & discrimination• Personal & community issues

Evaluation challenges/opportunities

• Lack of program/service planning/logic• Variable quality & approaches• Poor data collection systems• Inconsistent roles• Workforce capacity & experience variable• Need appropriate indicators, meaningful data• Navigating sensitivities & politics• Relationship building

Approaches

• Flexible, tailored to purpose – mixed methods• Strengths based – appreciative focus• Consultative, participatory • Capacity building• Cultural considerations• Strong scoping, attention to framing questions• Attention to outcomes as well as process• Settings/informal conversations – “yarn-ups” • Feedback & checking findings

Levels of influence

• Workers• Non-Aboriginal workers• Managers• Funders, policy makers• Other service providers• Community members

Overall comments

• Many examples of quality programs – local successes• Diversity, innovation• Leadership matters• Strong partnerships essential• Service capacity is building incrementally• Need for – workforce reform, development & support– robust logic models – impact pathways, appropriate

indicators– advocacy with mainstream, cultural competence

Conclusion

• Quality Aboriginal community based programs and services are models of best practice for the whole community.

• Current opportunities with focus on Closing the Gap

• Need for ongoing capacity building