youth development strategy journey to evaluation · youth development strategy journey to...

17
Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth Save the Children Australia Save the Children Australia

Upload: others

Post on 24-Sep-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Youth Development Strategy Journey to Evaluation

Ross Wortham Regional Manager Perth

Save the Children Australia

Save the Children Australia

Page 2: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Save the Children Australia

Page 3: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Why evaluate?

We knew we were making an impact anecdotally but couldn't always prove it!

Page 4: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Our experience with Monitoring & Evaluation

• Old school Logic Models – measures the:

– Inputs – yes – Activities - yes – Outputs (quantitative data) – yes – Outcomes – mostly ad hoc – Analysis? – not normally!

• Qualitative Research

– It Takes a Village and Communities for Children – Rich analysis – But who’s got the $ and time?

Mostly driven by funder KPIs

Page 5: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Youth Development Model

The Journey began with strategic thinking to improve our practice in supporting young

people

Page 6: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Circle of Courage

W.H.O. Life Skills

Culturally appropriate questions

Risk

Outcomes

Resilience

Research!

Data collection

Log-frames

evidence

Indicators

Protective Factors

Impact analysis

Behaviour Change Theory Theory

Theory Theory

Time time time

Vulnerability

Complexity!

Page 7: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Start with the problem and work backwards

Vulnerable children and families

Protective x Risk = Vulnerability

Page 8: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Focus on the solution

Resilience?

Protective x Risk = Resilience!

Page 9: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Our Approach Resilience vs Vulnerability

Resilience is • an individual and collective

process in which young people, families, and communities develop the capacity to respond positively to difficult situations

Vulnerability is • the interplay between risk

and protective factors which together determine to what extent a young person is vulnerable

Page 10: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Building Capacity

Assets Resources

Increasing: • Life skills • Cultural connection • Confidence • Etc.

Increasing: • Family functioning • Community connection • Role models • Etc.

Decreasing: • Low confidence • Poor social skills • Etc.

Decreasing: • Truancy • Drug abuse • Etc.

Page 11: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Unpacking Resilience

Page 12: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

GOAL: To protect young people and improve their resilience by building their capacity to respond positively to adversity

Priority Area 1: Community Connectedness

Objective 1: Young people increase their

engagement and participation with their

community, peers, family and services

Objective 2: Young people increase their

safety

Priority Area 2: Individual Capacity

Objective 3: Young people develop life skills

and cultural values to respond positively to

risk

Objective 4: Young people increase their connection to formal

education and training opportunities

Youth Development Model

Page 13: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Level of Risk Factors High Low

Leve

l of P

rote

ctiv

e Fa

ctor

s Lo

w

High

Universal:

Early Intervention: Children and Youth

Secondary Intervention: Young people and Family

Family and Community Events

Reconnect and Strong Tomorrow

One Step Closer

Primary Prevention: Early Childhood Intensive Supported Play scheme Armadale

Implementing the Youth Development Model

Page 14: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Medium term Long term Time line of program implementation

Measuring Change Small Steps to Success in our Youth Development Model

“I haven’t smoked in over a year and I even helped my

friend give up pot”

“I’m no longer smoking anymore

and haven’t for the last 6 months”.

“I know Marijuana affects my motivation, but I’m not ready to give up”

Page 15: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Using evidence base evaluation tools

Mapping our tools and indicators to the YDM objectives Reconnect - Outcomes Star model for individual assessments One Step Closer – Circle of Courage domains and now implementing Dr Ungar's Child and Youth Resilience Measurement tool

Page 16: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Next Steps

We are working on ‘get it right’

We dream to evaluate: • Collective impact • Evaluating across the life continuum • Collecting hard vs soft indicators • Engaging universities and academic institutions • Counterfactual analysis and research

Page 17: Youth Development Strategy Journey to Evaluation · Youth Development Strategy Journey to Evaluation Ross Wortham Regional Manager Perth . Save the Children Australia . Save the Children

Questions?

Ross Wortham | Regional Manager Perth Save the Children Australia 1074 Hay Street, West Perth, Western Australia 6005 Direct line: +61 8 9267 3920 | Fax: +61 8 9486 9503 Mobile: +61 (0) 450 085 562 Email: [email protected]