Impact Measurement: The Tools

Survey

• What is impact?• Why measure your impact?• Why do your research?• Strengthening your impact measurement.• Prioritising your impact measurement.• Choosing and designing your impact measurement

tools.

What do you want to measure? What measurement tools do you know of?

Social capital EmployabilityCase study

Impact Measurement: The Tools

2005-2010

2010- 2012

Assistant Head of Maths

Teaching Leaders ‘08

Assistant Principal - Assessment

Head of Maths

Assessment Consultant2012- 2013

Senior Officer – Data & Impact2013

Sarah McMorrine @tfdatagirl

London Academy, Edgware

Evelyn Grace Academy, Brixton (Ark Schools)

St Thomas the Apostle College, Peckham

Teach First Innovation Unit

Impact : What would have happened if you were not there?

What is impact?

Outputs Outcomes Impact20 day long sessions run. 100 pupils engaged

100 pupils certified first aiders

Lives saved!

Impact Measurement: The Tools

Playpumps aimed to build 4,000 by 2010 to bring the "benefit of clean drinking water to up to 10 million people". The concept is simple: a merry-go-round is connected to a bore-hole. As children play, the spinning motion pumps underground water into a raised tank.

Children would need to "play" non-stop for 27 hours a day.

Why measure your impact?

Why do your research?

A wind turbine that cost the Welsh government £48,000 to buy has been generating an average of just £5 worth of electricity per month. The turbine was put its Aberystwyth office, rated excellent for sustainability, in 2009.

Before it was installed, the turbine makers warned Welsh government contractors it would not be exposed to enough wind where it was positioned.

Impact Measurement Strength

Pre and post programme surveys

Longitudinal study

Random Controlled Trial (RCT)

Quasi-experimental comparison cohort

Impact Measurement Priorities

“If your programme doesn’t directly do it, don’t measure it”Sarah McMorrine 2013

Outputs Outcomes Impact20 day long sessions run. 100 pupils engaged

100 pupils certified first aiders

Lives saved!

Impact Measurement Tools

What do you want to measure?

…and what is the best way to measure it?

Survey Job offersCase study

Employability