Renée Leduc, MSc – Program Officer, NCE Secretariat David Phipps, PhD, MBA – Lead, KT Core Anneliese Poetz, PhD – Manager, KT Core Mobilizing Science Knowledge and Research: NCE Sharing of Best Practices Symposium Thursday January 29, 2015 11:00am – 12:00pm (Sable ABCD) Halifax, Nova Scotia

Focus • Learning Outcome: Three high-level questions

for mapping your co-production KM pathway • Story: My experience working on the KM part

of the Annual Reporting with the KM Networks

• Audience: KM networks, NCE networks, researchers and HQP doing KM

Progress Reporting

• Why track performance? – Monitoring, evaluation and feedback – Advocacy, accountability and analysis

NCE Monitoring Committee

• Is the network on track to deliver on what was committed ?

Tools √ Annual Progress

Report Program selection criteria

√ Dashboard Graphic representation of key performance indicators

√ (NCE only)

List of publications Indicator for research collaboration, quality and relevance

√ (KM only)

KM Performance Metric (KM PM)

Snapshot of KM performance and impact

Table – KM Performance Metrics

• KM activities-outputs – Stakeholders who were engaged – End-users who benefitted – Outcomes that ensued

KM PM: Not a Perfect Process • Not always a true

representation of KM network performance and impact

• The timeframe of a fiscal year can be restrictive

KM PM: Not a Perfect Process (cont’d)

• Some data are estimates

• Not necessarily user-friendly

• Repetitive and time consuming to compile

• Measuring – Sample choice – Tools, equipment, experimental design – Results, Discussion, Conclusion…and the ?

• What do we want to do with KM? • What is KM really all about?

It’s all about Outcome = Change = Benefit = Influence

• What • Who • How

What changed? • Behaviour • Practice • Policy • Research • Products

Policy created Capacity established Processes, practices effected Patent License Copyright Products or Processes Other…

NCE PMF literature Phipps, D.J., Cummings, J. Pepler, D., Craig, W. and Cardinal, S. (2014) Mapping the community impacts of research through knowledge mobilization. Submitted to J. Community Engagement and Scholarship

What was the benefit?

Health-Wellness benefit*** Media and public

awareness** Vulnerability addressed** New research questions**

Social benefit*** Economic benefit*** Environmental

benefit** Technological benefit*

*NCE PMF literature ** Phipps, D.J., Cummings, J. Pepler, D., Craig, W. and Cardinal, S. (2014) Mapping the community impacts of research through knowledge mobilization. Submitted to J. Community Engagement and Scholarship *** overlap

Who benefitted and how?

• Target end users • Unintended end users • Canadians in general • International community (if applicable)

How was the change achieved? • KP & KU: who, why, and how • Activity (action taken or work performed) • Output (products or results of the activity) • Measure activity and output quality as they relate to

KP, KU, EU: – Relevance, usefulness – Reach, accessibility – Use

Where We’re Going From Here (Annual Reporting – KM PM)

• Outcome driven • Link to network PMF • More accurate qualitative and

quantitative data • Less complex and restrictive process

Where Do You Go from Here? • What have you committed to this year? Over the

life of the network? • What is the change you want to make? What is

the baseline? What are your outcome drivers? • Quality assurance: relevance, usefulness,

accessibility, reach and use • Put it in a performance measurement framework