WISMS IM&T Task Group Update

John DickensAmrez JawedKevin Truby

Agenda

• Overview of process• Balanced Score Card Development• Dataset requirements• Data Collection• Data Storage• Information Reporting• National Reporting• Risks and Clarifications• Feedback

Overview of Process 1

• Definition of the project objectives– “in 2 years time, how will we know what impact

the WISMS project has had on our Service Users, Service Providers, Staff and wider Community?”

– Where are we starting (the baseline)?– What is ‘better’?– 3 metrics per task-group

Overview of Process 2

• Convene 4 Task Groups each made up of a cross-section of stakeholders to define the metrics that would measure the impact across their areas:– Economic Benefit– Individual Health and Wellbeing– User Experience– Community

Balanced Scorecard Development

• Each Task Group workshops to define:– Definition – what is the individual metric?– Baseline or Comparator – Oct 1 2009 or similar control– Currency – Attendances / Service Users / Events /

Completions– Timescale – per day / week / month / quarter / year /

project– Validations – is the data accurate?

• Facilitated (but not constrained) by IM&T

Individual Health and Wellbeing metrics - Financial

• IHWB-F1 Number of Service Users asked about debt

• IHWB-F2 Number of Service Users identified as having debt problems

• IHWB-F3 Number of Service Users referred to Specialist debt counselling services

Individual Health and Wellbeing metrics - Personal

• IHWB-P1 Number of Service Users participating in 30 minutes of activity on 3 or more days per week

• IHWB-P2a Number of Service Users referred to smoking cessation clinics

• IHWB-P2b Number of Service Users attending smoking cessation clinics

• IHWB-P2c Number of Service Users confirmed as '4 week quitters'

Individual Health and Wellbeing metrics - Social

• IHWB-S1 Number of Service Users reporting positive relationships with family and carers

• IHWB-S2 Number of Service Users involved in community groups, activities and involvement

Individual Health and Wellbeing metrics - Qualitative

• IHWB-Q1 Average Score of All Services User responses to Questionnaire Q1 this quarter

• IHWB-Q2 Average Score of All Services User responses to Questionnaire Q2 this quarter

• IHWB-Q3 Average Score of All Services User responses to Questionnaire Q3 this quarter

• IHWB-Q4 Average Score of All Services User responses to Questionnaire Q4 this quarter

User Experience metrics – Personal Development

• UE-PD1 – No of Service Users / Village Project attending Harm Reduction per month

• UE-PD2 – No of Service Users / Village Project attending a Personal Support session each month

• UE-PD3 – No of Service Users / Village Project attending a Structured Day Programme

• UE-PD4 – No of Service Users engaged in Village Project

User Experience metrics – Professional Development

• UE-Prof1 – No of Service Users / Village Project attending College Training (courses) each month

• UE-Prof2 – No of Service Users / Village Project attending an internal /on-site Training (courses) session each month

• UE-Prof3 – No of Service Users / Village Project attending JC+ employment Training each month

User Experience metrics – Social Reintegration

• UE-SR1 - Number of Service Users / Village Project attending P2W each month

• UE-SR2 - Number of Service Users / Village Project attending JC+ Interviews each month

• UE-SR3 - Number of Service Users / Village Project becoming volunteers each month

• UE-SR4 - Number of Service Users / Village Project becoming employed each month

Community metrics

• Comm-1a - The number of Service Users with parental /

guardian responsibility accessing WISMS family support team

• Comm-1b - The number of Service Users with parental /

guardian responsibility accessing Mainstream Family Support

Services

• Comm-2 – The number of Service Users reporting an

improvement in accommodation status (1-5)

Community metrics

• Comm-3a - Community perception of levels of alcohol and

drug activity - Q1

• Comm-3b - Community perception of levels of alcohol and

drug activity - Q2

• Comm-3c - Community perception of levels of alcohol and

drug activity - Q3

Economic Benefit metrics

• EB1 - Reduction in the cost of crime

• EB2 - Reduction in the cost of A&E attendances

• EB3 – Reduction in the cost of Benefits paid

Dataset Requirements

• From the workshops and subsequent clarifications data would be required from:– NHS Secondary care data (A&E, Inpatient and

Outpatient)– DWP Benefits paid– Criminal Justice crimes data– Service User Quarterly reviews– Community questionnaires

Definition of ‘our cohort’

• What is the cohort of Service Users:– “Clients on Turning Point / CIM and SystmOne as

at 1 October 2009 aged 18 years on that date”– How often do we add / remove Service Users?

Data Collection and Reporting

Collection– Forms / Direct input (secure system)– SUS Data (PCT)– DWP (tba)– Criminal Justice (tba)

• Reporting– Balanced Scorecard / Dashboard– Individual Trends– National Reporting (SUS data)

Information Flow Diagram

Black Marble Demo

Data Sharing

• Meetings have taken place with PCT Information Governance.

• All exchanges will take place under the Inter-Agency information Sharing Protocol. (Feb’09)

• ISA will underpin these.• Utilise Data protection Act 1998 – Caldicott Principles• Gold standard – Consent

Risks and Clarifications• Anonymisation of SUS data for this we will need • Ability to track individual Service Users throughout

the pathways? – Gold Standard – may not be able to achieve this. Silver standard basic of the BSC

• Information Sharing (all parties) &Co-operation by all participating organisations on data collection and communication

• Funding - may need up to 4 IT Servers• Workforce engagement and training• Additional data sources (future)-

Feedback

• Have we as an IM&T project group met your requirements.