![Page 1: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/1.jpg)
GA HIMSSThe Predictive Bull’s-eye: Defining and Measuring Predictive Analytic ROI
September 7, 2016
Leigh WilliamsRitesh Sharma
![Page 2: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/2.jpg)
Learning Objectives
Describe the role that
predictive analytics play
in the emerging
value-based landscape
Define the “predictive
analytic paradox”
Apply a framework for understanding
and determining predictive
analytic ROI
![Page 3: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/3.jpg)
Why all the hype around predictive analytics?
The way we define value is changing
Payment is linked to
performance
Prevention is key to
meeting goals
The “Prevention
Gap”
![Page 4: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/4.jpg)
Predictive Analytics:
Technology that uses machine learning ⎯also called artificial intelligence ⎯ to account for thousands of variables and make more precise and actionable predictions
Why all the hype around predictive analytics?
![Page 5: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/5.jpg)
What makes predictive analytics better than what we have today?
Accuracy Applicability Optimization
Efficiency Usability
![Page 6: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/6.jpg)
The Predictive Analytic Paradox
The process of applying an intervention obscures the
value of the prediction.
![Page 7: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/7.jpg)
The Predictive Analytic Paradox
By intervening based on predicted risk, you fundamentally change the outcome
and what you are able to observe.
High-Risk Individual
Interventions Applied
Individual Stays Well
Individual was never exposed
Intervention worked
![Page 8: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/8.jpg)
How To Determine Predictive Analytic ROI
Under-standing Accuracy
Translating Accuracy
Setting Goals
Aligning to the
Triple Aim
![Page 9: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/9.jpg)
Understanding Accuracy
What is the accuracy of the predictive engine when applied to your own data?
Understanding Accuracy
Translating Accuracy
Setting Goals Aligning to the
Triple Aim
If 100 people are predicted
to be readmitted
and 35 are readmitted
then the model has a 35% accuracy
rate
![Page 10: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/10.jpg)
Translating AccuracyUnderstanding
Accuracy Translating Accuracy
Setting Goals Aligning to the
Triple Aim
Pure potential
represents the accuracy
of the solution
20% 40% 60%
Pure Potential (100%)
Intervention Effectiveness
In our example, if you were able to stop all 35 readmissions,
we would achieve the “pure potential” of the solution.
![Page 11: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/11.jpg)
Translating Accuracy
Current capacity to perform the intervention
Ability to drive adoption of the predictive solution
Effective-ness of the interven-tion for a specific patient
Patient’s willingness to engage with the intervention
Understanding Accuracy
Translating Accuracy
Setting Goals Aligning to the
Triple Aim
Driving effective interventions
![Page 12: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/12.jpg)
Setting GoalsUnderstanding
Accuracy Translating Accuracy
Setting Goals Aligning to the
Triple Aim
• What if you did not have predictive analytics?
• How your organization is doing with applying an intervention
• Potential intervention effectiveness
Where you could have been
Where you are today
Where you could be
![Page 13: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/13.jpg)
Aligning to the Triple AimUnderstanding
Accuracy Translating Accuracy
Setting Goals Aligning to the
Triple Aim
![Page 14: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/14.jpg)
What Predictive Analytic ROI Looks Like
Results for one provider:
• Achieved a 32% drop in readmissions
• Avoided $4,894,400 in cost
• Saved 2,331 LOS days
![Page 15: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/15.jpg)
Driving Predictive Analytic Success
• Engage the right stakeholders
Leadership
• Select a key member who can drive the project
Project Owner
• Get users excited and committed
End users
![Page 16: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu](https://reader033.vdocuments.us/reader033/viewer/2022060514/5f8552102d94e507dd5dd2c7/html5/thumbnails/16.jpg)
Next Steps
Determine risk areas
Prioritize for predictive analytics
Define your ROI metrics