Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via
Dynamic Reporting Matt Stevens and Geoffrey Kip
Benefits Data Trust
Agenda
• Background
• Data and Reporting Key Concepts
• Best Practices
• Case Studies
• Additional Resources
• Q & A
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Learning Objectives
• How services agencies can utilize client data
for outreach
• The benefits of dynamic reporting for your
organization
• Examples of dynamic reports and reporting
best
practices
• Publicly available resources to help building
your own dynamic reports
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
About BDT
Benefits Data Trust is a
not-for-profit social
change organization
committed to
transforming how
individuals in need
access public
benefits and
services.
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Data Science for Individual
Impact • Targeted Identification
– Import lists of clients provided by partner agencies
– Match against current outreach pool to understand what benefits clients are already receiving and estimate what they may be eligible for
• Effective Outreach – Weekly batches of mail outreach to eligible individuals
– Forecast anticipated responses, applications
• Continual Analysis and Evaluation – Internal and External Reporting
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Data Science for Systems Impact
• Internal Research – Work with contact center to understand how we can
better serve our clients
• What challenges do they face with the application process?
– Analyze data on enrollment outcomes
• What challenges do clients face after application submission?
• Data for Good
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Data Science for Social Impact
• External Research to Understand Impact of
Benefits on Health Outcomes – MD Duals Research – Johns Hopkins / Hilltop Institute
– MIT Random Control Trial – J-PAL North America
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Data Driven Strategies
Uses benefit
enrollment data to
identify, outreach
and apply likely
eligible seniors and
individuals into
benefit programs like
SNAP and Medicaid
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Challenge:
Scaling Your Data Team
Pennsylvania : submitted 500,000 applications
since 2005
Analyst
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Challenge:
Scaling Your Data Team Pennsylvania
Analyst
Analyst
Maryland
Submitted 45k
applications since 2012
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Challenge:
Scaling Your Data Team
Pennsylvania
Maryland
Analyst
New York City
Submitted 22k
applications
since 2014
Analyst
Analyst
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Challenge:
Scaling Your Data Team
Pennsylvania
Maryland
Analyst
New York City
Analyst
Analyst
Analyst
SC
9k
Since
2015
CO
5k
Since
2015
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Opportunity
• In a growing organization, the demand for
data out paces the analytics team’s ability
to provide answers
• As data availability spreads, an
organization’s decision making becomes
decentralized
– Empower your teams by putting meaningful
data at their fingertips
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Core Concepts:
Data Democratization
• Breaking down silos to give everyone a
better understanding of the org’s data
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
The Opportunity:
Self-Service Reporting
Infrastructure
Data Science
Team
Targeted
Identification
Effective Outreach
Comprehensive
Application
Assistance
Continual Analysis
and Evaluation
Strategic Systems
Change
Proactive Thought
Leadership
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Core Concepts:
Data Literacy • Data literate teammates1
– know the different kinds of data that exist and which kind of data to use for which decisions
– Evaluate the accuracy and sufficiency of each kind of data they will use
– Transform data from a variety of sources into actionable information to guide decisions
– Hold themselves accountable for ethical generation, interpretation, and application of data
1 -‘Data Literacy – What it is and How it Differs from Assessment Literacy’ – Kathy
Dyer nwea.org
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Core Concepts:
• Dynamic Reporting
• Insight Democratization
• Data Literacy
• Data Democratization
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Case Studies
• Goal Progress Report
• Outcome Reporting
• Human Centered Design Workshop
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Goals Progress Report 04/10/2017 Summary of Goal Progress by Project
Contract Contract Period
Applications
to Date
Contract
Goal
Progress to
Goal
Percent of
Contract period
Completed Goal 1 October 1, 2016 - September 30, 2017 14,711 45,000 33% 52%
Goal 2 October 1, 2016 - September 30, 2017 17,268 25,000 69% 52%
Goal 3 October 1, 2016 - September 30, 2017 5,496 11,000 50% 52%
Goal 4 July 1, 2016 - June 30, 2017 8,188 11,000 74% 78%
Goal 5 July 1, 2016 - June 30, 2017 4,583 7,000 65% 78%
Goal 6 September 16, 2016 - September 15, 2017 1,840 1,700 100% 57%
Goal 7 July 1, 2016 - June 30, 2017 1,287 1,000 100% 78%
Goal 8 October 1, 2016 - September 30, 2017 3,368 6,000 56% 52%
Goal 9 October 1, 2016 - September 30, 2017 1,610 7,150 23% 52%
Goal 10 August 1, 2016 - June 30, 2017 5,728 6,500 88% 76%
Goal 11 July 1, 2016 - June 30, 2017 4,560 5,000 91% 78%
Goal 12 July 1, 2016 - June 30, 2017 1,888 2,500 76% 78%
Goal 13 July 1, 2016 - June 30, 2017 2,672 2,500 100% 78%
Goal 14 October 1, 2016 - September 30, 2017 1,805 2,800 64% 52%
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Zipcode Screenings Applications
Submitted 18041 8 6 18054 8 6 18070 1 1 18073 10 8 18074 10 8 18076 12 9 18915 4 3 18936 1 1 18964 21 16 18969 22 17 19001 30 23 19002 37 28 19003 31 23 19004 12 9 19006 35 26 19009 2 2 19010 7 5 19012 8 6 19025 5 4 19027 32 24 19031 11 8 19034 6 5
313 235
Philadelphia Outcome Report 1/1/16 –
12/31/16
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Human Centered Design
Workshop What is Human-Centered Design?
Human-centered design is a creative
approach to problem solving starts with the
people you're designing for and ends with
new solutions that are tailor made to suit
their needs.
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Human Centered Design
Workshop
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Recap: Key Points
• Dynamic Reporting
• Insight Democratization
• Data Literacy
• Data Democratization
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Introduction to R
• R is a programming language and environment for statistical
computing.
• Open Source software: free and users can contribute to modify
• R can be modified to meet your needs and increase functionality.
• Can be used for different purposes such as data management,
statistical analysis, producing visualizations, maps, dynamic
dashboards and for machine learning.
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
R studio IDE
R studio is an add- on to R that provides a nice user interface and
Integrated Development Environment (IDE) for R.
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
What is Shiny?
• Interactive web applications great for visualizing
R data
• No web development skills (HTML+CSS,
JavaScript) needed but can customize further if
you do have them
• Ability to use R language and all R packages
• Shiny is a package available in R studio
(https://www.rstudio.com/)
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Why use Shiny?
• Many customization options (access to R and all
packages)
• Ability to deploy and host apps on Shiny server
• Many users can view the apps at the same
time
• Affordable
• Good alternative or addition to other
BI/dashboard tools eg. Qlik, Tableau, Looker
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Examples
https://geoffkip.shinyapps.io/Goal_Progress/
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
https://geoffkip.shinyapps.io/benephilly_map_gk/
Examples
https://xavierign.shinyapps.io/BDT-Scorecard/
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Examples
https://www.rstudio.com/products/shiny/shiny-user-showcase/
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Resources to start using R and Shiny
• R Online Learning:
• https://www.rstudio.com/online-learning/
• Shiny Webinar Series:
• http://shiny.rstudio.com/tutorial/video/
• Websites like EDX, Coursera, Udemy all
provide free courses and certifications
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Hands on with R and Shiny
• We have prepared an Interactive document in R
that will help you get started with Shiny
• https://geoffkip.shinyapps.io/Markdown_goal_progress/
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Creating a Culture of Shared Knowledge –
Democratizing Your Organization’s Data via Dynamic Reporting
Matt Stevens and Geoffrey Kip
Benefits Data Trust
Questions?
• Matt Stevens – Director of Data Science
– @mttstvns
• Geoffrey Kip– Data Analyst
– @gjerome1991