business intelligence in the home care...
TRANSCRIPT
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Business Intelligence in the Home Care Sector
Peter Poulsen Lars Schunk Lasse Soelberg
Aalborg University
15. December, 2008
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 1 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Layout
1 Business Intelligence for Home CareIntroductionRambøll CareQuestions
2 Source Data and ETL ProcessSource DataExtract-Transform-Load
3 OLAP Cube and BI ApplicationCreating the OLAP CubeBI Application ToolExamples
4 Future Work and ConclusionFuture WorkConclusionQuestions
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 2 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Introduction
Collaborator: Herning Municipality
Home care department.
Business intelligence solution.
Existing technology
Operational home care system: Rambøll Care
What is missing?
Analytic capabilities
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 3 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Introduction
Collaborator: Herning Municipality
Home care department.
Business intelligence solution.
Existing technology
Operational home care system: Rambøll Care
What is missing?
Analytic capabilities
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 3 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Introduction
Collaborator: Herning Municipality
Home care department.
Business intelligence solution.
Existing technology
Operational home care system: Rambøll Care
What is missing?
Analytic capabilities
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 3 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Rambøll Care
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 4 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (1 of 2)
1 Has there been a change in the functional level between2003 and today?
2 Are there areas with equal functional levels that differsignificantly regarding inspected and actual providedassistance to a citizen?
3 Are there differences in the inspector’s grants, i.e., are twocomparable citizens granted different services based on thefunctional evaluation?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 5 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (1 of 2)
1 Has there been a change in the functional level between2003 and today?
2 Are there areas with equal functional levels that differsignificantly regarding inspected and actual providedassistance to a citizen?
3 Are there differences in the inspector’s grants, i.e., are twocomparable citizens granted different services based on thefunctional evaluation?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 5 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (1 of 2)
1 Has there been a change in the functional level between2003 and today?
2 Are there areas with equal functional levels that differsignificantly regarding inspected and actual providedassistance to a citizen?
3 Are there differences in the inspector’s grants, i.e., are twocomparable citizens granted different services based on thefunctional evaluation?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 5 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (2 of 2)
4 Are there special correlations between the functionalevaluation and the granted service package, i.e., is there forexample a subparameter in the functional evaluation that isdecisive for a change in the granted service package?
5 Has there been a change in the inspected time and thegranted time for citizens with similar characteristics based onthe functional evaluation?
6 Are there geographic conditions regarding both grants andfunctional levels?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 6 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (2 of 2)
4 Are there special correlations between the functionalevaluation and the granted service package, i.e., is there forexample a subparameter in the functional evaluation that isdecisive for a change in the granted service package?
5 Has there been a change in the inspected time and thegranted time for citizens with similar characteristics based onthe functional evaluation?
6 Are there geographic conditions regarding both grants andfunctional levels?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 6 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Questions (2 of 2)
4 Are there special correlations between the functionalevaluation and the granted service package, i.e., is there forexample a subparameter in the functional evaluation that isdecisive for a change in the granted service package?
5 Has there been a change in the inspected time and thegranted time for citizens with similar characteristics based onthe functional evaluation?
6 Are there geographic conditions regarding both grants andfunctional levels?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 6 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Our Focus
Question 1
Has there been a change in the functional level between 2003 andtoday?
Question 3
Are there differences in the inspector’s grants, i.e., are twocomparable citizens granted different services based on thefunctional evaluation?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 7 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
IntroductionRambøll CareQuestions
Our Focus
Question 1
Has there been a change in the functional level between 2003 andtoday?
Question 3
Are there differences in the inspector’s grants, i.e., are twocomparable citizens granted different services based on thefunctional evaluation?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 7 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Layout
1 Business Intelligence for Home CareIntroductionRambøll CareQuestions
2 Source Data and ETL ProcessSource DataExtract-Transform-Load
3 OLAP Cube and BI ApplicationCreating the OLAP CubeBI Application ToolExamples
4 Future Work and ConclusionFuture WorkConclusionQuestions
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 8 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Databases
Oracle - 9.5 GB
Production DB for the Rambøll Care System.
More than 100 tables
More than 100 views
SQL Server - 9 GB
Data Warehouse for Focus Care
98 Dimension tables
27 Fact tables
Documentation
NONE!!!
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 9 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Databases
Oracle - 9.5 GB
Production DB for the Rambøll Care System.
More than 100 tables
More than 100 views
SQL Server - 9 GB
Data Warehouse for Focus Care
98 Dimension tables
27 Fact tables
Documentation
NONE!!!
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 9 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Databases
Oracle - 9.5 GB
Production DB for the Rambøll Care System.
More than 100 tables
More than 100 views
SQL Server - 9 GB
Data Warehouse for Focus Care
98 Dimension tables
27 Fact tables
Documentation
NONE!!!
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 9 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Oracle Database Design
Tables
Both danish and english named tables, i.e. Client and Klient
Some tables are referenced all over the place, especiallyMODULE TYPE
Standard system extended with things as an afterthought
Tables can contain completely different things
Constraints
Mostly consists of only null checks
Few foreign keys used
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 10 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Oracle Database Design
Tables
Both danish and english named tables, i.e. Client and Klient
Some tables are referenced all over the place, especiallyMODULE TYPE
Standard system extended with things as an afterthought
Tables can contain completely different things
Constraints
Mostly consists of only null checks
Few foreign keys used
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 10 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Example from table EVALUATION HISTORY
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 11 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Example from table EVALUATION HISTORY
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 11 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Example from table EVALUATION HISTORY
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 11 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Architecture
E x t r a c t D A L T r a n s f o r m a t i o n L o a d D A L
G U I
S o u r c e D a t a W a r e h o u s e
E T L
T A R G I T
O L A P C u b e
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 12 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Design of the Data Warehouse
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 13 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Extract Employee
Source Table
PERSONNEL
Contains 2919 entries
Where about 600 entries are not employees, but more likefunctions, i.e. Week-end rute 5
What is extracted?
PersonelNo (ini)
CPR
Name
Address
Position
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 14 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Extract Employee
Source Table
PERSONNEL
Contains 2919 entries
Where about 600 entries are not employees, but more likefunctions, i.e. Week-end rute 5
What is extracted?
PersonelNo (ini)
CPR
Name
Address
Position
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 14 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Transform And Load Employee
Transform
Remove all employees without a CPR
Set PostCode to 0, if it does not exist
Load
Create the Employee table
Create a DataTable with all records
Use SqlBulkCopy to add the DataTable to the DW
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 15 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Transform And Load Employee
Transform
Remove all employees without a CPR
Set PostCode to 0, if it does not exist
Load
Create the Employee table
Create a DataTable with all records
Use SqlBulkCopy to add the DataTable to the DW
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 15 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Fact Table
Temporary Table
One entry for each evaluation
Contains the evaluation number
Contains keys for Citizens, Employee, Date and AgeGroup
Fact Table
For each evaluation, get the 20 rows with the actualevaluations from the source DB (MainGroup, SubGroup andValue)
Add the information from the temporary table to the fact
If any values are 0 or null, disregard the entire evaluation
For each 50.000 facts, add them to the DW.
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 16 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Source DataExtract-Transform-Load
Fact Table
Temporary Table
One entry for each evaluation
Contains the evaluation number
Contains keys for Citizens, Employee, Date and AgeGroup
Fact Table
For each evaluation, get the 20 rows with the actualevaluations from the source DB (MainGroup, SubGroup andValue)
Add the information from the temporary table to the fact
If any values are 0 or null, disregard the entire evaluation
For each 50.000 facts, add them to the DW.
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 16 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Layout
1 Business Intelligence for Home CareIntroductionRambøll CareQuestions
2 Source Data and ETL ProcessSource DataExtract-Transform-Load
3 OLAP Cube and BI ApplicationCreating the OLAP CubeBI Application ToolExamples
4 Future Work and ConclusionFuture WorkConclusionQuestions
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 17 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Creating the Dimensions
Creating the Hierarchy
Date Hierarchy
Age-Group Hierarchy
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 18 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Creating the Dimensions
Creating the Hierarchy
Date Hierarchy
Age-Group Hierarchy
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 18 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Creating Calculated Measures
Calculated Measures
Count
Average
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 19 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Creating Calculated Measures
Calculated Measures
Count
Average
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 19 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Browsing the OLAP Cube
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 20 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
TARGIT
Input
OLAP Cube.
Options
Select measure:
Grouped by <Attribute>
... with <Attribute> on the criteria line
... selected on the following criteria:
Output
Different Graphs
Tables
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 21 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
TARGIT
Input
OLAP Cube.
Options
Select measure:
Grouped by <Attribute>
... with <Attribute> on the criteria line
... selected on the following criteria:
Output
Different Graphs
Tables
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 21 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
TARGIT
Input
OLAP Cube.
Options
Select measure:
Grouped by <Attribute>
... with <Attribute> on the criteria line
... selected on the following criteria:
Output
Different Graphs
Tables
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 21 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Questions
Did any development happen, over time, in general?
Did any development happen, over time, in the main groupcategory ”Husføring”?
How is the distribution, of females over age, of the evaluationvalues.
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 22 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
General Development over Time
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 23 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Daily House Keeping Development over Time
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 24 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Main Group Development from 2002 to 2005
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 25 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Evaluation Value Distribution over age for females
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 26 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Evaluation Value Distribution over age for males
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 27 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Creating the OLAP CubeBI Application ToolExamples
Evaluation Value Distribution over age for males, cleaning
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 28 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Future WorkConclusionQuestions
Layout
1 Business Intelligence for Home CareIntroductionRambøll CareQuestions
2 Source Data and ETL ProcessSource DataExtract-Transform-Load
3 OLAP Cube and BI ApplicationCreating the OLAP CubeBI Application ToolExamples
4 Future Work and ConclusionFuture WorkConclusionQuestions
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 29 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Future WorkConclusionQuestions
Future Work
More Requirements, Working on Requirement 3
More Attributes, more analysis possibilities
More Calculated Measures
Find a way to use the comments for analysis purposes
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 30 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Future WorkConclusionQuestions
Conclusion
Designed a Data Warehouse
Implemented the ETL
Created the OLAP Cube
End User Analysis on the OLAP Cube
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 31 / 32
Business Intelligence for Home CareSource Data and ETL Process
OLAP Cube and BI ApplicationFuture Work and Conclusion
Future WorkConclusionQuestions
Questions
What can be done to make the process more time optimal?At the university? In Herning?
How could the comments attached to each evaluation form,or row, be used to improve the analytic possibilities of thedata warehouse?
How to implement a weights for overall analysis?
Peter Poulsen, Lars Schunk, Lasse Soelberg BI in the Home Care Sector 32 / 32