modernizing data architecture using data virtualization for agile data delivery
TRANSCRIPT
INTERNAL USE ONLY
Modernizing Data Architecture using Data Virtualization for Agile Data Delivery
Dave Kay, Data Consultant
UKGI Data, Analytics and Architecture
INTERNAL USE ONLY 2
INTERNAL USE ONLY 3
55,000Employees (approximately)
170+Countries
USD 4.6 bnBusiness operating profit
INTERNAL USE ONLY 4
The Zurich Group Operates a Federated Model for Data
Deliveries.
Group Function – Delivers Data Framework
Satellite Function – ZNA
Satellite Function – UKGI & UK Life
Satellite Function – Zurich Switzerland BU
Etc…
INTERNAL USE ONLY 5
INTERNAL USE ONLY 6
Big change coming in Insurance – the ability to respond at pace is key to success.
•
•
•
•
•
•
INTERNAL USE ONLY 7
INTERNAL USE ONLY 8
Learn about and build plans for:
•
Driving toward a near future that
encompasses:
•
With ambition for a longer term
where:
•
INTERNAL USE ONLY 9
INTERNAL USE ONLY 10
Sch
ed
uli
ng
Data
So
urc
es
ET
L P
rocessin
g
So
luti
on
Deli
very
User
Access
INTERNAL USE ONLY 11
Reduce
CostFlex
Resource
Raise
throughputAccelerate
change
• Cost of change prohibitive to generating value from data
• Slower time to market inhibiting impact of good analytics
• Complexity of solution can cause delivery bottlenecks
• Bespoke coded solution requires unique resource to maintain
INTERNAL USE ONLY 12
Data
Landing
Conformed
Warehouse
Data Hub Interface
Layer
• Data landed into infrastructure from disparate sources
• Conformed enterprise data warehouse provides central storage
• Data hub providing single ‘user facing’ data source
• Simplified Interface layer landscape – single point of entry
INTERNAL USE ONLY 13
INTERNAL USE ONLY 14
Business Need: Provide daily MI and intra-day
Operational Reporting for a community of business
analysts, salesmen, underwriters, managers and
actuarial staff – off the back of a brand new system.
• XML Source with over 13,000 elements, 10+ products
• XML Schema not available
• Data items and schema differ dramatically per
product type
• Fast pace of change
INTERNAL USE ONLY 15
• Subset of data ‘shredded’ via XSLT – immediately reduces scope
(250 items)
• SSIS transforms at multiple points generate maintenance difficulties
• Data effectively replicated multiple times
• Change Request process lengthy and expensive
• Specialist development skills required
INTERNAL USE ONLY 16
• XML made available into new DAA architecture for ingestion
• Denodo used as a virtual staging wrapper
• Views over XML representing core entities for reporting (Relational
View) virtualised in Denodo – cached to SQL Server
• Relational, Reporting and Analytical stores published as
consumable data sets via Denodo
• Two tier interface:
• Rapid interactive access to quickly changing data for ad-hoc
queries via Alteryx, JDBC, REST etc
• Stable, conformed relational marts virtualised & cached for
exploration, analysis and visualisation in Qlik etc
INTERNAL USE ONLY 17
•
•
•
•
•
•
•
•
••
INTERNAL USE ONLY 18
INTERNAL USE ONLY 19
Data
So
urc
es
Vir
tua
l S
tag
ing
Vir
tua
l S
em
an
tic
Ato
mic
Ware
ho
us
e
Vis
ua
lisati
on
An
aly
tic
s
INTERNAL USE ONLY 20
Reduce
CostFlex
Resource
Raise
throughputAccelerate
change
• Cost model reduced
• Significantly quicker time to market
• Greater throughput
• Resource pool expanded