using a data lake at the core of a life assurance business

13
INTERNAL USE ONLY Using a Data Lake at the core of a Life Assurance business Hadoop World Summit April 13 th 2016 Rajdeep Mukherjee & Chris Murphy

Upload: dataworks-summithadoop-summit

Post on 16-Apr-2017

927 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Using a Data Lake at the core of a Life Assurance business

Hadoop World SummitApril 13th 2016

Rajdeep Mukherjee & Chris Murphy

Page 2: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 2

Zurich is a global insurance company founded in 1872 ,Head Quartered in Zurich Switzerland.

Zurich business is organized into three core business segments: General Insurance, Global Life and Farmers.

Zurich’s customers include – Individuals.– small businesses.– mid-sized and large companies, including

multinational corporations.in more than 170 countries.

Zurich Insurance – Introduction

Page 3: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 3

Insurance Industry – Key trends

The key trends impacting the business

– Digital Trends : Consumers are looking for simplicity , transparency and speed in their transaction with business . Relentless march of online and mobile technologies is continuing to fuel this change . A Digital transformation needs easy and quick access to data as a foundation.

– Technological : IOT and sensors presenting new opportunities and challenges at the same time and advent of Big data techs is allowing companies to process unstructured data to gain insights in conjunction with the structured data.

– Risks: Emerging risks due to new technology ,human interaction , habits needs advanced analytical models to predict losses.

– Regulatory : The effect of global regulations such as SOX , GLB and solvency II are driving insurers to ramp up Enterprise data management

Insurance

Digital Trends

Analytics Emerging Risks

Regulations

All Trends have Data in Common!

Page 4: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 4

State of Data Management

Fragmented Landscape. Rigid data design fails to Incorporate local business requirements Very long Change cycles.

OPERATIONS

oPERATION

LOB

Adhoc

Corporate

CRM PolicyMgmt

ClaimMgmt

ERP

ODS LoB Marts Spread sheets EDW

External Data

Business Users

Page 5: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 5

What Capabilities are required to Keep up with the Trends

Capability to store all data(Internal, External , Structured , Unstructured ) at Low cost. Capability to curate and expose Business Views on Demand. Data Fabric to support different workloads (Operational and Analytical). Support Rapid Change cycles. Enable metadata management and data Lineage. Govern where required don’t govern everything. Scaling up should be a low cost effort. Enable business Friendly tooling

“Make App , Analytics and Data a seamless process “Spee

d

App

Analytics

Data

Page 6: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Zurich Data Lake – Conceptual Architecture

6

CRM PolicyMgmt

ClaimMgmt

ERP

Life GC UK-GI BU

CustomerPolicyClaim

CustomerPolicyClaim

CustomerPolicyClaim

CustomerPolicyClaim

Customer Policy Claim

Raw StoreEverything with History

EnterpriseProvisioning

Curation Layer LoB Views

CurationGroup Level Views

Consumption

Real-time Interactive Batch

FlatteningLabelling

Data Sources

Page 7: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 7

Zurich Data Lake - Technical Architecture

Batch Ingestion

Micro Batch

Real Time

Ingestion Framework

s

Adapters

Ingest Persist ,Process, Provision Curate

RAW Layer

Enterprise Provision layer

LoBViews

Corporate Views

Security MgmtMetadata Mgmt

Operations Mgmt

Consume

API

Interactive SQL

Batch SQL

SOURCE

KerberosAD

IBM

Ambari

RANGER

Hcatalogue

Page 8: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY 8

Putting the Customer First

Page 9: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Getting to our dataLegacy technology landscape

9

Page 10: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Customer MatchingGuess Who

10

Page 11: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Tapping the Data lakeIn the Pipeline

11

Page 12: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Learnings

12

Page 13: Using a Data Lake at the core of a Life Assurance business

INTERNAL USE ONLY

Any Questions?

13