choosing the right enterprise data architecture

10

Click here to load reader

Upload: cloveretl

Post on 22-Jan-2018

181 views

Category:

Data & Analytics


3 download

TRANSCRIPT

Page 1: Choosing the right enterprise data architecture

CHOOSING THE RIGHT ENTERPRISE

DATA ARCHITECTURE

Page 2: Choosing the right enterprise data architecture

Data is predicted to grow 40% year on year, however this data is often unstructured and comes in an ever-growing number of formats. How exactly do you begin to decide the correct data architecture to deal with all this influx of data, and how do you get there? This SlideShare will help you put typical enterprise data architectures into perspective of costs, use and skillsets required.

Page 3: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Initial Investment

Low

Operational Data Data Lake Data Mart Data Vault Data WarehouseODS

Medium High

No initial setup required

Modelling is less complicated as with

a data warehouse but requires ALL

data to be captured

High investment in normalizing and

modelling data for use in the data

warehouse

Some initial modelling required, but mostly can be

left until later

Limited department scale > easier

modelling

Calls for automated replication and

cleansing process, no excessive

modelling required

Page 4: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Cost Of Asking New Questions

Low

Data Vault ODS Data Mart Operational Data Data WarehouseData Lake

Medium High

Curated structures capture all data

Additional integration required

Relatively small scale of data captured

All raw data accessible immediately. Requires talent to interpret data

as its needed

Calls for remodelling the global

normalized model

Page 5: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Ongoing Maintenance Costs

Low

Operational Data Data Mart Data Lake Data VaultData Warehouse

Medium High

No cost Any change in data needs to be reflected

in the data vault

Collecting all raw data can impose ever-growing

storage cost

As long there are no new questions,

no maintenance required

Same as data warehouse

Page 6: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Frequency Of Change In The Business

Slow

Data Warehouse Data Vault Data Lake Operational DataData Mart

Medium Fast

Page 7: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Type of Data

Data Warehouse Data Vault Data Lake Operational DataData Mart

Highly structured and well described

(SQL databases)

Mixed with unstructured data (text, images, etc.)

Page 8: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Use Case

DataWarehouse Data Mart Data Lake Data Vault Data Lake Operational

DataOperational

Data ODS

Business intelligence, key reporting on KPIs

Ad hoc analytics on structured data

Ad hoc analytics on any data

Near real-time fresh data required

Page 9: Choosing the right enterprise data architecture

To learn more, download Your Guide to Enterprise Data Architecture white paper

Talent Available Or Planned In The Organization

DataWarehouse Data Mart Data

Warehouse Data Mart Data Vault Data Lake OperationalData

Non-technical Traditional IT Data Scientist, Developer, Data Consultant