big data – from strategy to production

14
Big Data – From Strategy to Production Mag. Mario Meir-Huber Big Data Leader CEE

Upload: semantic-web-company

Post on 15-Apr-2017

447 views

Category:

Data & Analytics


2 download

TRANSCRIPT

Page 1: Big Data – From Strategy to Production

Big Data – From Strategy to ProductionMag. Mario Meir-HuberBig Data Leader CEE

Page 2: Big Data – From Strategy to Production

2

• Big Data – Challenges

• How to get it right?

Agenda

Page 3: Big Data – From Strategy to Production

3

Big Data - Challenges

Page 4: Big Data – From Strategy to Production

4 © 2014 Teradata

When Algorithms go bad …

Page 5: Big Data – From Strategy to Production

5 © 2014 Teradata

+ 5.99$ shipping costs

Page 6: Big Data – From Strategy to Production

6

Big Data Technology Stack

Hadoop Ecosystem

Big Data Platforms

Data Ingestion

AndProcessing

EfficiencyTrust

WorkloadGovernance

ToolsPlatform

ProgrammingParallel

Big Data Analytics

Data Science

Transformquestion

toalgorithm

Machine LearningAnalysis

IntegrationQuery

PerformanceTransform

Warehousing

Big Data Utilization

DomainExpertise

Asking theright

question

Reporting & Dashboards

Alerting & Recommend

ationsBusiness

IntelligenceText Analysis and Search

24/09/2015 6

DataCenters

Big Data Management

Scalable Data

Storage

IaaSCloud

VirtualizationNetwork

ComputeStorage

DBMSNoSQL

Man

agem

ent

Secu

rity

Pr

ivac

y

Gov

erna

nce

Data

Value

Page 7: Big Data – From Strategy to Production

7

BIG  DATA  IS  NOT  JUST  A  SINGLETECHNOLOGY

Page 8: Big Data – From Strategy to Production

8

BI/DWH Projects vs. Big Data Projects

$Xm

$Xm

$Xm

Release 1

Release 2

Release 3

3MAR

5MAY

7JUL

9SEP

11NOV

13JAN

15MAR

17MAY

19JUL

21SEP

23NOV

3MAR

5MAY

7JUL

9SEP

11NOV

13JAN

15MAR

17MAY

19JUL

21SEP

23NOV

BI/DWH Projects• Highly Planned & Controlled

• Slow Release Schedule

• 3x releases 2 years

• High Central funding cost

• Low Risk / High Success

Big Data Projects• Small Iterative Projects

• 40+ Discoveries / 2 years

• Low cost per project

• $20k-$50k per project

• BAU funded initiatives

• Project funded

• Central discovery team / BIU for free thinking

• High Risk / High Fail

• Iterates to a new project

40+ Projects over 2 years

3 Releases Over 2 years

Page 9: Big Data – From Strategy to Production

9

BIG  DATA  IS  NOT  JUST  A

USE  CASE

Page 10: Big Data – From Strategy to Production

10

BIG  DATA  IS  AMOVEMENTMORE  ANALYTICSON  ALL  YOUR  DATA

Page 11: Big Data – From Strategy to Production

11

Big Data – IT business alignment

Provide a business strategyInvolve all business departments

Prioritize projects and build a roadmapExecute

Provide a technology roadmapAnalyze necessary technologies

Implement a Big Data platform (Data Lake)

Execute projects

Page 12: Big Data – From Strategy to Production

12

BIG  DATA  NEEDS  THE  

BUSINESS

Page 13: Big Data – From Strategy to Production

13

How to get it right?

Page 14: Big Data – From Strategy to Production

1414 © 2014 Teradata