architecture overview for data analytics deployments · data analytics platform dashboards...

26
GLOBAL SPONSORS Architecture Overview for Data Analytics Deployments Mahmoud Ghanem Sr. Systems Engineer

Upload: dangdan

Post on 18-Feb-2019

221 views

Category:

Documents


0 download

TRANSCRIPT

GLOBAL SPONSORS

Architecture Overview for Data Analytics Deployments

Mahmoud Ghanem

Sr. Systems Engineer

© Copyright 2017 Dell Inc. 2

Agenda

• The Big Picture

• Top Use Cases for Data Analytics

• Modern Architecture Concepts for Data Analytics

• Dell EMC Solutions to Simplify Data Analytics

© Copyright 2017 Dell Inc. 2

© Copyright 2017 Dell Inc. 3

The Big Picture…

+

DATA

ANALYTICS DEVOPS CLOUD

+ =

INDUSTRY

LEADER

KNOW

SOONER

ACT

FASTER

SCALE

IT

DIGITAL

DISRUPTION

© Copyright 2017 Dell Inc. 4

DATA ANALYTICS SPECTRUM

DESCRIPTIVE

STATISTICS

PREDICTIVE

MODELING

PRESCRIPTIVE

RECOMMENDATIONS

GENERAL

INTELLIGENCE

DATA MINING

MACHINE LEARNING

GENERAL AI

© Copyright 2017 Dell Inc. 5

Top Use Cases for Data Analytics

EDW Optimization

360 View of Customer

Security, Risk & Compliance

IOT

Predictive Analytics

Operations Intelligence

ML

DATA ANALYTICS PLATFORM

Dashboards Visualization

Platform As A Service

Data Marketplace Application Marketplace

Collaboration Real time Control

ENABLE DATA FOR CONSUMPTION – ANALYTICS / DATA APIS

OPEN STANDARDS DATA INGESTION, STORE, CLEANSE & GOVERNANCE

Data Ingestion (IoT, Social, City, Personal)

Data Stores (Structured, Unstructured, Object, In-Memory,

Key Value)

Data Wrangling (Transformation, Cleansing)

Data Governance (Audit, Workflow, Encryption)

INFRASTRUCTURE FOUNDATION

SECU

RIT

Y

Cloud M&O (Private,

Public)

Business Continuity (Backup & Recovery, DR)

Compute (Converged, Scale-up, Scale-out)

Network (SDN,SAN, WAN, Wireless)

Storage (SDS, Block, File, Object)

DATA LAYER

APPLICATION LAYER

Data Discovery

Search

Analytics (Graph, Machine Learning, Spatial,

Sentiment)

API Management (Data API, Micro-Services)

Catalog

INFRASTRUCTURE LAYER

© Copyright 2017 Dell Inc. 7

A strategic comparison of modern architecture concepts

for Data Analytics.

© Copyright 2017 Dell Inc. 8

BUY

BUILD

© Copyright 2017 Dell Inc. 9

BUY

© Copyright 2017 Dell Inc. 10

BUY • Time to value

• Commodity use case

• Simplicity at a cost

• Incumbent evolution/expansion

• Existing talent

• Use/source diversity is low

© Copyright 2017 Dell Inc. 11

BUILD

© Copyright 2017 Dell Inc. 12

BUILD

• Unique value stream

• Snowflake use case

• Cheap = Complex

• Lower cost of incumbents

• Talent and DevOps culture

• Massive scale and variety

• Lower cost of incumbents

• Talent and DevOps culture

• Massive scale and variety

© Copyright 2017 Dell Inc. 13

BATCH

STREAMING

© Copyright 2017 Dell Inc. 14

BATCH

© Copyright 2017 Dell Inc. 15

BATCH

• Descriptive

• Fidelity matters

• Large volumes

• Data Science playground

• Time is relative

• Scheduled

© Copyright 2017 Dell Inc. 16

STREAMING

© Copyright 2017 Dell Inc. 17

STREAMING

• Potentially Predictive

• Speed trumps fidelity

• Parallel for streams

• Data Science outcomes

• Talent and DevOps culture

• Massive scale and variety

© Copyright 2017 Dell Inc. 18

PUBLIC

PRIVATE

© Copyright 2017 Dell Inc. 19

VIRTUAL

PHYSICAL

© Copyright 2017 Dell Inc. 20

DAS

NAS

© Copyright 2017 Dell Inc. 21

© Copyright 2017 Dell Inc. 22

Biz Apps

Priorities

Services

Deploy

Compute

Dell EMC

portfolio

Knowledge

Ready Nodes

Ready Bundles

Ready Systems

The Ready Solutions formula

© Copyright 2017 Dell Inc. 23

Dell EMC Ready Bundles for Hadoop

End-to-end data

management,

processing and

analytics with

‘no-code-needed’

deployment plus

high double-digit

performance gains

Dell EMC Ready Bundle for Cloudera Hadoop

Capacity optimized

and efficient data

processing and

data lake platform

leveraging Isilon

for shared storage

for Hadoop with

HDFS as a

protocol.

Dell EMC Ready Bundle for Hortonworks with

Isilon

Open Source data

management,

processing and

analytics solution

that efficiently

process multi-

structured data

volumes using

existing tools and

resources

Dell EMC Ready Bundle for

Hortonworks Hadoop

© Copyright 2017 Dell Inc. 24

Big Data Technology Advisory Service • Develop an architecture and plan to implement big data capabilities

Analytics Application development

Statistical Modeling/Natural

Language Processing/

Machine Learning

Data Exploration/ Visualization

Enterprise Search/Index

Business Intelligence

Data Warehousing

Data Transformation

Data Discovery

Data Tagging / Metadata

Management

Hadoop / SQL on Hadoop

Enterprise Log Analysis

Data Ingestion

Key Steps:

1. Determine Target

Capabilities and Outcomes

2. Assess Current State

3. Determine Future State

Architecture

4. Perform Gap Analysis

5. Recommend Architecture

Roadmap and plan

© Copyright 2017 Dell Inc. 25

The journey is worth it