global sponsors - dell technologies germany...global sponsors dell emc data analytics strategy...

GLOBAL SPONSORS

GLOBAL SPONSORS

Dell EMC Data Analytics Strategy STEFFEN THUEMMEL

ADV. SYSTEMS ENGINEER, DELL EMC

[email protected]

44ZB DATA

2020

IoT

Enterprise Challenges in Digital Transformation Drive for deeper insights is accelerating need

for architectures to enable unstructured

analytics

22ZB

2018

11ZB

2016

Manage Data Growth

Perform Advanced Analytics

Handle Unstructured Data Sources

Drive Real-Time Results

Organizations need to deliver analytics on more than

just their traditional structured data

Evolving spectrum of data analytics

Requires infrastructure that enables multiple applications and varied use cases

Predictive

Analytics

Business

Intelligence

Analytics of

Things

Cyber security

Analytics

Real-time

Analytics

Machine

Learning

Enables analytics for ALL of your data

Dell EMC Unstructured Analytics Portfolio

PowerEdge

Performance

Centric

Storage

Centric

Predictive

Analytics

Business

Intelligence

Analytics of

Things

Cyber security

Analytics

Real-time

Analytics

Machine

Learning

Archive

Centric

© Copyright 2017 Dell Inc. 6

Dell EMC Unstructured Analytics Portfolio

PowerEdge

Solution accelerators Splunk Ready System

Hadoop Ready Bundle

QuickStart for Hadoop

EDW Optimization Solutions

Hadoop Backup Solutions

SAS-Grid Solution with Isilon

Streaming Analytics Solutions

Proven solutions for unstructured analytics


HADOOP DECISIONS

DAS

ECS

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRxqFQoTCOaly7Pu2McCFUM7Pgod2B4DeQ&url=http://upgradingpeopleeveryday.com/blog/artmid/131966/articleid/38016/now-offering-amazon-web-services-and-cloudera-training&psig=AFQjCNHiPYQJ4OLnDpmAZlGOccr0SUQbow&ust=1441300896805011

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjB8sP05_XLAhVP8mMKHfkhBfYQjRwIBw&url=http://www.pngall.com/ibm&bvm=bv.118443451,d.cGc&psig=AFQjCNFcA9ueQkBExd5x99_gMKXmQySm0Q&ust=1459887772668708

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRxqFQoTCNzKibCdwscCFQp5PgodJvgL8w&url=http://spark.apache.org/&ei=ZVLbVZyEE4ry-QGm8K-YDw&psig=AFQjCNHdyNDf3WRI-e7ueqm1L1sxneimaQ&ust=1440523234717178

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&frm=1&source=images&cd=&cad=rja&uact=8&ved=0CAcQjRxqFQoTCIai1rqdwscCFcZaPgode2gMoQ&url=https://visualstudiogallery.msdn.microsoft.com/b73b4531-5c7c-4984-b67b-9eab33c50232&ei=e1LbVcb4IMa1-QH70LGICg&psig=AFQjCNECpCFJa8Ai7YpgkHzZ4S948mLUDg&ust=1440523254568085

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiZzvnm6vXLAhVQ7WMKHdmpBaAQjRwIBw&url=http://findicons.com/icon/568510/database&bvm=bv.118443451,d.cGc&psig=AFQjCNGUqdc3YPNgng-NCSRoREfxLUiGBA&ust=1459888538189055

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=&url=http://www.iconarchive.com/show/ios7-icons-by-icons8/Very-Basic-Lock-icon.html&bvm=bv.118443451,d.cGc&psig=AFQjCNHghGLCxCH0NqiPX8gewOX06ixg0A&ust=1459888723118299

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwi8irad8PXLAhUIPT4KHVSPCe4QjRwIBw&url=https://commons.wikimedia.org/wiki/File:Magnifying_glass_icon.svg&psig=AFQjCNE7jNYWUdw7med5jDZSH6Rw-sYi9A&ust=1459890009562716




3 TRADITIONAL DISCOVERY QUESTIONS

1

2

3

What do you hope to achieve with Hadoop?

Why is this impactful to your business?

Which Hadoop Distribution

will you choose?

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwit2_OTl_jLAhVEnw4KHUZmBuYQjRwIBw&url=http://info.hortonworks.com/INFA_Hortonworks_Phrama_Series_.html&bvm=bv.118443451,d.eWE&psig=AFQjCNHil0lBXJ2DPbRah7QnpbAURqLGNQ&ust=1459969176955875

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiait_El_jLAhVGLw8KHRycAjIQjRwIBw&url=http://bigdatauniversity.com/zones/tcs/&bvm=bv.118443451,d.eWE&psig=AFQjCNE2LQfPfQOMEwsYMp3O3sbfvWGrNg&ust=1459969272577029

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjKpL7JmPjLAhVD7g4KHZ-uCoEQjRwIBw&url=http://www.quadrobay.com/images/&psig=AFQjCNHHJx1kNeWfMXgq9FPleUPO9VVg1Q&ust=1459969316731077

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwirrvHVlvjLAhUH7g4KHZW7B7wQjRwIBw&url=http://www.powerframeworks.com/series-AV037&bvm=bv.118443451,d.eWE&psig=AFQjCNHZvNKLURqWqQkDRF6AImPprIPy9Q&ust=1459969015139246

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwik-NCfl_jLAhWGDQ4KHXCKCrsQjRwIBw&url=https://otp.pivotal.io/&bvm=bv.118443451,d.eWE&psig=AFQjCNHTUQj9Xn0hn0QZH_-lbS3p9a5yeg&ust=1459969199734600

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjI5rOCl_jLAhXEow4KHZCgDSMQjRwIBw&url=http://community.cloudera.com/&bvm=bv.118443451,d.eWE&psig=AFQjCNFI64y3A4_Cf5TRGE_ehB9kEdLYkQ&ust=1459969137755513

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwj8v8CM8fzLAhVGuw4KHbsEAEwQjRwIBw&url=https://www.voltage.com/partner/mapr/&psig=AFQjCNEhfSoUqO6xxrM3tTVdblzaa7uh8g&ust=1460130753920899

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjD74is8fzLAhVBxQ8KHfeTAUUQjRwIBw&url=https://twitter.com/wilfriedhoge/status/583658998198599680&bvm=bv.118817766,d.ZWU&psig=AFQjCNGHdLiqz2uZ8wDGlNPDoQYrYaO94Q&ust=1460130808307627

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjZ_u_L9fzLAhVDlg8KHQVaBycQjRwIBw&url=http://www.packsize.com/solutions/cfo/&bvm=bv.118817766,d.ZWU&psig=AFQjCNEcmW16c2Q2tpMgmAbvUnwuXwUAfQ&ust=1460131945400094

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwimgKGho_3LAhXIXh4KHR1sCQcQjRwIBw&url=http://edgh.washington.edu/home/series/clinical-education-modules&psig=AFQjCNHLFgY4glCQnnm4TduBm5WdtLgIgw&ust=1460144154784219


NEXT LEVEL QUESTIONS

Access Implementat

ion

Compliance

Scalability

Tools & Apps

Business Units

Consolidate

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwivmOX7pvjLAhXGA44KHVphBAsQjRwIBw&url=https://thetripclip.com/tc/Main/Activities/index.php?activityID%3D22%26ID%3DQ%26age%3Dpictures%26size%3D1&psig=AFQjCNGWxxTePCNRRnh-bz6WWZRd1x5UYg&ust=1459973418806556

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwivqOGEvPjLAhVBqw4KHXmuAyUQjRwIBw&url=https://www.fotolia.com/id/91395650&bvm=bv.118443451,d.ZWU&psig=AFQjCNFuLr9FnXxaK-hdhX4rqPHzkjYyJw&ust=1459979034792551

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjE_YDZvPjLAhUEaQ8KHanrD10QjRwIBw&url=http://www.clariant.com/en/Company/DiscoverValue/Glucopure&bvm=bv.118443451,d.ZWU&psig=AFQjCNFck9HdgHrGihMWirKc_RctQseuMg&ust=1459979251991539

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwi5xtGsvfjLAhUG7A4KHYnCBtwQjRwIBw&url=http://www.freepik.com/free-photos-vectors/key&bvm=bv.118443451,d.ZWU&psig=AFQjCNF34tnCw8XQzkgpho2szCUr5w-dhg&ust=1459979423539933

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwibjYr7vfjLAhXBjA8KHYRtAQoQjRwIBw&url=http://www.freepik.com/free-photos-vectors/hierarchy-icon&bvm=bv.118443451,d.ZWU&psig=AFQjCNFLJSXfUw9YPt3WAxWil4hnual0Mw&ust=1459979587549399

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwic2u23vvjLAhWCFg8KHXNZD2sQjRwIBw&url=http://community.k2.com/&bvm=bv.118443451,d.ZWU&psig=AFQjCNGIW39pxcfDdyko6OfBb_KFBPAU_Q&ust=1459979709768896

http://www.iconarchive.com/show/ios7-icons-by-icons8/Network-Security-Checked-icon.html

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjC-cDCuP3LAhUBPg8KHfYUCCoQjRwIBw&url=https://thenounproject.com/term/diversity/173121/&bvm=bv.118817766,d.ZWU&psig=AFQjCNGdW6bpf-L8Bb2_xUhxhttHDltqKw&ust=1460149921228079


EMC ISILON HDFS INTERFACE

• Native HDFS support

• Underlying file system is OneFS

• As simple as pointing the HDFS clients to the

DNS name of the Isilon cluster!


HADOOP WITH EMC DATA LAKE

1 Multi Protocol Scale-Out Storage Platform

• NFS, SMB, FTP, HTTP, HDFS, SWIFT

2 Enterprise Data Protection & Governance

• SnapshotIQ, SyncIQ, SmartLock, ACLs..

3 Industry-Leading Storage Efficiency

• >80% Storage Utilization

4 Independent Scalability with Optimized QoS

• Optimally Scale Storage & Compute

5 Consolidate Data Silos

• Industry Standard Protocols

• Bring Applications to Shared Data

6

Hadoop as a Service

• Eliminate Shadow IT

• Offer variations of Hadoop to all your BUs


Traditional “Share-Nothing” Hadoop

Existing Virtualized Data Center SHARE-NOTHING Hadoop Infrastructure

Unstructured Data

1

Existing Primary Storage

2 3 4 2 3 4 2 3 4 2 3 4

• Hadoop on a Stick (R=3)

means 5 data copies ($$$$)

• Data has to copy to the

Hadoop cluster before analysis

can begin (Time to Results)

How will you maintain data

consistency when a file changes

on your primary storage?

http://www.google.com/url?sa=i&rct=j&q=file+folder+computer+image&source=images&cd=&cad=rja&docid=RIRIN7x8ZSTU6M&tbnid=DkZgWX30S_FZGM:&ved=0CAUQjRw&url=http://www.wpclipart.com/computer/icons/folders/yellow_file_folder.png.html&ei=W6hkUfW9L4es8QT-hYD4Aw&bvm=bv.44990110,d.eWU&psig=AFQjCNHj-4J6mOyb6D5f72yAN2wBRgk31A&ust=1365637557242641














Existing Virtualized Data Center


Isilon “Share-Everything” Hadoop

1

Start using Hadoop NOW with unused processing and RAM available in your VMware environment

No replication required (Use your existing data)

Access to same data via NAS and HDFS protocols

Time to results extremely fast using already existing data with NO COPIES or wasted $$$$

Analysis Can

Begin with

the 1st VM

New Hadoop Compute Nodes

Unstructured Data

Use Native HDFS Protocol




DEPENDENT SCALING

Traditional Hadoop HDFS

Storage to Compute ratio is fixed

Scaling compute means scaling capacity

Difficult to provide QoS

Compute upgrade is a forklift

Compute

Sto

rage

Required

performance/

capacity

Required Hadoop

Cluster Nodes


INDEPENDENT SCALING

Traditional Hadoop HDFS

Isilon HDFS

Storage to Compute ratio is fixed

Scaling compute means scaling capacity

Difficult to provide QoS

Compute upgrade is a forklift

Scale compute independent of storage

Achieve optimal performance balance even as workloads evolve

No data migrations, ever!

Add new performance as hardware evolves

Benefit from 80% utilization rate Compute

Sto

rage

Required

performance/

capacity

Required Hadoop

Cluster Nodes


SNAPSHOT & VERSION CONTROL

Before

After

Traditional HDFS does not have replication

No Snapshotting of data

Loss of version control

Not designed for Mission Critical

Full SnapshotIQ integration identifies changes

Multi-threaded, Multi-Node Scale-Out replication

Improved RPO/RTO for business continuity

Geo-replicated Hadoop!


ISILON REGULATORY COMPLIANCE


Data Center Network

TIME-TO-RESULTS

Data Copy Analysis In-Place Analysis


Hadoop on a Stick

Have you ever

copied 100TB from

Primary Storage to

a Hadoop system?

How long does it

take to copy 100TB

from one place to

another over a

10Gb link?

>24 Hours

Data Center Network


Hadoop Compute Nodes

Reading

relevant

data to

analysis



















http://www.google.com/url?sa=i&rct=j&q=document&source=images&cd=&cad=rja&docid=CvuNvLB3gqK0kM&tbnid=aubfJN_kFZJ-tM:&ved=&url=http://www-03.ibm.com/software/lotus/symphony/gallery.nsf/GalleryClipArtAll/8CE0CE18AB15F52185257596003225D4&ei=xaFoUdCKLejKigKtioDACw&bvm=bv.45175338,d.cGE&psig=AFQjCNE-MxjVtOS7CeP5fqSHsiiab-FmmQ&ust=1365898054040540


SMB, NFS,

HTTP, FTP,

HDFS

NameNode

Data

name

node

name

node

name

node

name

node

da

ta n

od

e

NFS

SMB

SMB

NFS

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MULTIPLE HADOOP DISTRIBUTIONS

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

MAP Reduce

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjI5rOCl_jLAhXEow4KHZCgDSMQjRwIBw&url=http://community.cloudera.com/&bvm=bv.118443451,d.eWE&psig=AFQjCNFI64y3A4_Cf5TRGE_ehB9kEdLYkQ&ust=1459969137755513

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwiait_El_jLAhVGLw8KHRycAjIQjRwIBw&url=http://bigdatauniversity.com/zones/tcs/&bvm=bv.118443451,d.eWE&psig=AFQjCNE2LQfPfQOMEwsYMp3O3sbfvWGrNg&ust=1459969272577029

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwik-NCfl_jLAhWGDQ4KHXCKCrsQjRwIBw&url=https://otp.pivotal.io/&bvm=bv.118443451,d.eWE&psig=AFQjCNHTUQj9Xn0hn0QZH_-lbS3p9a5yeg&ust=1459969199734600

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjD74is8fzLAhVBxQ8KHfeTAUUQjRwIBw&url=https://twitter.com/wilfriedhoge/status/583658998198599680&bvm=bv.118817766,d.ZWU&psig=AFQjCNGHdLiqz2uZ8wDGlNPDoQYrYaO94Q&ust=1460130808307627


HADOOP OUTLOOK

80 % Utilizati

on

Capacity Independen

t Scalabilit

y

Implementation

Enterprise features

Data Access Applications

& Tools

Hadoop-as-a-service

Compliance &

Regulation

https://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwivqOGEvPjLAhVBqw4KHXmuAyUQjRwIBw&url=https://www.fotolia.com/id/91395650&bvm=bv.118443451,d.ZWU&psig=AFQjCNFuLr9FnXxaK-hdhX4rqPHzkjYyJw&ust=1459979034792551

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwi5xtGsvfjLAhUG7A4KHYnCBtwQjRwIBw&url=http://www.freepik.com/free-photos-vectors/key&bvm=bv.118443451,d.ZWU&psig=AFQjCNF34tnCw8XQzkgpho2szCUr5w-dhg&ust=1459979423539933

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwjE_YDZvPjLAhUEaQ8KHanrD10QjRwIBw&url=http://www.clariant.com/en/Company/DiscoverValue/Glucopure&bvm=bv.118443451,d.ZWU&psig=AFQjCNFck9HdgHrGihMWirKc_RctQseuMg&ust=1459979251991539

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwibjYr7vfjLAhXBjA8KHYRtAQoQjRwIBw&url=http://www.freepik.com/free-photos-vectors/hierarchy-icon&bvm=bv.118443451,d.ZWU&psig=AFQjCNFLJSXfUw9YPt3WAxWil4hnual0Mw&ust=1459979587549399

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=0ahUKEwic2u23vvjLAhWCFg8KHXNZD2sQjRwIBw&url=http://community.k2.com/&bvm=bv.118443451,d.ZWU&psig=AFQjCNGIW39pxcfDdyko6OfBb_KFBPAU_Q&ust=1459979709768896

http://www.iconarchive.com/show/ios7-icons-by-icons8/Network-Security-Checked-icon.html

http://www.google.com/url?sa=i&rct=j&q=&esrc=s&source=images&cd=&cad=rja&uact=8&ved=&url=http://www.iconarchive.com/show/ios7-icons-by-icons8/Very-Basic-Lock-icon.html&bvm=bv.118443451,d.cGc&psig=AFQjCNHghGLCxCH0NqiPX8gewOX06ixg0A&ust=1459888723118299



OPPORTUNITY COSTS OF TRADITIONAL HADOOP DEPLOYMENTS

Opportunity Cost Description Benefit with Isilon

Data Transformation/Migration

Projects

Hydrating a data lake involves data migration

projects as pre-requisite for analytics use cases.

Data Migration Projects avoided with in-

place analytics

Multiple Siloed Analytics/Hadoop

platforms Data management costs per each platform

Supports Multiple Analytics/Hadoop

Platforms with single copy of data

Customized DR and data

protection solutions

Design, implementation and life cycle management

of data protection and disaster recovery solutions on

DAS cluster

Supports Data Protection and Disaster

Recovery

out-of-the-box

Managing storage efficiently Storage provisioning, monitoring, quota

management on DAS cluster Storage management out-of-the-box

Fraud

Detection &

Risk Analytics

Trading / Tick

Data Analytics IoT

Data Driven

Business

Transformation

Unstructured Analytics Use Cases

Customer 360

Analytics

Enabling enterprises to improve operational efficiencies

and monetize new revenue streams

Right Solution Configuration for the use case

High Performance w/ cost as main driver

100% Compliance to Hadoop Operational features

Ability to scale down at cost On

e o

r

mo

re

Storage scaling faster than compute

Enterprise Grade File Mgmt.

Consolidation of IT Workloads

Aggregate capacity > 100 TB

On

e o

r

mo

re Data Compute

Geo-distributed single namespace

Analytics and Hadoop

Compute Data

Compute + Data

PowerEdge

PowerEdge

PowerEdge

Dire

ct

Att

ach

ed

Sto

rag

e

Sh

are

d S

tora

ge

CUSTOMER REQUIREMENTS CONFIGURATION drive

Pe

rfo

rman

ce-

ce

ntr

ic

Sto

rag

e-

ce

ntr

ic

Arc

hiv

e-

ce

ntr

ic


Data analytics offerings


Visit: dellemc.com/bigdata

global sponsors - dell technologies germany...global sponsors dell emc data analytics strategy...

Documents