mt09 using dell’s hpc cloud solutions to maximize hpc utilization while reducing cost

28
Using Dell HPC Cloud Solutions to Maximize Discovery, Innovation & Transformation Jay Boisseau, Ph.D. Chief HPC Technology Strategist Session MT09

Upload: dell-emc-world

Post on 16-Apr-2017

173 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

Using Dell HPC Cloud Solutions to Maximize Discovery, Innovation & Transformation

Jay Boisseau, Ph.D.Chief HPC Technology Strategist

Session MT09

Page 2: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

2

HPC, Cloud & Dell: Questions We Will Answer

1. What is high performance computing (HPC)?

2. What is cloud computing?

3. What kind of cloud HPC is right for you?

4. What are Dell HPC solutions and recommendations,

from on-prem to managed to hybrid?

• R Systems

• Cycle Computing

• VMware

• OpenStack

Page 3: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

What is High Performance Computing (HPC)?

Page 4: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

4

HPC: Faster, Better Answers to Bigger Problems

• HPC is for

– faster answers, to

– bigger problems, and large sets of problems, with

– better accuracy!

• HPC solutions offer higher performance

than mainstream IT solutions, through

– higher performance components, e.g.› Dell EMC PowerEdge C6320p servers w/Intel Xeon Phi processors

› Dell EMC PowerEdge C4130 servers w/NVIDIA GPUs or Xeon Phi

› Dell EMC OmniPath Networking or Mellanox InfiniBand networking

› Dell EMC high performance storage such as IEEL, Isilon, and more

– highly integrated systems of components, e.g.› Dell HPC System for Research, Manufacturing, and Life Sciences

› HPC management software including Bright Computing or OpenHPC software

Page 5: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

5

The Definition of HPC is expanding

Computationally-intensive modeling & simulation applications by scientists, engineers and others

Traditional modeling and simulation applications:

• Computer-aided design and manufacturing (CAD/CAM/CAE)

• Weather forecasting• Oil Exploration

Using HPC technologies to analyze big data for rapid insights, real time results and predictive analytics

New HPDA applications:

• Personalized medicine• Fraud detection• Machine Learning

Traditional High

Performance

Computing

High Performance

Data Analytics

(HPDA)

Data-centric HPC

applications• Genomics

• Financial modeling

• Signal processing

Page 6: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

Only 18% of IT organizations were effective in introducing new technologies faster and/or more effectively than competitors.4

Industry now

accounts for almost

half of HPC revenue.1

HPC is moving mainstream—more uses for more kinds of customers

1 out of 4By 2018, HPC will account for nearly 1 in 4 of all servers sold, and $20B+ in aggregate hardware sales.5

HPC is “mainstreaming” into many verticals and converging with big data and Cloud.

45% of IT execs said top priority for technology providers is to enable innovation.2

50%

45%

Yet there are still major challenges to adoption.

77% of HPC end users report that data and storage is now the most strategic part of HPC data center.3

77%18%

Page 7: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

7

HPC is critical for BIG problems that require faster, better answers via integrated, scalable solutions

Modeling & Simulation

Traditional ParallelComputing Clusters

Large Ensemble Problems Analyzing Multiple Data Sets

High Throughput Computing

Fast Answers & Insights for Data Intensive Problems

Big Data Analytics

(we’ll address this box shortly…)

Page 8: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

8

Dell Technologies Vision to Democratize and Advance HPC

Dell Technologies will help more

people make more innovations

and discoveries than any other

HPC systems vendor in the world

Michael Dell at CERN

Page 9: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

9

Dell Technologies Vision to Democratize and Advance HPC

Dell Technologies will help more

people make more innovations

and discoveries than any other

HPC systems vendor in the world

Michael Dell at CERN

We will achieve our vision via an innovative,

cost-effective portfolio of solutions that integrate

Dell Technologies and partner innovations with

community standards.

Page 10: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

10

Servers Storage Networking Management DataCenterServices & Financing

Accelerators

HPC System for Research

HPC System for Life Sciences

HPC System for Manufacturing

HPC NFS Storage

HPC Lustre Storage

(IEEL)

• Simplified design, configuration and ordering

• Domain-specific designs using flexible industry-standard building blocks

• Validated systems for research, life sciences and manufacturing with a single point of

contact for services and support and ease of financing

Dell EMC HPC Systems portfolio today

Page 11: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

What is Cloud Computing?

Page 12: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

12

What is Cloud Computing? Simplified, Scalable Resources and Usage

Cloud computing is a model of deploying, managing and using network-

connected computing and storage resources that enables

Flexible provisioning and scaling

Optimal usage of resources through

virtualization or containers

Failover/redundancy/resiliency

Multiple models/levels (e.g. SaaS) for different needs

Increased collaboration

On-demand usage scaling

Cost optimization, flexible pricing models

Page 13: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

13

Cloud Computing: Public, Private, Hybrid.., Oh My!

• Public cloud providers like Microsoft, Amazon, and others provide compute and

storage resources to anyone, charge by usage

• Private cloud solutions are deployed by companies and institutions for their sole

usage, and are often referred to as on-prem (“on premises”)

• Managed services/ecosystem: these are systems managed and provided on pay-

per-usage or dedicated pricing models (and now exist for HPC e.g. R Systems)

• Hybrid cloud solutions provide all the benefits of local/on-prem/private cloud

solutions, and enable leveraging managed or public cloud solutions

For HPC, public cloud solutions are limited in features compared to Dell HPC solutions,

and thus on scalability and performance on HOC workloads. However, Dell private and hybrid

HPC cloud solutions can be designed for optimal effectiveness for Dell customers

Page 14: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

14

Cloud Computing: Public, Private, Hybrid.., Oh My!

• Public cloud providers like Microsoft, Amazon, and others provide compute and

storage resources to anyone, charge by usage

• Private cloud solutions are deployed by companies and institutions for their sole

usage, and are often referred to as on-prem (“on premises”)

• Managed services/ecosystem: these are systems managed and provided on pay-

per-usage or dedicated pricing models (and now exist for HPC e.g. R Systems)

• Hybrid cloud solutions provide all the benefits of local/on-prem/private cloud

solutions, and enable leveraging managed or public cloud solutions

For HPC, public cloud solutions are limited in features compared to Dell HPC solutions,

and thus on scalability and performance on HOC workloads. However, Dell private and hybrid

HPC cloud solutions can be designed for optimal effectiveness for Dell customers

Page 15: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

15

Dell Provides, Customer-centric Cloud Solutions

Microsoft VMwareRedHat /

OpenStack

Glo

ba

l S

up

po

rt &

De

plo

ym

en

t

Cloud Strategy & Advisory Services

De

ll F

ina

ncia

l Se

rvic

es

Dell Servers / Storage / Networking

Infrastructure Management

Cloud Management & Integration

Cloud Brokerage/Resell

Performance & Security Management

Cloud Integration Services

Cloud Hosting & Management

Offering stack

Private Cloud

Public Cloud

Professional Services

Managed Services

Customer entry points

A

B

D

C

Professional Services

D

Consulting Services-led cloud deployment

On-premise or managed private cloud deployment

IaaS or PaaSdeployment

B

A

Hybrid

Cloud

Public Cloud

PrivateCloud

Managed Services

C

Page 16: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

16

Dell has a Differentiated Cloud Strategy to Drive Significant Growth

Delivering customer success with Dell’s innovative Future-Ready Cloud

Customer outcomes…

Best-of-breed technology innovation & expertise

Comprehensive, end-to-end lifecycle solutions

Heterogeneous choice and distinct point of view

Dell differentiators…

A faster, simpler path to cloud with less risk and greater project success

Industry-leading TCO with integrated cloud

management, visibility, and security

Flexibility to adapt cloud to changing business demands

Page 17: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

What kind of cloud HPC solution is right for you?

Page 18: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

18

HPC is critical for BIG problems that require faster, better answers via integrated, scalable solutions

Cloud Computing

Emerging Usage Model to Simplify HPC

Modeling & Simulation

Traditional ParallelComputing Clusters

Large Ensemble Problems Analyzing Multiple Data Sets

High Throughput Computing

Fast Answers & Insights for Data Intensive Problems

Big Data Analytics

HPC can thus provide a competitive advantage to almost any business or organization!

Page 19: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

19

• Extra capacity as needed

• Reduced internal I/T requirements

• Greater load flexibility

• Security

Cloud models Why not Cloud?

• Public cloud

• Private cloud

• Hybrid cloud

• Cost: burst vs. steady-state

• Workload: burst vs. steady-state

• ISV licensing

• Data motion

• Security

Why Cloud?

Why HPC Cloud Solutions?

Dell anticipates that hybrid HPC Cloud will become increasingly pervasive with a wide diversity of optimal solutions available for different customer requirements.

Solution integration will become more critical.

Page 20: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

What are Dell HPC solutions and recommendations for cloud HPC?

Page 21: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

Dell HPC as a Managed Service

• Customizable burst, short-term and/or long term HPC

capacity served as an operating expense, with flexible

usage options.

• Large scale core count clusters with choice of

interconnect options

• High memory configurations available for memory

intensive workloads

• “White Glove” user support for the novice or

experienced HPC customer

• Customizable security: public, hybrid or private cloud

• Quick and easy to set up access

• ISVs - ANSYS, CD-Adapco, LSTC, Simulia, others

Services overview Customer benefits

• “Utility” Use (Pay as you go) or

“Dedicated” / Exclusive Use

• Reduce capital outlay and TCO

• Infrastructure

• Hardware

• Technical staff

• Lower technical barrier to HPC

• Increase institutional utilization

of HPC resources

• Flexibility in HPC platform,

compute and storage options.

Page 22: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

22

Dell + Cycle Computing: On-Prem Dell HPC Systemswith Public Cloud Bursting

22

Existing workflows

Instant access to resources

Auto-scaling

Secure, consistent cloud access

Ability to link usage to costs

Support for multi-cloud

Reliable tools for IT

Workflows linking internal and external clouds

Tools to Manage & control costs

Page 23: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

23

Dell + Cycle Computing: On-Prem Dell HPC Systemswith Public Cloud Bursting

CycleCloud tools extend on-prem HPCsolutions to public cloud, to optimize:– Productivity &innovation: instant access to

‘extra’ resources as needed– Cost: only burst/migrate workloads when

usage is– Simplicity: full data & workflow, no code

rewrites– Security: encrypts in motion and at rest

• Customers in financial services, pharma and manufacturing are adopting rapidly!

• Direct availability to customers—talk to us!

Internal

Data

Workflow

Burst

User

Page 24: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

24

VMware: Virtualization Leadership, Now For HPC

• VMware is the clear leader in enterprise virtualization

• VMware offers HPC Virtualization to enable research, innovation

– increase utilization, enable wider usage of the compute environment by

providing much greater flexibility in usage

– improve resource control

– leverage infrastructure for combined workloads (HPC and non-HPC)

– reduce costs, simplify management

• Virtualization making inroads into HPC areas such as life

sciences, electronic design automation, financial services, Big

Data, and digital media

• VMware vSphere now runs on Amazon Web Services (AWS)

– AWS (and other public clouds) Amazon Web Services already offers

some HPC capabilities, and is useful for some loosely-coupled

simulations, high throughput computing, and large-scale data analysis

– Amazon recently announced (9/30/16) new AWS EC2 instances with up

to 8 NVIDIA K80 GPUs (very effective for some HPC applications)

Page 25: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

25

OpenStack and Container Solutions for HPC

• OpenStack is the leading open-source software for creating private, public,

and hybrid clouds

• OpenStack controls large pools of compute, storage, and networking

resources throughout a datacenter

• Dell EMC provides leading OpenStack solutions in partnership with Red Hat

• Dell EMC HPC solutions include Bright Computing software, which provides

simplified OpenStack deployment and management

• Dell EMC is working with many partners to explore future OpenStack and

containerized solutions for HPC, including Intel and also academic partners at

University of Cambridge and Monash University

Page 26: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

26

Summary

HPC adoption & usage is growing: HPC enables faster, better innovation and discovery

Cloud computing is enormous and growing: it simplifies deployment, management,

usage, and scaling

Dell EMC can design and deliver optimal hybrid HPC cloud solutions for customers

with variable workloads, enterprise virtualization requirements, and/or desire to combine

workloads on IT systems

– Dell EMC with R Systems

– Dell EMC with Cycle Computing and Microsoft Azure

– Dell EMC VMware/Amazon Web Services

Dell EMC is working with Intel, Red Hat, and innovative academic partners around the

world to explore providing robust HPC-cloud capabilities on top of OpenStack, using

containers, etc.

Page 27: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost

Let’s talk

See HPC solutions in action at the Expo• Kiosks and Customer Presentations in the

Big Data & Analytics area

Engage with our Dell EMC HPC subject matter experts to learn more

Visit dell.com/hpc

Join the Dell EMC HPC Community www.dellhpc.org

Page 28: MT09 Using Dell’s HPC Cloud Solutions to maximize HPC utilization while reducing cost