openstack & netappstorage+for+openstac… · a legacy of open source collaboration push &...

‹#›

OpenStack & NetApp

Seamlessly Connect Clouds with NetApp

2

A Legacy of Open Source CollaborationPush & Pull

3

A Legacy of Open Source CollaborationPush & Pull

3

Linux

FreeBSD

iSCSI

NFS

RDMA

SnapCreator

NDMP

OpenStack

oVirt

▪ OpenStack Foundation

▪ Charter member (Gold)

▪ OpenStack Summit sponsors

NetApp OpenStack Involvement

4

▪ 1st Major Storage Provider

▪ Upstream Contributions

▪ Production Deployments

▪ Deployer

▪ OpenStack Foundation

▪ Charter member (Gold)

▪ OpenStack Summit sponsors

NetApp OpenStack Involvement

4

NetApp Joins ! Integration Announced

Folsom Summit Sponsor !

7-mode driver in Essex

Havana Summit Sponsor !

Direct Drivers in Grizzly

“K” Release Summit Sponsor !

Manila Incubation

Essex Summit Sponsor !

7-mode driver previewed

Grizzly Summit Sponsor !Clustered

ONTAP driver in Folsom

Icehouse Summit Sponsor !RHEL-OSP on

FlexPod !Swift on E-series

2012.4 2013.4 2014.102011.3 2011.10 2012.10 2013.10 2014.4

Juno Summit Sponsor !

E/EF-series drivers in Icehouse

▪ 1st Major Storage Provider

▪ Upstream Contributions

▪ Production Deployments

▪ Deployer

Core Competencies

5

E-SeriesFAS

Core Competencies

5

Service AutomationQuality of Service

Unified Architecture

Storage EfficiencySeamless Scaling

Secure Multi-Tenancy

Continuous Operations

Data Mobility Data Protection

Simplicity

Vast BandwidthDensity

ConsistencyHorizontal Scaling

Broad Connectivity

Versatility

Data Mobility All-Flash

▪ Avail core competencies through OpenStack service abstractions

Development Theme

6

Software Defined Storage, Today

7

VM VM VM VM VM VM VM

Clustered Data ONTAP®

SVM SVM SVM SVM

Clustered Data ONTAP

8

SVM SVM SVM

Continuous Uptime

▪ Virtualized Everything

▪ Network

▪ Storage Controller

▪ Storage Containers

▪ Live Migration

▪ Continuous Availability

▪ Horizontal / Vertical Scaling

▪ Secure Multi-tenancy, Data Protection, Storage Efficiency, Performance Assurance, Encryption, et cetera, et cetera

FlexVol FlexVol FlexVol FlexVol

LIF LIF LIF LIF LIF LIF


8

SVMSVM SVM

Continuous Uptime

▪ Virtualized Everything

▪ Network

▪ Storage Controller

▪ Storage Containers

▪ Live Migration

▪ Continuous Availability

▪ Horizontal / Vertical Scaling

▪ Secure Multi-tenancy, Data Protection, Storage Efficiency, Performance Assurance, Encryption, et cetera, et cetera

FlexVolFlexVolFlexVol FlexVol

LIF LIF LIFLIFLIF LIF

CoreOpenStack Logical Architecture

9

CoreOpenStack Logical Architecture

9

ImageBlock

StorageCompute

Orchestration

Dashboard

Networking

Identity

Object Storage

Telemetry

Shared Files

Compute

Image Object Storage

Block Storage


Networking

Shared Services

E/EF-Series FlashRay StorageGRID WebScale

Integration Overview

10

Glance

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



10

Image

Glance


▪ File or Swift Backends ▪ Simplicity advantage to File

▪ rapid instance creation advantage to File

!▪ 90+% Deduplication not uncommon

Glance on Data ONTAP

Glance on NetApp

VM

VM

11

Deduplication

RHEL SUSEUbuntu

Ubuntu SUSE UbuntuUbuntu UbuntuSUSE

RHEL RHEL SUSERHELRHEL SUSE






Glance on NetApp

VM

VM

11

Deduplication

RHEL SUSEUbuntu

Ubuntu SUSE UbuntuUbuntu UbuntuSUSE

RHEL RHEL SUSESUSE






Glance on NetApp

VM

VM

11

Deduplication

RHEL SUSEUbuntu

Ubuntu SUSE UbuntuUbuntu Ubuntu

RHEL RHEL SUSE






Glance on NetApp

VM

VM

11

Deduplication

RHEL SUSEUbuntu

Ubuntu SUSE Ubuntu

RHEL RHEL SUSE

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



12

Image

Swift

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



12

Image

Object Storage

Object Storage

Swift

Swift Deployment

3 Copies... Commonly MoreSwift on JBOD

13

Storage Node

Storage Node

Storage NodeAny single

object stored 3 or

more times

Swift & Dynamic Disk PoolsEfficient Storage & Scaling

14

▪ Dynamic distribution / re-distribution of data“De-clustered” RAID

▪ An evolved CRUSH… node level Erasure Coding

▪ Space and scaling efficiency

Swift Deployment

1.3 Copies within a SiteSwift on E-series Dynamic Disk Pools

15

Storage Node

Pari

ty

Swift Deployment

1.3 Copies within a SiteSwift on E-series Dynamic Disk Pools

15

1.3X capacity

consumed with DDP

Storage Node

Pari

ty

▪ Significant improvement in cost of operations

▪ Swift becomes immediately consistent within a site

▪ Deploy E-series across sites for even greater savings

▪ Efficient, reduced replication▪ eliminates a scaling inhibitor

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



16

Image

Object Storage

Object Storage

Cinder

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



16

Image

Object Storage

Object Storage

Block Storage

Block Storage

Cinder

▪ A control plane, not the data path

!▪ Abstraction to implementation

!▪ No fan-in or data path impedance

Block Storage Control Plane

17

Instance

HypervisorStorage

Controller

Compute Block

Storage

Cinder as Orchestrator

FAS

Clustered ONTAP

7-mode

Cinder deployment with NetAppDiverse Options for Diverse Use Cases

18

E-Series

E-Series

EF-Series

FAS

Clustered ONTAP

7-mode

Cinder deployment with NetAppDiverse Options for Diverse Use Cases

18

E-Series

E-Series

EF-Series

pNFS

NFSiSCSI

NFS

iSCSI

iSCSI

iSCSI

▪ Cinder “Volumes” are block devices

▪ Cinder “Drivers” are providers

▪ File Cloning

▪ Snapshots = immutable file clones

Clustered ONTAP Tenant Atomicity

19

FlexVol

Cinder Volume Types

Archival

Deliver a Storage Marketplace

20

▪ Craft a catalog

▪ based upon tenant requirements

▪ Compose volume types with

▪ Efficiency

▪ Performance

▪ Availability

▪ Protection

netapp:raid_type!

netapp:disk_type!

netapp:qos_policy_group!

netapp_mirrored!

netapp_dedup!

netapp_nodedup!

netapp_compression!

netapp_thin_provisioned

netapp:raid_type!

netapp:disk_type!


netapp_mirrored!

netapp_dedup!

netapp_nodedup!

netapp_compression!


netapp:raid_type!

netapp:disk_type!


netapp_mirrored!

netapp_dedup!

netapp_nodedup!

netapp_compression!


netapp:raid_type!

netapp:disk_type!


netapp_mirrored!

netapp_dedup!

netapp_nodedup!

netapp_compression!


netapp:raid_type!

netapp:disk_type!


netapp_mirrored!

netapp_dedup!

netapp_nodedup!

netapp_compression!


Analytics Streaming Temporal Database

Cinder

Cinder E/EF-Series driver

22

SYMbol Proxy

Volume Types

E-series

HPC Database Analytics

Cinder

Cinder E/EF-Series driver

22

SYMbol Proxy

Volume Types

E-series

6 Accumulo instances with 2TB of type

“Analytics”

HPC Database AnalyticsAnalytics

Cinder

Policy-Based Block Storage Service

23

Silver

RemoteClustered ONTAP

Volume Types

Gold BronzeSilver

Cinder


23

Silver


Boot 8 CentOS LAMP instances with 2TB of Silver please

Volume Types

Gold BronzeSilver

Cinder

SnapMirror


23

Silver


Boot 8 CentOS LAMP instances with 2TB of Silver please

Volume Types

Gold BronzeSilverSilver

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



24

Image

Object Storage

Object Storage

Block Storage

Block Storage

Nova

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



24

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute

Persistent, rapid, space-efficient instances

Nova


Enhanced Instance Creation

25

Boot 8 persistent RHEL instances… Glance on NetApp

Cinder on NetApp

Hypervisor

RHEL SUSEUbuntu CentOS


Enhanced Instance Creation

25

Boot 8 persistent RHEL instances… Glance on NetApp

Cinder on NetApp

Hypervisor

RHEL RHEL RHEL RHEL

RHEL RHEL RHEL RHEL

RHEL SUSEUbuntu CentOS

RHEL RHEL RHEL

RHEL RHEL RHEL RHEL

RHEL

▪ Cloned, not copied

▪ Instances, instantly

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



26

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute


Manila

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



26

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute


Shared Files

Shared File Systems

Manila

Manila


28

Finance R&D

Nova

Hypervisor

VM VM VM VM VM VM

Manila


28

Finance R&D Marketing

Share “R&D” with Instances 1 & 3

Create a “Marketing” share for 2 & 4

Nova

Hypervisor

VM VM VM VM VM VM

Adding Manila…OpenStack Logical Architecture

29

Adding Manila…OpenStack Logical Architecture

29

Orchestration

Dashboard

Networking

Identity

ImageBlock

StorageCompute (Virtual)

Object Storage

Telemetry

SharedFile Systems

Stackforge, Tempest, & Devstack integratedManila – Incubation

31

Shared Files

Compute


Block Storage


Image

Networking

Shared Services



32

Image

Object Storage

Object Storage

Block Storage

Block Storage

Compute


Shared Files

Shared File Systems

NetApp Icehouse Summary

33

▪ E-series & EF-series Cinder

▪ Manila progress ▪ Incubation

▪ pNFS ▪ by default, where available

▪ Enhanced Instance Creation ▪ copyoffload optimization

▪ Reference Architectures ▪ Puppet manifests for simplified deployment

NetApp Icehouse Summary

33


Development FocusJuno

▪ Manila

▪ Cinder Currency & New Features

▪ Reference Architectures

▪ Configuration Management Tooling

▪ Deployment Automation

▪ Horizon, Heat, Ceilometer

▪ Fibre Channel Support

▪ Puppet ▪ Clustered Data ONTAP

▪ E/EF-series

!▪ Chef ▪ Clustered Data ONTAP

▪ E/EF-series

Programmable Infra

35

Configurations Management Coming with Juno

▪ Agile Data Infrastructure ▪ Build private and public clouds delivering high-

performing, efficient and scalable services

▪ Proven Storage & Data Management ▪ Lower risk and enable a broad spectrum of cloud

SLAs by combining the power and ingenuity of open-source cloud management with proven data solutions

▪ Community Leadership & Commitment ▪ Provide choice in cloud management by actively

collaborating and taking a leadership role in the development of open-source initiatives

Why NetApp for OpenStack?

36

▪ Continuous Availability for Continuous Deployment ▪ Focus on Dev, not on Ops

!▪ Unified Storage ▪ Cloud Native & POSIX Living together in harmony on

a single efficient architecture

!▪ Common Data Fabric, Hybrid Cloud now ▪ Single most prevalent storage operating system

▪ thin, efficient replication

▪ repatriation & bursting


37

▪ Slice for POC, roll to production ▪ Focus on Dev, not on Ops

!▪ Graduate your no-SLA to high-SLA on

the same infra ▪ Livestock & Pets, living together in harmony

!▪ Holistic, sustainable Cloud Deployment ▪ power, cooling, efficiency…


38

▪ Announced at the Hong Kong Design Summit

▪ Technical Report April 2014 ▪ Reference Architecture: Deploying RHEL-OSP 4

on NetApp Clustered Data ONTAP

▪ Cinder drivers RHEL-OSP certified

OpenStack & Converged Infrastructure

39

FlexPod with Red Hat OpenStack Platform

News ▪ http://netapp.com/openstack

▪ @openstacknetapp

▪ #openstack-netapp on freenode

!Resources ▪ NetApp OpenStack Deployment and Operations Guide

▪ RHEL-OSP Reference Architecture

▪ Rackspace Private Cloud Certifications

▪ Nebula Integration

▪ NetApp OpenStack Communities

Getting Started

40


SessionsRelated Topics


SessionsRelated Topics

▪ Ask the Experts: Storage Considerations for OpenStack ▪ Monday 11:15am - 11:55am

▪ Demo Theater: Optimize Cloud Storage with NetApp ▪ Monday 2:00pm - 2:15pm

▪ Creating Differentiated Storage Offerings Using Cinder Volume Types ▪ Monday 2:00pm - 2:40pm

▪ Introducing Nebula. Experience Turn-key Private Cloud ▪ Monday 2:50pm - 3:30pm

▪ NetApp Storage for OpenStack ▪ Wednesday 9:00am - 10:00am

▪ Manila: An OpenStack File Share Service ▪ Wednesday 10:15am - 11:15am

▪ Extending TripleO for OpenStack Infrastructure Management ▪ Wednesday 11:00am - 11:40am

▪ Considerations and Lessons Learned Deploying OpenStack ▪ Wednesday 11:30am - 12:30pm

OpenStack SummitNovember 2014

42

▪ First OpenStack Summit in EMEA

▪ See you there!▪ Paris, France

▪ “K” Design Summit

Thanks!@openstacknetapp

43

openstack & netappstorage+for+openstac… · a legacy of open source collaboration push &...

Documents