SYMANTEC STORAGE IN REDHAT OPENSTACK ECOSYSTEM Abhijit Dey Director, Engineering, Symantec

Agenda

                     Introduc*on  and  Background  1  

                     Symantec  Storage  Ecosystem  2  

                     Enabling  RedHat  OpenStack  with  Symantec  Storage  HA  3  

                   A  Use  Case:  Symantec  Storage  Appliance  with  Redhat  OpenStack  

                   Symantec  Storage  HA    in  Redhat  Virtualiza*on  (RHEV)  

5  

                   Q  &  A  6  

4  

Introduction and Background

OpenStack

OpenStack opportunity ñ OpenStack is an open source cloud computing platform

ñ Various components

ñ Compute (Nova)

ñ Image Service (Glance)

ñ Networking (Neutron)

ñ Object Storage (Swift)

ñ Block Storage (Cinder)

ñ Cinder provides an infrastructure for managing volumes in OpenStack.

Symantec Storage Ecosystem

Symantec Cluster File System / Storage and HA stack

Cluster-­‐wide  Low  Latency  Transport  

Group  Atomic  Broadcast  

Global  Lock  Manager  

File  system  instance  Cluster  Volume  Manager  

Cluster  File  System  

Node-­‐instance  CFS/CVM  agents   RAC,  NFS,  Apps  

Symantec  Cluster  Server,  agents  for  mounts/disk  groups/volumes  

Cluster-­‐wide  Low  Latency  Transport  

Group  Atomic  Broadcast  

Global  Lock  Manager  

File  system  instance  Cluster  Volume  Manager  

Cluster  File  System  

Node-­‐instance  CFS/CVM  agents   RAC,  NFS,  Apps  

Symantec  Cluster  Server,  agents  for  mounts/disk  groups/volumes  

CLUSTER INTERCONNECT

A 2-NODE CLUSTER

Enabling Redhat OpenStack with Symantec Cluster File System

Why use SYMANTEC Cluster File System with REDHAT OpenStack? ñ Enterprise Block Storage for OpenStack ñ Three Use Scenarios ñ Appliance format external presentation ñ Native on Nova (compute) ñ Virtual Storage Appliance

ñ Benefits of having Symantec CFS with OpenStack ñ High Availability, Resiliency and Performance ñ Leverage Internal DAS storage for price/performance ñ Bridge between traditional storage environments and OpenStack ñ Leverage SSD and Flash read/write cache ñ Storage optimizations (de-duplication, compression, thin reclamation) ñ Management features (replication, backup)

What is the aim here? ñ Symantec Cluster File System provides persistent block storage backend for Open Stack virtual Machines

ñ Volumes backed by Sparse/Pre-allocated files on Cluster File System (Protocols – NFSv3)

ñ Implement Symantec Cluster File System cinder driver using OpenStack Specification and functionality.

10

How to get this integration done? ñ Cinder provider – python code – implemented.

ñ Check into OpenStack (open-source) for Icehouse release (blue-print , code review, devstack testing complete )

ñ All Symantec Storage releases works with RDO Cinder + Symantec NFS driver.

ñ Get Redhat Certification by following partner certification program to be included with Redhat OpenStack – This work is underway NOW!

ñ Location : Openstack/cinder/volume/drivers/cnfs.pyvolume_driver=cinder.volume.drivers.cnfs.SymantecNFSDriver

11

REDHAT OPENSTACK

12

Cluster-­‐wide  Low  Latency  Transport  

Group  Atomic  Broadcast  

Global  Lock  Manager  

File  system  instance  Cluster  Volume  Manager  

Cluster  File  System  

Node-­‐instance  CFS/CVM  agents   RAC,  NFS,  Apps  

Symantec  Cluster  Server,  agents  for  mounts/disk  groups/volumes  

Cluster-­‐wide  Low  Latency  Transport  

Group  Atomic  Broadcast  

Global  Lock  Manager  

File  system  instance  Cluster  Volume  Manager  

Cluster  File  System  

Node-­‐instance  CFS/CVM  agents   RAC,  NFS,  Apps  

Symantec  Cluster  Server,  agents  for  mounts/disk  groups/volumes  

CLUSTER INTERCONNECT

SYMANTEC CLUSTER FILE SYSTEM

Implemented Features for Symantec RDO Cinder driver

ñ Icehouse – Cinder (Dev, QA complete)

ñ All of the Havana features + ñ Extend Volume - Extend volume is

the additional functionality. (pre-allocation of extents)

ñ Futures ñ Replication pool management ñ Secure Erase ñ Policy and SLA enforcements

ñ Havana – Cinder (Dev, QA complete)

ñ Volume Create/Delete ñ Volume Attach/Detach ñ Snapshot Create/Delete ñ Create Volume from Snapshot ñ Get Volume Stats ñ Copy Image to Volume ñ Copy Volume to Image ñ Clone Volume

Work in progress to get RHEL OpenStack running with Symantec Cluster File System ñ RDO certification of Symantec NFS Cinder driver in progress

ñ Users update Cinder configuration file to instantiate Symantec Storage subsystem.

ñ All Cinder API and commands are supported to manage the volumes.

ñ RDO Horizon dashboard will have full management capabilities.

Symantec Cluster File System NFS-based cinder driver ñ Based on generic NFS cinder driver. http://docs.openstack.org/havana/config-reference/content//NFS-driver.html

ñ Mount the NFS shares on the compute nodes.

ñ Create a file a sparse or pre-allocated (for performance) on the share chosen by cinder-scheduler.

ñ Exported as a virtual block device to the running VMs on the compute node.

ñ Leverage libvirt support to virtualize and presents as block devices.

ñ Generic NFS driver provides volume create/delete, attach/detach & statistics

Symantec iSCSI-cinder driver for Redhat OpenStack ñ Provides direct access to block devices

ñ Does not rely on hypervisor and libvirt. ñ Can use for block device provisioning purposes (bare metal / non-virtualized environment).

ñ Based on the Symantec ISCSI framework (create, delete, clone lun).

ñ Limitation: iSCSI based drivers can only present a maximum number of block devices.

ñ For large number of cinder volumes the NFS based driver will be recommended

Symantec Storage in Redhat Virtualization (Rhev)

Symantec + Red Hat Virtualization (RHEV)

ñ Enterprise ready Availability and Disaster Recovery Solutions ñ Enable Application and Virtual Machine Highly Availability ñ Integrated Replication, snapshots and recovery points

ñ Accelerated Performance

ñ Advanced read/write caching with SmartIO = more VMs on the box ñ Flexible Storage Sharing (Shared Nothing) = no SAN

ñ Resilient, Highly Available storage infrastructure

ñ Compression & De-duplication

Symantec Red Hat Virtualization (RHEV) Support Work in progress: ñ Qualifying live migration of guest OS backed by Symantec Cluster File System

ñ Symantec Cluster File System as a POSIX compliant File system, exported via NFS.

ñ Symantec Cluster Volume Manager as a shared block device.

ñ Symantec Dynamic Multi-pathing as a shared SCSI device in guest VMs.

ñ Use Symantec Clustering service / agents to automate live migration and DR

Current KVM and RHEV support matrix Supported Configuration   Red Hat KVM   RHEV (RHEL-H)  

Storage management in the host  

SFCFS on host   Work in Progress to get SFCFS on host  

Storage management inside virtual machine  

SFCFS inside virtual machine   Work in Progress to gt SFCFS inside virtual machine  

Split stack   SF on the host as well inside virtual machine  

Work in Progress / Proposed here  

Virtual machine availability (KVM)  

SFCFSHA on host   VCS on host  

Application Availability   SFCFSHA inside virtual machine  

VCS inside virtual machine  

Symantec ApplicationHA   VCS on host and ApplicationHA inside virtual machine  

Work  in  Progress  to  get  VCS  and  AppHA  insider  virtual  machine  

Virtual Machine Disaster Recovery  

No   VCS on host  

SFCFS-HA/DR in RHEL-H cluster (including metro cluster)

CVM  CFS  

VCS  

RHEL  Guest  

RHEL  Hypervisor  

DMP  

CVM  CFS  

VCS  

Vir*o-­‐blk  

RHEL  Guest  

Vir*o-­‐scsi  

RHEV-­‐M  

Live  migraLon  support  and  co-­‐existence  

Virtual  Machine  HA  

SmartIO  /  FSS  

De-­‐duplicaLon  

ReplicaLon  

Storage  Live  migraLon  

Cluster-­‐wide  Low  Latency  Transport  Group  Atomic  Broadcast  

Global  Lock  Manager  

File  system  instance  Cluster  Volume  Manager  

Cluster  File  System  

Node-­‐instance  CFS/CVM  agents   RAC,  NFS,  Apps  

Symantec  Cluster  Server,  agents  for  mounts/disk  groups/volumes  

RHEL  Hypervisor  

Disaster Recovery solution for RHEV

GCO  

VFR  

VVR  

RHEL  Hypervisor  DMP  VxVM  VxFS  

VCS  

Vir*o-­‐blk  Vir*o-­‐scsi  

RHEL  Guest  

RHEL  Hypervisor  DMP  VxVM  VxFS  

VCS  

Vir*o-­‐blk  

RHEL  Guest  

Vir*o-­‐scsi  

A Use Case: Symantec Storage Appliance integrated with Redhat OpenStack

Symantec Storage NAS Appliance ñ Scalable to 64 nodes

ñ Leverage SAN or DAS storage

ñ Developed using Redhat 6.5

ñ Cluster File System and HA solutions delivered as an Appliance

ñ Fully integrated with Red Hat OpenStack Cinder

ñ Future Manila Integration

RHEL 6.5 OS

Symantec Core Storage Layer

Protocol

CIFS FTP

HTTP

Oracle Plugin NFS

CLI GUI

Enab

lem

ent

OpenStack Plugin

Network

RHEV Plugin

Backup Client

iSCSI

       Symantec  Storage  Appliance  Architecture  

 

Symantec NAS Layer

Appliance integration with Redhat OpenStack REDHAT OPENSTACK

SYMANTEC STORAGE NAS

APPLIANCE

REDHAT 6.5 OS

Bottomline q Today, Symantec Clustering Services provides High Avaialability for Redhat

Virtualization platform.

q At Symantec we are working with Redhat closely to provide the following functionality

q Enable Redhat OpenStack with Symantec Storage HA

ü  Enabling Redhat Openstack in Symantec NAS appliance (currently under development)

ü  NFS and ISCSI Cinder drivers to support Redhat OpenStack integration with Symantec Storage HA

q Integration of RHEV and Symantec

ü  Enabling Rhev-Host and Rhev-guest with full HA/DR support for application and virtual machines using Symantec Storage Foundation HA