ma - the next step in software-defined storage with virtual san · 2014-07-09 · virtual san...
TRANSCRIPT
© 2014 VMware Inc. All rights reserved.
The next step in Software -Defined Storage with Virtual SAN
VMware vForum 2014
Michael Armstrong@m80arm
What’s on the agenda?
• Where Virtual SAN fits in the Software Defined Data Center
• Overview of Virtual SAN
– How to build and configure
– Ecosystem
– Features: Resiliency, Scaling, Performance, Simplicity, Integration
• Virtual SAN Use Cases
• Additional Resources
The Software-Defined Data Center
3
Transform storage by aligning it with app demands
Managementtools give wayto automation
Expand virtual
compute to all
applications
Virtualize the network for speed and efficiency
The Software-Defined Data Center
4
Transform storage by aligning it with app demands
Today’s Challenge: Massive Increase in Storage Demand & Complexity
5
24%
26%
28%
28%
31%
42%
Management
Complexity
Provisioning
Time/budget
DataMigrations
Troubleshooting
MeetingSLA
Most Pressing Storage Challenges
M
20M
40M
60M
80M
100M
120M
2008 2009 2010 2011 2012 2013 2014 2015 2016
Terabytes Sold
Terabytes Sold
Source: IDC, Yezhkova, Worldwide Enterprise Storage Systems Forecast, November 2013, #244293
Storage Growth
41%YoY
Source: IDC, Storage Predictions 2014, January 2014, General Storage QuickPoll, #243511, n=307
Storage Market in Midst of Disruption
6
Key Drivers Server flash
Falling storage prices
Abundant CPU cycles
Hypervisor-converged infrastructure
Cloud economics
Server Storage
20-30 years ago
Shared Storage
10-15 years ago
New Forms
Today
The Hypervisor Opens Up New Opportunities
7
SAN / NAS
x86 Servers
Cloud Storage
vSphere
The virtualization platform:
• Knows the needs of all apps in real time
• Sits directly in the I/O path
• Global view of underlying infrastructure
• Hardware agnostic
Object-based Pool
SAN/NAS Pool
Hypervisor Converged
Pool
Leveraging The Hypervisor We Can Transform Storage
8
• Today • Software-defined Storage
LUN
Array A
LUN
LUN
Array B
LUN
LUN Abstract and
pool(Virtualized Data Plane)
Automate SLAs via VM-centric policies(Policy-based Control Plane)
VM level Data services(Virtual Data Services)
SAN / NAS
x86 Servers
Cloud Object
Storage
vSphere
Replication
Snapshots
Software-Defined Storage
9
Bringing the efficient operational model of virtualization to storage
Virtual Data Services
Data Protection
Mobility Performance
Policy-driven Control Plane
SAN / NAS
SAN/NAS Pool
Virtual Data Plane
x86 Servers
Hypervisor-convergedStorage pool
Object Storage Pool
Cloud Object
StorageVirtual SAN
VMware Virtual SAN 5.5Radically Simple Hypervisor-Converged Storage
Virtual SAN: Radically Simple Hypervisor-Converged Storage
11
vSphere + Virtual SAN
…
• Software-defined storage embedded in vSphere
• Runs on any standard x86 server
• Pools HDD/flash into a shared datastore
• Managed through storage policy-based management framework
• High performance through flash acceleration
• Highly resilient - zero data loss in the event of hardware failures
• Deeply integrated with the VMware stack
The BasicsThe Basics
Hard disksSSD
Hard disksSSD
Hard disks
SSD
Virtual SAN Shared Datastore
Why Virtual SAN?
12
• Two click Install
• Single pane of glass
• Policy-driven
• Self-tuning
• Integrated with VMware stack
Radically SimpleRadically Simple
• Embedded in vSphere kernel
• Flash-accelerated
• Up to 2M IOPs from 32 nodes
• Granular and linear scaling
High PerformanceHigh Performance Lower TCO
• Server-side economics
• No large upfront investments
• Grow-as-you-go
• Easy to operate with powerful automation
• No specialized skillset
12,000+Virtual SAN
Beta Participants
95% Beta
customersRecommend
VSAN
90%Believe VSAN
will impact Storage like
vSphere did to Compute
Unprecedented Customer Interest And Validation
13
Virtual SAN
Virtual SAN Puts The App In Charge• Simpler and Automated Storage Management Through Application-
centric Approach
14
Today
1. Pre-define storage configurations
2. Pre-allocate static bins
3. Expose pre-allocated bins
4. Select appropriate bin
5. Consume from pre-allocated bin
1. Define storage policy
2. Apply policy at VM creation
Resource and data service are automatically provisioned and maintained.
Virtual SAN Shared
Datastore✖ Overprovisioning
(Better safe than sorry!)
✖ Wasted resources, wasted time
✖ Frequent data migrations
� No overprovisioning
� Less resources, less time
� Easy to change
Today
Virtual SAN Simplifies And Automates Storage Management
15
Per VM Storage Service Levels From a Single Self-tuning Datastore
Storage Policy-Based Management
Virtual SAN Shared
Datastore
vSphere + Virtual SANvSphere + Virtual SAN
SLAs
Software Automates Control of Service
Levels
No more LUNs/Volumes!
Policies Set Basedon Application
Needs
Capacity
Performance
Availability
Per VM Storage Policies
Hardware Requirements
16
Any Server on the VMware Compatibility Guide
• SSD, HDD, and Storage Controllers must be listed on the VMware Compatibility Guide for VSAN http://www.vmware.com/resources/compatibility/search.php?deviceCategory=vsan
1Gb/10Gb NIC
SAS/SATA Controllers (RAID Controllers must work in “pass-through” or RAID0” mode
SAS/SATA/PCIeSSD
SAS/NL-SAS/SATA HDD
At least 1 of each
4GB to 8GB USB, SD Cards
Virtual SAN Implementation Requirements
• Virtual SAN requires:– Minimum of 3 hosts in a cluster
configuration
– All 3 hosts MUST!!! contribute storage• vSphere 5.5 U1 or later
– Maximum of 32 hosts
– Locally attached disks• Magnetic disks (HDD)
• Flash-based devices (SSD)
– Network connectivity• 1GB Ethernet
• 10GB Ethernet (preferred)
17
esxi-01
local storage local storage local storage
vSphere 5.5 U1 Cluster
esxi-02 esxi-03
cluster
HDDHDD HDD
Two Ways to Build a Virtual SAN Node• Completely Hardware Independent
18
1. Virtual SAN Ready Node
…with multiple options available at GA + 30
Preconfigured server ready to use Virtual SAN…
2. Build Your Own
…using the Virtual SAN Compatibility Guide*
Choose individual components …
SSD or PCIe
SAS/NL-SAS/ SATA HDDs
Any Server on vSphere Hardware Compatibility List
HBA/RAID Controller
Note: For additional details, please refer to Virtual SAN VMware Compatibility Guide Page Components for Virtual SAN must be chosen from Virt ual SAN HCL, using any other
components is unsupported
Broad Partner Ecosystem Support for Virtual SAN
19
StorageServer / Systems
SolutionData Protection
Solution
vSphere + Virtual SANvSphere + Virtual SAN
20
� Simple to set up via policy
� Delivered on per VM basis
� Zero data loss in case of disk, network or host failures
� Ensures zero downtime from disk or network failures
� Interoperable with vSphere HA and Maintenance Mode
Virtual SAN Is Highly Resilient Against Any Hardware FailureVirtual SAN is Designed to Ensure Data is Never Lost in Case of Failures
Scale UPAdd more
Disks
IOPSCapacity
40 TB
400 TB
4.4 PB
Scale OUT
Add more nodes
� ElasticGrow or shrink on demand
� GranularAdd single nodes or disks
� Non-disruptive No app downtime
Virtual SAN Enables Elastic Linear Scalingof Performance and CapacityNo More Complex Forecasting & Large Upfront Investments
“Virtual SAN enables us to scale our storage infrastructure and while providing the necessary redundancy. This allows us to be more agile and bring our solutions to market faster.”
Frans Van Rooyen, Cloud Architect, Adobe
21
Virtual SAN Delivers Enterprise-Grade Scale
22
2MIOPS
3,200
VMs
4.4Petabytes
Maximum Scalability per Virtual SAN Cluster
32Hosts
“Virtual SAN allows us to build out scalable heterogeneous storage infrastructure like the Facebooks and Googles of the world. Virtual SAN allows us to add scale, add resources, while being able to service high performance workloads.”
— Dave BurnsVP of Tech Ops, Cincinnati Bell
High Performance with Elastic and Linear Scalability
23
80K 160K320K
480K640K
253K
505K
1M
1.5M
2M
4 8 16 24 32
IOP
S
Number of Hosts In Virtual SAN Cluster
Mixed 100% Read
286
473
677
767805
3 5 7 8Number of Hosts In Virtual SAN Cluster
Number of VDI VMs
VSAN All SSD ArrayNotes: based on IOmeter benchmarkMixed = 70% Read, 4K 80% random Notes: Based on View Planner benchmark
Up to 2M IOPs in 32 Node Cluster Comparable VDI density to an All Flash Array
Virtual SAN Simplifies Storage
24
Two clicks to deploy!
If You Know vSphere, You Know Virtual SAN
Virtual SAN: Deeply Integrated with VMware Stack
25
Ideal for VMware Environments
vMotionvSphere
HA
DRSStorage vMotion
vSphere
SnapshotsLinked Clones
VDP AdvancedvSphere
Replication
Data Protection
VMware View
Virtual Desktop
vCenter Operations MgrvCloud Automation
Center
IaaS
Cloud Ops and Automation
Site Recovery Manager
Disaster Recovery
Site A
Site B
Storage Policy-Based Management
Virtual SAN Reduces CAPEX and OPEX for Better TCO
26
CAPEX• Server-side economics• No Fibre Channel network• Pay-as-you-grow
OPEX• Simplified storage
configuration• No LUNs• Managed directly through
vSphere Web Client• Automated VM provisioning• Simplified capacity planning
As Low as
$0.50/GB2
As Low as
$0.25/IOPS
5X Lower OPEX4
Up to 50% TCO
Reduction
As Low as
$50/Desktop 1
1. Full clones2. Usable capacity3. Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
4. Source: Taneja Group
• Compared to external storage at scale
• Estimated based on 2013 street pricing, Capex (includes storage hardware + Software License costs)
• Additional savings come from reduced Opex through automation
• Virtual SAN configuration: 9 VMs per core, with 40GB per VM, 2 copies for availability and 10% SSD for performance
Granular Scaling Eliminates Overprovisioning• Delivers Predictable Scaling and ability to Control Costs
27
VSAN enables predictable linear
scaling
VSAN enables predictable linear
scaling
Spikes correspond to
scaling out due to IOPs
requirements
Spikes correspond to
scaling out due to IOPs
requirements
$40
$90
$140
$190
$240
500 1000 1500 2000 2500 3000
Sto
rage
Cos
t Per
Des
ktop
Number of Desktops
$/VDI Storage CostVirtual SAN
Running a Google-like Datacenter• Modular infrastructure. Break-Replace Operations
28
"From a break fix perspective, I think there's a huge difference in what needs to be done when a piece of hardware fails. I can have anyone on my team go back and replace a 1U or 2U servers. … essentially modularizing my datacenter and delivering a true Software-Defined Storage architecture ."
— Ryan HoenleDirector of IT, DOE Fund
Virtual Desktop (VDI)
Tier 2 / Tier 3 / StagingTier 2 / Tier 3 / Staging DR Target
• Rapid storage provisioning and complete automation
• Ideal price/performance
• Enables Cloud Architect to easily provision storage
• Integrated with vSphere Replication and VMware SRM
• Reduces cost of storage
• Minimizes data center footprint
• Handle peak performance requirements (boot, login, read/write storms)
• Granularly scale from POC to production without huge upfront investments
• Support high VDI density
Virtual SAN Use Cases• Use Cases for Virtual SAN 5.5
29
Site A Site B
Additional Resources
30
Product Pagehttp://www.vmware.com/products/virtual-san/
VSAN Communityhttps://communities.vmware.com/community/vmtn/vsanVIP Toolvip.vmware.com/salessignup
Hands-On-Labhttp://vmware.com/go/vsanlab
Virtual SAN 60-day Free Evaluationhttp://www.vmware.com/go/try-vsan-en
Software-defined Storage Sales [email protected]
Thank YouMichael Armstrong @m80arm