software defined storage
DESCRIPTION
Software Defined StorageTRANSCRIPT
-
PRESENTATION TITLE GOES HERE
Software Defined Storage @ Microsoft
Siddhartha Roy Cloud + Enterprise Division
Microsoft Corporation
-
Lessons Learned operating large cloud properties
-
Industry trends
3
Virtualization Mobility and flexibility within and
across sites/clouds More density
Cloud scale services influencing design Standard, volume hardware to build
high-scale systems at low cost Cloud design points in software
Data explosion Device proliferation Modern apps Unstructured data analytics
Scale Out with minimal operational complexity
What is Software Defined Storage (SDS) ? Cloud scale storage and cost economics
on standard, volume hardware
-
Microsoft Software Defined Storage (SDS) Breadth offering and unique opportunity
Customer choice
SAN and NAS storage
Private Cloud with partner storage
Windows SMB3 Scale Out File Server (SoFS) + Storage Spaces
Private Cloud with Microsoft SDS
StorSimple + Microsoft Azure Storage
Hybrid Cloud Storage
Microsoft Azure storage
Public Cloud Storage
-
Private Enterprise and Hosted Clouds with SAN and NAS storage
SAN and NAS storage
Private Cloud with partner storage
Windows SMB3 SoFS + Storage Spaces
Private Cloud with Microsoft SDS
StorSimple + Microsoft Azure
Hybrid Cloud Storage
Microsoft Azure storage
Public Cloud Storage
-
Optimizing Windows for SAN/NAS storage
Technical work: SMI-S, NVM Programming, XAM
SMB 2/3 Plugfest
INCITS: T10,T11,T13 (SCSI,FC,AT) IETF: Co chairs for NFS 4.1, STORM
(iSCSI)
-
Private Enterprise and Hosted Clouds with Microsoft Storage Defined Storage
SAN and NAS storage
Private Cloud with partner storage
Windows SMB3 SoFS + Storage Spaces
Private Cloud with Microsoft SDS
StorSimple + Microsoft Azure
Hybrid Cloud Storage
Microsoft Azure storage
Public Cloud Storage
-
Public Cloud lessons applied
-
Software Defined Storage in Windows Server 2012 R2
Primary application data storage on cost affective, continuously available, high performance
SMB3 file Shares backed by Storage Spaces
1. Performance, Scale: SMB3 File Storage network
2. Continuous Availability and Seamless Scale Out with File Server Nodes
3. Elastic, Reliable, Optimized Storage Spaces
4. Standard volume hardware for low cost
Storage Spaces
Hyper-V Clusters
SMB3 Storage Network Fabric
Shared JBOD Storage
1
4
2 2
3
Scale-Out File Server Clusters
-
SMB3 File Storage network High speed, low latency with SMB Direct SMB Multichannel for storage path failure resiliency Scale Out File Server Nodes Easy share management Active/Active Scale Out pay as you grow Continuously Available
Physical storage
SoFS + Storage Spaces under the hood
Virtualized storage
Scale Out File Server cluster nodes
Hyper-V cluster nodes
SMB3 Storage Network
SSD
HDD
Tiered Storage spaces
Optimized Placement
-
Hyper-V Cluster
SMB Buffer
Scale Out File server (SoFS) Cluster
SoFS - Low latency, high scale with SMBDirect
App Buffer
SMB Buffer
Adapter Buffer
Adapter Buffer
SMBDirect Microsoft implementation of RDMA on Ethernet, InfiniBand over SMB3 protocol
High throughput with low latency
Optimized to expose full potential of 10/40Gbps Ethernet and 56Gbps InfiniBand
Usage beyond storage for Server Server Fast Live migration
32KB random reads
from a mirrored space (disk)
~500,000 IOPS ~16.5 GBytes/sec
-
Software Defined Storage stack overview System Center Windows Server
SMI-S Storage Service
Block storage provisioning
File storage provisioning
Hyper-V Storage
Management
Storage Pool Classification
Thin Provision
Alert Monitor
SAN based Rapid
Provisioning
SM API Integration
Storage Utilization Trending
PowerShell Support
SAS Array Support
Thin LUN provisioning
Cluster-Aware Updating with no
downtime
Guest Clusters on
SMB
8,000 VMs per Hyper-V Cluster
VM Prioritization
Scale with 64-node clusters
VM Storage Migration
Dynamic Access control
SMB3 in flight data encryption
Hyper-V Replica DPM
Windows Azure
Backup
SMB3 Direct for low latency
SMB3 SoFS for Hyper-V, SQL Server
SMB3 Multichannel for FT, Perf
SMB3 for Windows
clients
Dedup
SMB3 Transparent
Failover
iSCSI Target block
storage
ReFS local file system
for resiliency
NFS 3, 4.1 for *nix clients,
VMware
CSV Scale Out
Tiered Storage Spaces
Fast NTFS chkdsk
-
Private Cloud Choice - SAN or Microsoft SDS
Hyper-V compute nodes
Hyper-V compute nodes
Block protocol fabric Low latency network Management of LUNs Storage tiering Data deduplication RAID resiliency groups Pooling of disks High availability Persistent write-back cache. Copy offload Snapshots
Traditional FC/iSCSI SAN storage arrays
Microsoft SDS Storage (in Windows Server)
File protocol fabric Low latency with SMB3Direct Management of Shares Storage tiering (new with R2) Data deduplication Flexible resiliency options Pooling of disks. Continuous availability Persistent write-back cache.
(new with R2) SMB copy offload Snapshots
FC/SAS disk shelf
FC/SAS disk shelf
SAN/NAS
Shared SAS JBOD
Shared SAS JBOD
Scale Out File Server + Storage Spaces
-
Customer Quote: NTTX
By using Storage Spaces, Hyper-V over SMB, and other new features, I eliminate big, lumpy capital expenditures. I can buy inexpensive storageand scale. - Philip Moss, Chief Technology Officer, NTTX Select
NTTX designed a new datacenter around Windows Server 2012 in order to get new services to market faster and at a lower cost.
Benefits: Achieved greater flexibility for meeting customer needs. Got new offerings to market faster. Increased annual revenue opportunities to U.S.$18.6 million. Saved $5.8 million a year.
Hosting provider uses industry-standard storage (Microsoft SoFS + Storage Spaces) to slash storage costs by 30 %
-
http://www.raidinc.com/ http://www.dataonstorage.com/ http://www.fujitsu.com/fts/
http://www.quantaqct.com/ http://www.supermicro.com/ http://www.dell.com/
-
Participants in the 2013 edition of the SNIA SMB2 / SMB3 Plugfest
Santa Clara, CA September 2013
Ecosystem of SMB server/client implementations
SMB PlugFest Occurs every year side-by-side with the
Storage Developer Conference (SNIA SDC) in September
Interaction across operating systems and SMB implementations
-
Hybrid Cloud Storage StorSimple + Azure
SAN and NAS storage
Private Cloud with partner storage
Windows SMB3 SoFS + Storage Spaces
Private Cloud with Microsoft SDS
StorSimple + Microsoft Azure
Hybrid Cloud Storage
Microsoft Azure storage
Public Cloud Storage
-
MICROSOFT NDA ONLY
StorSimple Applications & Workloads Ca
pacit
y
Time
Data grows exponentially (5060% Annually)
Most I/O happens to working set data
CapEx, OpEx of traditional
storage
Cloud Storage
Local Storage
Target Use Cases File Share
SMB NFS
File servers NAS
SharePoint
Business intelligence Collaboration Content & records management
Archives EMR/PACS Legal Construction
Media Engineering Logs, records
VMs Regional office storage
VM sprawl VM archives
-
StorSimple connects Windows, Hyper-V and VMware servers to Azure Storage in minutes with no application modification
Consolidates primary, archive, backup, DR thru seamless integration with Azure
Cloud Snapshots = revolutionary speed, simplicity and reliability for backup and recovery
Reduces enterprise storage TCO by 6080%
Application Servers
Inactive Primary Data + Backup + Archive + DR
Speed of SSD/SAS + Elasticity of Cloud
Warm data on SAS Local Tier
Most Active Data on SSD
StorSimple Appliance
Azure Storage
-
Public Cloud Storage Azure
SAN and NAS storage
Private Cloud with partner storage
Windows SMB3 SoFS + Storage Spaces
Private Cloud with Microsoft SDS
StorSimple + Microsoft Azure
Hybrid Cloud Storage
Microsoft Azure storage
Public Cloud Storage
-
Store, backup, recover your data Highly scalable: 20 trillion objects stored Highly durable: Multiple copies of your data Multiple object support: blobs, tables, drives Easy access: Supports REST APIs Available anywhere: multiple regions
-
Get your data wherever and whenever you need it Microsoft Azure Storage Defend against regional
disasters.
Geo replication
-
Continue the journey
-
Microsoft Cloud Server Contribution to Open Compute Contributions to Open Compute Project CAD models, Specs, Gerber files, Source code Benefits to traditional servers - 40% cost savings, 15% power efficiency gains
-
Where can I find more information ?
Microsoft Storage http://Microsoft.com/storage
Solution guide Cost effective storage for Hyper-V http://technet.microsoft.com/en-us/library/dn554251.aspx Drop by our expo booth
Slide Number 1Lessons Learned operating large cloud properties Industry trends Customer choice Private Enterprise and Hosted Clouds with SAN and NAS storageOptimizing Windows for SAN/NAS storage Private Enterprise and Hosted Clouds with Microsoft Storage Defined Storage Public Cloud lessons applied Software Defined Storage in Windows Server 2012 R2SoFS + Storage Spaces under the hood SoFS - Low latency, high scale with SMBDirectSoftware Defined Storage stack overview Private Cloud Choice - SAN or Microsoft SDSCustomer Quote: NTTXStorage Spaces solution partnersSlide Number 16Hybrid Cloud Storage StorSimple + AzureStorSimple Applications & WorkloadsStorSimple Solution OverviewPublic Cloud Storage AzureSlide Number 21Slide Number 22Where are we going? Continue the journey Microsoft Cloud Server Contribution to Open ComputeWhere can I find more information ?