Hyper-V over SMB: Remote File Storage Support in Windows Server 2012 Hyper-V Jose BarretoPrincipal Program ManagerMicrosoft Corporation

VIR306

agenda

• Hyper-V over SMB – Overview

• Hyper-V over SMB – Setup• Configuration Options• Sample Configurations

title

Hyper-V over SMB - Overview

Beyond Virtualization

Windows Server 2012 offers a dynamic, multi-tenant infrastructure that goes beyond virtualization to provide maximum flexibility for delivering and connecting to cloud services.

Modern Workstyle, Enabled

Windows Server 2012 empowers IT to provide users with flexible access to data and applications from virtually anywhere on any device with a rich user experience, while simplifying management and helping maintain security, control and compliance.

The Power of Many Servers, the Simplicity of One

Windows Server 2012 offers excellent economics by integrating a highly available and easy to manage multi-server platform with breakthrough efficiency and ubiquitous automation.

Every App, Any Cloud

Windows Server 212 is a broad, scalable and elastic server platform that gives you the flexibility to build and deploy applications and websites on-premises, in the cloud and in a hybrid environment, using a consistent set of tools and frameworks.

Windows Server 2012Cloud Optimize Your IT

Hyper-VHyper-VHyper-VHyper-VHyper-VHyper-V

Hyper-V over SMBFile Storage for Virtualization

What is it?Store Hyper-V files in shares over the SMB 3.0 protocol(include VM configuration, VHD files, snapshots)Works with both standalone and clustered servers (file storage used as cluster shared storage)

HighlightsIncreases flexibilityEases provisioning, management and migrationLeverages converged networkReduces CapEx and OpEx

Supporting FeaturesSMB Transparent Failover - Continuous availabilitySMB Scale-Out – Active/Active file server clustersSMB Direct (SMB over RDMA) - Low latency, low CPU useSMB Multichannel – Network throughput and failoverSMB Encryption - SecurityVSS for SMB File Shares - Backup and restoreSMB PowerShell - Manageability

File Serve

r

File Serve

r

SharedStorage

Hyper-V

SQLServe

r

IIS

VDIDeskt

opHyper-V

SQLServe

r

IIS

VDIDeskt

opHyper-V

SQLServe

r

IIS

VDIDeskt

op

Hyper-V Cluster

File Server Cluster

File Server Cluster

SMB Transparent Failover

Failover transparent to server applicationZero downtime – small IO delay during failover

Supports planned and unplanned failoversHW/SW MaintenanceHW/SW FailuresLoad Rebalancing

Resilient for both file and directory operations

Requires:Windows Failover ClustersBoth server running application and file server cluster must be Windows Server “8”Shares enabled for ‘continuous availability’

Hyper-V

Failover share - connections and handles lost,temporary stall of IO

2

2

Normal operation1

Connections and handles auto-recoveredApplication IO continues with no errors3

1 3

File Server Node A

File Server Node B

\\fs1\share \\fs1\share

SMB Scale-Out

Targeted for server app storageExample: Hyper-V and SQL ServerIncrease available bandwidth by adding cluster nodes

Key capabilities:Active/Active file sharesFault tolerance with zero downtimeFast failure recoveryCHKDSK with zero downtimeSupport for app consistent snapshotsSupport for RDMA enabled networksOptimization for server appsSimple management

Single File System Namespace

Cluster Shared Volumes

Single Logical File Server (\\FS\Share)

Hyper-V Cluster(Up to 64 nodes)

File Server Cluster

(Up to 8 nodes)

Data Center Network(Ethernet, InfiniBand or combination)

SMB Client SMB Server

SMB ServerSMB Client

User

Kernel

Application

DiskR-NIC

Network w/RDMA

support

NTFSSCSI

Network w/RDMA

support

R-NIC

SMB Direct (SMB over RDMA)

AdvantagesScalable, fast and efficient storage accessHigh throughput with low latencyMinimal CPU utilization for I/O processingLoad balancing, automatic failover and bandwidth aggregation via SMB Multichannel

ScenariosHigh performance remote file access for application servers like Hyper-V, SQL Server, IIS and HPCUsed by File Server and Clustered Shared Volumes (CSV) for storage communications within a cluster

Required hardwareRDMA-capable network interface (R-NIC)Three types: iWARP, RoCE and Infiniband

Multiple RDMA NICsMultiple 1GbE NICsSingle 10GbE RSS-capable NIC

SMB Server

SMB Client

SMB Multichannel

Full ThroughputBandwidth aggregation with multiple NICsMultiple CPUs cores engaged when NIC offers Receive Side Scaling (RSS)

Automatic FailoverSMB Multichannel implements end-to-end failure detectionLeverages NIC teaming (LBFO) if present, but does not require it

Automatic ConfigurationSMB detects and uses multiple paths

SMB Server

SMB Client

SMB Server

SMB Client

Sample Configurations

Multiple 10GbE in LBFO team

SMB Server

SMB ClientLBFO

LBFO

Switch10GbE

NIC10GbE

NIC10GbE

Switch10GbE

NIC10GbE

NIC10Gb

E

NIC10GbE

NIC10Gb

E

Switch1GbE

NIC1GbE

NIC1GbE

Switch1GbE

NIC1GbE

NIC1GbE

Vertical lines are logical channels, not cables

Switch10GbE/IB

NIC10GbE/

IB

NIC10GbE/

IB

Switch10GbE/IB

NIC10GbE/

IB

NIC10GbE/

IB

Switch10GbE

SMB Encryption

End-to-end encryption of SMB data in flightProtects data from eavesdropping/snooping attacks on untrusted networks

Zero new deployment costsNo need for IPSec, specialized hardware, or WAN accelerators

Configured per share or for the entire server

Can be turned on for a variety of scenarios where data traverses untrusted networks

Application workload over unsecured networksBranch Offices over WAN networks

ServerClient

SMB Encryption

VSS for SMB File Shares

Application consistent shadow copies for server application data stored on Windows Server “8” file shares

Backup and restore scenarios

Full integration with VSS infrastructure

Volume Shadow Copy Service

\\fs\fooData volume

\\fs\foo@t1Shadow

Copy

Backup Server

Application Server File Server

File Share Shadow Copy Agent

Coordinate Shadow Copy

Create Shadow Copy

Create Shadow Copy

Request Shadow Copy

VSS Providers

BackupA

B

C

D

E

Read fromShadow CopyShare

G

Relay Shadow Copy

request

Backup Agent

Volume Shadow Copy Service

File Share Shadow Copy Provider

F

title

Hyper-V over SMB – Setup

Permissions for Hyper-V over SMB

Full permissions on NTFS folder and SMB share forHyper-V AdministratorComputer Account of Hyper-V hostsIf Hyper-V is clustered, the Hyper-V Cluster Account (CNO)

1. Create FolderMD F:\VMS

2. Create ShareNew-SmbShare -Name VMS -Path F:\VMS -FullAccess Dom\HAdmin, Dom\HV1$, Dom\HV2$, Dom\HVC$

3. Apply Share permissions to NTFS Folder permissions

(Get-SmbShare –Name VMS).PresetPathAcl | Set-Acl

How to use it: simply type a UNC path

New-VHD -Path \\FS1\VMS\VM1.VHDX -Dynamic -SizeBytes 100GBNew-VM -Name VM1 -Path \\FS1\VMS -VHDPath \\FS1\VMS\VM1.VHDX -Memory 4GB

Important notes on Hyper-V over SMB

Hyper-V supports SMB version 3.0 onlyThe Hyper-V Best Practices Analyzer (BPA) will check the version of SMBThird-party SMB 3.0 implementations coming from storage partners like EMC and NetApp

Continuously Available shares are recommended

Active Directory is requiredComputer accounts, which are required for configuring proper permissions, only exist in a domain

Loopback configurations are not supported

File Server and Hyper-V must be separate serversIf using Failover Clusters, File Server and Hyper-V must be on separate clusters

System Center Virtual Machine Manager 2012 SP1 will bring support for Hyper-V over SMB

CTP is available for download

Remote ManagementUse PowerShellUse Server Manager (for file shares)Use Remote Desktop (RDP) Use VMM 2012 SP1 If using Hyper-V Manager remotely, Constrained Delegation is required

demo

Jose BarretoPrincipal Program ManagerWindows Server

Hyper-V over SMB Setup

The TechEd Cluster in a Box Demo StackCluster in a Box prototypes

QuantaWistron

LSI HA-DAS MegaRAID® and SAS controllersQuanta application servers, JBOD expansion, and 10GbE switchMellanox IB FDR NICs and switch OCZ SAS SSDsInfrastructure

Domain Controller serverPower distribution unit1GbE switchKeyboard & monitor

MegaRAID® is a registered trademark of LSI Corporation

title

Configuration Options

Hyper-V Server

Parent PartitionChild Partition

Hyper-V over SMB

File Server

SMB Server

Network(RDMA option)

SMB ClientVHD Stack

StorageVSP

StorageVSC

NTFSSCSI/IDE

Application

VM Bus

NIC NIC

Network(RDMA option)

NTFSSCSI

User

Kernel

Disk

Hyper-V over SMB - File Server Configurations

Single-node File Server Lowest cost for shared storage Shares not continuously available

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

File Server

Share1 Share2

Disk Disk

A

Hyper-V over SMB - File Server Configurations

Single-node File Server Lowest cost for shared storage Shares not continuously available

Dual-node File Server Low cost for continuously

available shared storage Limited scalability

(up to a few hundred disks)

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

File Server

Share1 Share2

Disk Disk

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

File Server 1

Share1 Share2

File Server 2

Share1 Share2

Shared SAS Storage

Disk DiskDisk Disk

A B Active ON

Hyper-V over SMB - File Server Configurations

Single-node File Server Lowest cost for shared storage Shares not continuously available

Dual-node File Server Low cost for continuously

available shared storage Limited scalability

(up to a few hundred disks)

Multi-node File Server Highest scalability

(up to thousands of disks) Higher cost, but still lower than

connecting all Hyper-V hosts with FC

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

File Server

Share1 Share2

Disk Disk

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

File Server 1

Share1 Share2

File Server 2

Share1 Share2

Shared SAS Storage

Disk DiskDisk Disk

Hyper-V Parent 1

Child 1Config

VHD Disk

Hyper-V Parent N

Child NConfig

VHD Disk

FS 1

Share1

Fibre Channel Storage Array

Disk Disk Disk DiskDisk Disk Disk

FS 2

Share2

FS 3

Share3

FS 4

Share4

A B CActive ON Active ON

Hyper-V over SMB - Network Configurations

1GbE Networks

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

1GbE 1GbE

1GbE 1GbE

Clients

A

Hyper-V over SMB - Network Configurations

1GbE Networks

Mixed 1GbE/10GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

1GbE 1GbE

1GbE 1GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

10GbE / IB 10GbE / IB

1GbE 1GbE

Clients Clients

BA

Hyper-V over SMB - Network Configurations

1GbE Networks

Mixed 1GbE/10GbE 10GbE or InfiniBand

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

1GbE 1GbE

1GbE 1GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

10GbE / IB 10GbE / IB

1GbE 1GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

10GbE / IB 10GbE / IB

10GbE / IB 10GbE / IB

Clients Clients Clients

B CA

Hyper-V over SMB - Network Configurations

1GbE Networks

Mixed 1GbE/10GbE 10GbE or InfiniBand Networks

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

1GbE 1GbE

1GbE 1GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

10GbE / IB 10GbE / IB

1GbE 1GbE

Hyper-V 1

File Server

1

Hyper-V 2

File Server

2

10GbE / IB 10GbE / IB

10GbE / IB 10GbE / IB

Clients Clients Clients

File Server

1

File Server

2

10GbE / IB 10GbE / IB

Clients

B CA D

Hyper-V 1 Hyper-V 2

title

Sample Configurations

All Standalone

Hyper-VStandalone, shares used for VHD storage

File ServerStandalone, Local Storage

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations cost

Configuration lowlightsStorage not fault tolerantFile server not continuously availableHyper-V VMs not highly availableHardware setup and OS install by IT Pro

Hyper-V Host Hyper-V Host

File Server

Share

VHD

Share

VHDX

All Standalone + Storage Spaces

Hyper-VStandalone, shares used for VHD storage

File ServerStandalone, Storage Spaces

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations costStorage is Fault Tolerant

Configuration lowlightsFile server not continuously availableHyper-V VMs not highly availableHardware setup and OS install by IT Pro

Hyper-V Host Hyper-V Host

File Server

Storage Spaces

Space Space

Share

VHD

Share

VHDX

Standalone File Server, Clustered Hyper-V

Hyper-VClustered, shares used for VHD storage

File ServerStandalone, Storage Spaces

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations costStorage is Fault TolerantHyper-V VMs are highly available

Configuration lowlightsFile server not continuously availableHardware setup and OS install by IT Pro

Hyper-V Host Hyper-V Host

File Server

Storage Spaces

Space Space

Share

VHD

Share

VHDX

Failover

Clu

ste

r

Clustered File Server, Standalone Hyper-V

Hyper-VStandalone, shares used for VHD storage

File ServerClustered, Storage Spaces

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations costStorage is Fault TolerantFile Server is Continuously Available

Configuration lowlightsHyper-V VMs not highly availableHardware setup and OS install by IT Pro

Hyper-V Host Hyper-V Host

File Server

Share

VHD

Share

VHDX

File Server

Shared JBOD SAS

Clustered Storage Spaces

Space Space

Failover

Clu

ste

r

Act

ive O

N

Failover

Clu

ste

rAll Clustered

Hyper-VClustered, shares used for VHD storage

File ServerClustered, Storage Spaces

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations costStorage is Fault TolerantHyper-V VMs are highly availableFile Server is Continuously Available

Configuration lowlightsHardware setup and OS install by IT Pro

Hyper-V Host Hyper-V Host

File Server

Share

VHD

Share

VHDX

File Server

Shared JBOD SAS

Clustered Storage Spaces

Space Space

Failover

Clu

ste

r

Act

ive O

N

Failover

Clu

ste

rCluster-in-a-box

Hyper-VClustered, shares used for VHD storage

File ServerCluster-in-a-box

Configuration highlightsFlexibility (Migration, shared storage)Simplicity (File Shares, permissions)Low acquisition and operations costStorage is Fault TolerantFile Server is continuously AvailableHardware and OS pre-configured by the OEM

Hyper-V Host Hyper-V Host

File Server

Share

VHD

Share

VHDX

File Server

Shared JBOD SAS

Clustered Storage Spaces

Space Space

Clu

ste

r-in

-a-b

ox

Act

ive O

N

title

Summary

Shared JBOD SAS

File Server Cluster for Hyper-V

Networking2+ Interfaces

Server2+ servers

StorageReliable Shared

Storage

Storage Spaces

Clustered RAID

External Storage Arrays

2+ discrete servers2+ node “Cluster-in-a-Box”

1 GbE 10 GbE40 GbE

InfiniBandRDMA+ Optional

RDMA

FC / iSCSI / SAS

fabric

Related Content

Breakout SessionsWSV303 Windows Server 2012 High-Performance, Highly-Available Storage Using SMBWSV310 Windows Server 2012: Cluster-in-a-Box, RDMA, and MoreWSV314 Windows Server 2012 NIC Teaming and Multichannel SolutionsWSV322 Update Management in Windows Server 2012: Revealing Cluster-Aware UpdatingWSV330 How to increase SQL availability and performance using Window Server 2012 SMBWSV334 Windows Server 2012 File and Storage Services Management WSV410 Continuously Available File Server – Under the Hood

Find Me Later At http://blogs.technet.com/josebda or http://smb3.info

Product Demo Stations (Technical Learning Center, Windows Server)

Resources

Connect. Share. Discuss.

http://northamerica.msteched.com

Learning

Microsoft Certification & Training Resources

www.microsoft.com/learning

TechNet

Resources for IT Professionals

http://microsoft.com/technet

Resources for Developers

http://microsoft.com/msdn

SIA, WSV, and VIR Track Resources

Talk to our Experts at the TLC

#TE(sessioncode)

DOWNLOAD Windows Server 2012 Release Candidate

microsoft.com/windowsserverHands-On Labs

DOWNLOAD Windows Azure

Windowsazure.com/teched

Complete an evaluation on CommNet and enter to win!

MS Tag

Scan the Tagto evaluate thissession now onmyTechEd Mobile

© 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to

be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS

PRESENTATION.