jbods (just a bunch of disks) see under the “storage spaces” category
TRANSCRIPT
Det moderne datacenter
Craig Forster
Build the cheapest, fastest, easiest to manage, most scalable, full-featured SAN in the world using Windows Server 2012 R2
Senior Premier Field EngineerMicrosoft Danmark
Why are there so many Windowspeople at a session about SANs?
a lot has changed . . .
AzureIaaS – storage must get cheaper“cattle, not pets”Fibre Channel is too slow now64-node clusters with 8,000 VMs
JBODs(just a bunch of disks)
See www.windowsservercatalog.com under the “Storage Spaces” Category
http://www.raidinc.com/ http://www.dataonstorage.com/http://www.fujitsu.com/fts/
http://www.quantaqct.com/
http://www.supermicro.com/
File Client(SMB 3.0)
SQLIO
RDMA NIC
RDMA NIC
RDMA NIC
File Server(SMB 3.0)
RDMA NIC
RDMA NIC
RDMA NIC
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
Storage Spaces
SA
S
JBODSSDSSDSSDSSDSSDSSDSSDSSD
SASHBA
SASHBA
SASHBA
SASHBA
SASHBA
SASHBA
8KB random readsfrom a mirrored space
(disk)~600,000 IOPS
8KB random readsfrom cache (RAM)~1,000,000 IOPS
32KB random readsfrom a mirrored space
(disk)~500,000 IOPS
~16.5 GBytes/sec
MICROSOFT CONFIDENTIAL – INTERNAL ONLY
Speeds and Feeds
NIC Throughput
1Gb Ethernet ~0.1 GB/sec
10Gb Ethernet ~1.1 GB/sec
40Gb Ethernet ~4.5 GB/sec
32Gb InfiniBand (QDR)
~3.8 GB/sec
54Gb InfiniBand (FDR) ~6.5 GB/sec
HBA Throughput
3Gb SAS x4 ~1.1 GB/sec
6Gb SAS x4 ~2.2 GB/sec
4Gb FC ~0.4 GB/sec
8Gb FC ~0.8 GB/sec
16Gb FC ~1.5 GB/sec
Bus Slot Throughput
PCIe Gen2 x4 ~1.7 GB/sec
PCIe Gen2 x8 ~3.4 GB/sec
PCIe Gen2 x16 ~6.8 GB/sec
PCIe Gen3 x4 ~3.3 GB/sec
PCIe Gen3 x8 ~6.7 GB/sec
PCIe Gen3 x16 ~13.5 GB/sec
Memory Throughput
DDR2-400 (PC2-3200) ~3.4 GB/sec
DDR2-667 (PC2-5300) ~5.7 GB/sec
DDR2-1066 (PC2-8500)
~9.1 GB/sec
DDR3-800 (PC3-6400) ~6.8 GB/sec
DDR3-1333 (PC3-10600)
~11.4 GB/sec
DDR3-1600 (PC3-12800)
~13.7 GB/sec
DDR3-2133 (PC3-17000)
~18.3 GB/sec
Only a few common configurations listed. Numbers are rough approximations.Actual throughput in real life will be lower than these theoretical maximums.
Numbers provided are for one way traffic only (double for full duplex). One interface/port only.Numbers use base 10 (1 GB/sec = 1,000,000,000 bytes per second)
DEMO>1 million IOps in a VM
DEMOTiered Storage
DEMOWrite-Back Caching
Data Rebuilt 2,400 GB
Time Taken 49 min
Rebuild Throughput
> 800 MB/s
3TB HDDs, 2-way,4-column Mirror Space
Source: Internal Testing,No Foreground Activity
Storage Space
VHDX
• VHDX can align to 512, 512e and 4096 byte disks
• Dynamic/Differencing VHDXs grow 10x faster than VHD
• 40% faster 64k writes to a fully expanded VHDX
• VHDX online resize:
Resize-VHD -path C:\temp\test.vhdx -ToMinimumSize
A bunch of other stuff
• Shared VHDX (vSAS) for Fixed and Dynamic disks• Storage QoS per VHD• Soft minimums, hard maximums
• CSV re-balancing• RDMA flooding• 8KB IOps increased from:
300,000 IOps per interface to 450,000
Cloud-as-a-Tierr
Very Bad Bad Neutral Good Very Good
1 2 3 4 5
DA302
SessionCode
1-5Craig's
Performance
1-5Relevan
ce
1-5Match
of Technical Level
OptionalCommen
t
Text to 1919
Appendix
Checking the media type for physical disks# Find all eligible disks$disks = Get-PhysicalDisk |? {$_.CanPool -eq $true}
# Looking at the MediaType for the PhysicalDisks$disks | Select FriendlyName, Manufacturer, Model, MediaType
# Changing the MediaType to SSDSet-PhysicalDisk -FriendlyName PhysicalDisk1 -MediaType SSD
# Changing the MediaType to HDDSet-PhysicalDisk -FriendlyName PhysicalDisk1 -MediaType HDD
Creating the storage pool# Create a new Storage Pool New-StoragePool -StorageSubSystemFriendlyName *Spaces* -FriendlyName TieredPool -PhysicalDisks $disks
Define the pool storage tiers# Define the Pool Storage Tiers$ssd_tier = New-StorageTier -StoragePoolFriendlyName TieredPool -FriendlyName SSD_Tier -MediaType SSD
$hdd_tier = New-StorageTier -StoragePoolFriendlyName TieredPool -FriendlyName HDD_Tier -MediaType HDD
Creating a tiered storage space# Creation of a Tiered Storage Space with a Write-Back Cache$vd1 = New-VirtualDisk -StoragePoolFriendlyName TieredPool -FriendlyName TieredSpace –StorageTiers @($ssd_tier, $hdd_tier) -StorageTierSizes @(500GB,10TB) -ResiliencySettingName Mirror -WriteCacheSize 5GB
Assigning a file to a storage tier# Assign a File to SSD TierSet-FileStorageTier -FilePath E:\MarketingPoolVMParent.vhdx –DesiredStorageTier ($vd1 | Get-StorageTier -MediaType SSD)
# Assign a File to HDD TierSet-FileStorageTier -FilePath E:\Archive1.vhdx –DesiredStorageTier ($vd1 | Get-StorageTier -MediaType HDD)
Getting the list of files assigned to tiers# Get the list of assigned files, the tier, and the status for the Volume “E"Get-FileStorageTier -VolumeDriveLetter E
# Get the tier and status of a specific fileGet-FileStorageTier -FilePath E:\MarketingPoolVMParent.vhdx