“psam”, nec pcie ssd appliance for microsoft sql …access latency) (storage capacity) huge...
TRANSCRIPT
“PSAM”, NEC PCIe SSD Appliance
for Microsoft® SQL Server®
(Reference Architecture)
July 2014
NEC Corporation
Page 3 © NEC Corporation 2014
1TB
10TB
100TB
1PB
<ns <1us <150us ~2ms ~8ms ~20ms
SATA
Disk
Array SAS
Disk
Array SAS
SSD PCIe
SSD
CPU Cache
(Access latency)
(Storage
Capacity)
Huge Performance gap
SW visibility gap
DRAM
Background of the solution (1/2)
Issue#1: Performance gap between memory and storage
▌Customers are faced with performance bottleneck from performance
gap between in-box memory / storage and external disks.
Performance tuning is getting more complicated, needs many external storages
and host bus adapters to provide enough IO bandwidth for high-performance
DWH/BI system.
Page 4 © NEC Corporation 2014
Issue#2: CPU, Memory and IO Balanced Scalability
▌Customer’s expectation: Avoid excessive initial investment,
System performance should scale up seamlessly by adding HW resources
without modifying system (DB) configuration.
▌Customer’s pain : Intel QPI* architecture
The latest QPI architecture-based processors have an
integrated memory controller and IO controller on die.
The architecture requires extra CPU sockets,
even if customer just wants to have much
IO slots (or memory). The extra CPU sockets
contribute to increased power consumption
and system cost
Background of solution (2/2)
“Rich IO slots” of NEC Express5800 Scalable Enterprise Server and
“PCIe SSD (server-mounted flash storage)” will solve those issues
“NEC PCIe SSD Appliance for Microsoft® SQL Server®” is the answer
PC
Ie s
lot
DIMM DIMM DIMM DIMM
DIMM DIMM DIMM DIMM
DIMM DIMM DIMM DIMM
DIMM DIMM DIMM DIMM
PC
Ie s
lot
PC
Ie s
lot
Mem
ory
Contr
oller
Mem
ory
Contr
oller
IO Controller
CPU QPI
QPI
QPI
QPI based CPU
* QPI = Quick Path Interconnect
(Interconnect between CPUs)
Page 5 © NEC Corporation 2014
NEC Solution Platforms
の露出用
記載文言は検討中
High-performance and high availability appliance system (reference
architecture) with no external storage. NEC Express5800 Scalable Enterprise Server-based “all in a box” solution
combined with high-performance HGST FlashMAX II PCIe server-mounted
flash storage.
Best practice configuration fully utilizing NEC’s knowledge for SQL Server. Support the latest Microsoft SQL Server “SQL Server 2014”.
Balanced CPU-IO performance depending on number of Flash MAX II
(i.e., depending on data size ).
No data lost by utilizing mirrored storage pool feature of Windows OS.
Proven performance reference architecture for TCO optimization
High band width
Low Latency
InfiniBand
Single Node model AlwaysOn AG two node cluster model
PCIe SSD PCIe SSD PCIe SSD
NEC PCIe SSD Appliance for Microsoft® SQL Server® Overview
Page 6 © NEC Corporation 2014
2. Reference configuration of
NEC PCIe SSD Appliance for
Microsoft® SQL Server®
Page 7 © NEC Corporation 2014
Optimized performance combining fast clock CPU (E7-8893 v2:6C, 3.4GHz) and
high-performance HGST FlashMAX II PCIe server-mounted flash storage (FM2)..
No data lost by utilizing software-mirrored storage pool feature of Windows
Operating System
Balanced CPU-IO performance depending on number of FM2 (i.e., data size ).
Reference configuration per Node
• 1CPU (3.4GHz, 6C)
• 128GB RAM
• 2x FM2 in mirrored storage pool
• 2CPU (3.4GHz, 6C)
• 256GB RAM
• 4x FM2 in mirrored storage pool
• 3CPU (3.4GHz, 6C)
• 384GB RAM
• 6x FM2 in mirrored storage pool
• 4CPU (3.4GHz, 6C)
• 512GB RAM
• 8x FM2 in mirrored storage pool
Page 8 © NEC Corporation 2014
QPI
Express5800 Scalable Enterprise Server
128GB
RAM
FlashMAX II 1.1TB
FlashMAX II 1.1TB
Internal Drive
SW Mirror
128GB
RAM
128GB
RAM
128GB
RAM
FlashMAX II 1.1TB
FlashMAX II 1.1TB
PCIeGen2 x8
FlashMAX II 1.1TB
FlashMAX II 1.1TB
SW Mirror
SW Mirror FlashMAX II 1.1TB
FlashMAX II 1.1TB
E7-8893
v2
E7-8893
v2
E7-8893
v2
E7-8893
v2 SW Mirror
Intel® Xeon® Processor
E7-8893 v2 (6core 3.4GHz)
Block Diagram
Page 9 © NEC Corporation 2014
Reference Configuration for Single Node Data Warehouse system
CPU and Memory 1CPU 128GB RAM
2CPU 256GB RAM
3CPU 384GB RAM
4CPU 512GB RAM
Express5800 Scalable Enterprise Server 1 1 1 1 Built-in DVD-ROM Drive 1 1 1 1 Additional CPU (E7-8893 v2, 6 core) 1 2 3 4 Memory Riser 2 4 6 8 16GB additional memory (8GB DIMM x2) 8 16 24 32 10KRPM 600GB HDD 3 5 5 7 RAID SAs-Controller (1GB, RAID 0/1/5/6) 1 1 1 1 1000BASE-T Network Adopter (4 port) 1 2 3 4
1.1TB FlashMAX II
# of card 2 4 6 8
Maximum Physical Storage Capacity per node *
•Max capacity mode •Mirrored Storage Pool
1.1TB 2.2TB 3.3TB 4.4TB
Reference configuration as single node Data Warehouse system
* Data capacity after compression. About 1/3.5 of logical user data capacity before compression
Page 10 © NEC Corporation 2014
Reference Configuration for Single Node OLTP system
CPU and Memory 1CPU 128GB RAM
2CPU 256GB RAM
3CPU 384GB RAM
4CPU 512GB RAM
Express5800/A1040b 1 1 1 1
Built-in DVD-ROM drive 1 1 1 1
Additional CPU (E7-8893 v2, 6 core) 1 2 3 4 Memory Riser 2 4 6 8 16GB additional memory (8GB DIMMx2) 8 16 24 32 10krpm 600GB SAS-HDD 3 5 5 7 RAID SAS-Controller (1GB, RAID 0/1/5/6) 1 1 1 1 1000BASE-T Network Adopter (4 port) 1 2 3 4
1.1TB FlashMAXII
# of card 2 4 6 8 Maximum Physical Storage Capacity per node
• Max Performance mode •Mirrored Storage Pool
0.9TB 1.7TB 2.6TB 3.4TB
Reference configuration as single node OLTP system
Page 11 © NEC Corporation 2014
3. Performance of
NEC PCIe SSD Appliance for
Microsoft® SQL Server®
as Dara Warehouse system
Page 12 © NEC Corporation 2014
Configuration for
DWH performance comparison
NEC PCIe SSD Appliance
for Microsoft® SQL Server®
Express5800/A1080a-S
FTRA DWH
CPU E7-8893 v2 (6C, 3.4GHz) E7-8870 (10C, 2.4GHz)
CPU socket count 1 2 3 4 2
Total core count 6 12 18 24 20
Physical memory capacity 128GB 256GB 384GB 512GB 128GB
Storage configuration
1.1TB FlashMAX II (Max Capacity Mode)
Mirrored storage pool configuration iStorage M100 x3
(72 450GB 10krpm SAS-HDD)
RAID-10 18 pair 1set 2 sets 3sets 4 sets
Physical Storage Capacity 1.1TB 2.2TB 3.3TB 4.4TB 16.2TB
Physical
Capacity
per
Usage
User data* * Data capacity after compression
About 1/3.5 of logical user data
capacity before compression.
~0.5TB ~1.0TB ~1.5TB ~2.0TB 8.0TB
Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 3.5TB
tempdb ~0.3TB 0.6TB ~0.9TB ~1.2TB 4.5TB
DWH performance comparison with Express5800/A1080a based FTRA DWH
using Microsoft Fast-track Data Warehouse Benchmark tool. (FTRA DWH =Microsoft SQL Server Fast Track Data Warehouse)
Single Node DWH Performance (1/2)
Page 13 © NEC Corporation 2014
1,425
3,422
4,820
8,234
4,759
0.36 0.30 0.32 0.25 1.72 0.00
0.50
1.00
1.50
2.00
2.50
3.00
3.50
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,000
1P6C 2P12C 3P18C 4P24C 2P20C
Benchmark Logical Scan rate [MB/s]
Lead time to scan all user data [s]
NEC PCIe SSD Appliance for Microsoft® SQL Server® (E7-8893v2 3.4GHz)
Fast-track Data Warehouse NEC Express5800 A1080a-S
(E7-8870 2.4GHz)
Performance comparison using Microsoft Fast-track Data Warehouse benchmark tool
Single Node DWH Performance (2/2)
Page 14 © NEC Corporation 2014
Express5800 A1080a-S base
Microsoft Fast-track Data Warehouse
NEC PCIe SSD Appliance for Microsoft® SQL Server ®
4P24C (3.4GHz) + 512GB RAM
Total 72 SAS-HDD drives
8G-FC channels x12
(2p 8G-FC HBA x6)
Performance boost with significant TCO saving
All-n-a-box
Solution To Balance CPU power
and IO bandwidth,
12 FC channels and
72 HDDs are required
69% less rack space 13U 4U
173% better performance
Rack space
27% less power consumption 2,125W 1,551W Power Consumption
Benchmark logical
scan rate • Microsoft Fast-track Data ware
house benchmark tool
4,759MB/s 8,234MB/s
Benefit as Data Warehouse system
2P20C (2.4GHz) + 128GB RAM
Page 15 © NEC Corporation 2014
4. Performance of
NEC PCIe SSD Appliance for
Microsoft® SQL Server®
as OLTP system
Page 16 © NEC Corporation 2014
Configuration for
OLTP performance
Comparison
NEC PCIe SSD Appliance
for Microsoft® SQL Server®
Express5800/A1080a-S
+ External FC storage
CPU E7-8893 v2 (6C, 3.4GHz) E7-8870 (10C, 2.4GHz)
CPU socket count 1 2 3 4 2
Total core count 6 12 18 24 20
Physical memory capacity 128GB 256GB 384GB 512GB 256GB
Storage configuration
1.1TB FlashMAX II (Max Performance Mode)
Mirrored storage pool configuration iStorage M100 x1
(24 450GB 10krpm SAS-HDD)
RAID-10 6 pair 1set 2 sets 3sets 4 sets
Physical Storage Capacity 0.9TB 1.7TB 2.6TB 3.4TB 5.4TB
Physical
Capacity
per
Usage
User data ~0.5TB ~1.0TB ~1.5TB ~2.0TB 3.6TB
Transaction log ~0.2TB ~0.4TB ~0.6TB ~0.8TB 1.0TB
tempdb ~0.2TB ~0.3TB ~0.5TB ~0.6TB 0.8TB
Single Node OLTP Performance (1/2)
OLTP performance comparison with “Express5800/A1080a + external
FC storage system” using “Hammer DB” benchmark tool.
Page 17 © NEC Corporation 2014
NEC Express5800 A1080a-S performance of optimized I/O scenario is the base performance of the relative performance comparison
Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache.
Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache.
Performance comparison using HammerDB benchmark tool
54
95
131
178
100
27
50
71
91
4
50% 47% 46% 49%
96%
0%
25%
50%
75%
100%
0
50
100
150
200
1P6C 2P12C 3P18C 4P24C 2P20C
Relative performance of Optimized I/O scenario
Relative performance of Non-Optimized I/O scenario
Performance down rate between 2 scenarios (%)
NEC PCIe SSD Appliance
for Microsoft® SQL Server® (E7-8893v2 3.4GHz)
NEC Express5800 A1080a-S (E7-8870 2.4GHz)
+ iStorage M100 x1
Relative performance Performance down rate
Single Node OLTP Performance (2/2)
Page 18 © NEC Corporation 2014
Express5800 A1080a-S
+iStorage M100 NEC PCIe SSD Appliance for Microsoft® SQL Server ®
2P20C (2.4GHz) + 256GB RAM
Total 24 SAS-HDD drives
4P24C (3.4GHz) + 512GB RAM
8G-FC channels x 4
(2p 8G-FC HBA x 2)
Achieve high performance even in heavy IO stress, requires
less DB tuning cost (i.e., less system integration cost)
53% less impact of IO 96% 49%
OLTP performance down ratio
between the optimized IO scenario
And Non-optimized IO scenarios *1,3
178% better performance Relative OLTP performance (TPS)
comparison for optimized I/O
scenario *1, *2 100 178
*1 Relative performance comparison using HammerDB benchmark tool
*2 Optimized IO scenario : Minimize IO by enabling Server side memory caches and Storage side cache.
*3 Non-optimized IO scenario: Maximize IO by disabling Server side memory caches and Storage side cache.
All-in-a-box
solution
Benefit as OLTP system
Page 19 © NEC Corporation 2014
5. Summary
Benefit of
NEC PCIe SSD Appliance for
Microsoft® SQL Server®
Page 20 © NEC Corporation 2014
Benefit of NEC PCIe SSD Appliance for Microsoft® SQL Server ®
Balanced and Predictable
Performance Easy to introduce TCO reduction
Initial Cost
Operating Cost
Time to introduction
Down
• Balanced and Proven CPU-IO
Performance depending
on number of Flash MAX II.
• Consistent high-performance
even under heavy IO load.
• Customer can choose best
practice configuration
depending on data size.
• Configuration guide,
including best parameter
setting will be available *
• Less platform integration cost
• Less Rack apace
• Less Power Consumption
Express5800 Scalable Enterprise Server
High-performance PCIe server-mounted flash storage
X
* Pre-configuration and Pre-installation Are subject of discussion
Page 21 © NEC Corporation 2014
Big Data Analytics Solution
built on NEC PCIe SSD Appliance for Microsoft® SQL Server®
Enterprise System
Customer Data
Web site Blog
SMS
TARO SUZUKITARO SUZUKI08/07
Smart Device
SQL Server 2014 Analysis Services
INPUT Big Data Analytics Platform
Store data into High-Performance
PCIe server-mounted flash storage
Process &
Aggregation
Data Scientist
End user
Data Extract
NEC PCIe SSD Appliance
for Microsoft® SQL Server®
“Microsoft SQL Server 2014” equipped with ETL, DB, BI, Data Mining, easy-to-use
“Excel & Power BI” and “NEC PCIe SSD Appliance for Microsoft® SQL Server®”
provide Low-Cost All-in-One Big Data Analysis Platform