postgres open 2014 - a performance characterization of postgres on different storage systems
DESCRIPTION
Performance is an important factor when considering different storage systems for Postgres. In this talk we will present a detailed performance characteristics on a number of different storage systems. We will compare Fibre Channel SAN, Enterprise NAS, VMware VSAN, and local storage (SSD and SAS disks) behind battery backed RAID. We will look at OLTP and OLAP workloads.TRANSCRIPT
A Performance Characterization ofPostgres on Different Storage Systems
Dong Ye & Syed Faisal Akber
2014-09-18
1 / 29
1 Storage Systems
2 Benchmarks
3 Results
4 Summary
2 / 29
Storage Systems
3 / 29
Storage Systems
Fibre Channel
NFS
Local Storage
VSAN
4 / 29
Fibre Channel
Block level storageconnected by specialfibre optic cables
Uses “Fabric” switchesfor connectivity
Top speed today is 16Gbps
5 / 29
NFS
Network Attached Storage
Easy to setup
Uses normal network (Ethernet) switches
Storage Arrays now support NFS
New features now available to NFS servers viaArrays
6 / 29
Local Storage
Hard-disk drives andsolid-state drives
Directly attached toservers
Inexpensive
7 / 29
VSAN
Abstracts and poolsserver-side flash anddisk into shared andreplicated pools
Built within thehypervisor
Latency is minimized byleveraging SSD as writebuffer and read cache
Non-disruptive scaling
8 / 29
Benchmarks
9 / 29
Benchmarks
Benchmark Description and ConfigurationDBT2 OLTP, TPC-C
60 warehouses, clients = # of CPUs,zero delays
DBT3 OLAP, TPC-H10 scale factor, 3 streams
10 / 29
Results
11 / 29
Fibre Channel Testbed
Subsystem SpecificationsStorage EMC VNX 5500 RAID-0 LUNsHypervisor VMware ESXi 5.5 Update 2CPU 32Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB
12 / 29
13 / 29
Fibre Channel – DBT2
Type ResultVMFS 123674.82 NOTPMRDM/Passthrough 123377.15 NOTPM
14 / 29
15 / 29
Fibre Channel – DBT3
Type Power Throughput CompositeVMFS 47.89 25.57 34.99RDM/Passthrough 47.02 25.03 34.30
16 / 29
NFS Testbed
Subsystem SpecificationsStorage NetApp FAS6210Hypervisor VMware ESXi 5.5 Update 2CPU 8Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB
17 / 29
18 / 29
NFS – DBT2
Type ResultMount inside VM 47458.26 NOTPMMount by hypervisor 80205.98 NOTPM
19 / 29
20 / 29
NFS – DBT3
Type Power Throughput CompositeMount inside VM 143.64 119.52 131.02Mount by hypervisor 86.92 122.73 103.28
21 / 29
Local Storage Testbed
Subsystem SpecificationsRAID Controller HP P410i (1024MB BBWC)Drive Write Cache Disabled from system BIOSDisks under Test 1x 15K-rpm SAS, 1x SSDHypervisor VMware ESXi 5.5 Update 2CPU 8Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB
22 / 29
23 / 29
Local Storage – DBT2
Type ResultSAS 88955.97 NOTPMSSD 86796.97 NOTPM
24 / 29
25 / 29
Local Storage – DBT3
Type Power Throughput CompositeSAS 49.25 11.92 24.23SSD 143.63 119.52 131.02
26 / 29
Summary
Storage Systems
Benchmarks
Results
27 / 29
Questions?
28 / 29
References
PostgreSQL http://www.postgresql.org/
Transacton Processing Performance Council (TPC)http://www.tpc.org/
VMware Virtual SAN (VSAN)http://www.vmware.com/products/virtual-san
Database Test Suitehttp://sourceforge.net/projects/osdldbt/
Virtual Machine File System (VMFS) http://www.vmware.com/products/vsphere/features/vmfs
29 / 29