postgres open 2014 - a performance characterization of postgres on different storage systems

A Performance Characterization ofPostgres on Different Storage Systems

Dong Ye & Syed Faisal Akber

2014-09-18

1 / 29

1 Storage Systems

2 Benchmarks

3 Results

4 Summary

2 / 29

Storage Systems

3 / 29

Storage Systems

Fibre Channel

NFS

Local Storage

VSAN

4 / 29

Fibre Channel

Block level storageconnected by specialfibre optic cables

Uses “Fabric” switchesfor connectivity

Top speed today is 16Gbps

5 / 29

NFS

Network Attached Storage

Easy to setup

Uses normal network (Ethernet) switches

Storage Arrays now support NFS

New features now available to NFS servers viaArrays

6 / 29

Local Storage

Hard-disk drives andsolid-state drives

Directly attached toservers

Inexpensive

7 / 29

VSAN

Abstracts and poolsserver-side flash anddisk into shared andreplicated pools

Built within thehypervisor

Latency is minimized byleveraging SSD as writebuffer and read cache

Non-disruptive scaling

8 / 29

Benchmarks

9 / 29

Benchmarks

Benchmark Description and ConfigurationDBT2 OLTP, TPC-C

60 warehouses, clients = # of CPUs,zero delays

DBT3 OLAP, TPC-H10 scale factor, 3 streams

10 / 29

Results

11 / 29

Fibre Channel Testbed

Subsystem SpecificationsStorage EMC VNX 5500 RAID-0 LUNsHypervisor VMware ESXi 5.5 Update 2CPU 32Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB

12 / 29

13 / 29

Fibre Channel – DBT2

Type ResultVMFS 123674.82 NOTPMRDM/Passthrough 123377.15 NOTPM

14 / 29

15 / 29

Fibre Channel – DBT3

Type Power Throughput CompositeVMFS 47.89 25.57 34.99RDM/Passthrough 47.02 25.03 34.30

16 / 29

NFS Testbed

Subsystem SpecificationsStorage NetApp FAS6210Hypervisor VMware ESXi 5.5 Update 2CPU 8Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB

17 / 29

18 / 29

NFS – DBT2

Type ResultMount inside VM 47458.26 NOTPMMount by hypervisor 80205.98 NOTPM

19 / 29

20 / 29

NFS – DBT3

Type Power Throughput CompositeMount inside VM 143.64 119.52 131.02Mount by hypervisor 86.92 122.73 103.28

21 / 29

Local Storage Testbed

Subsystem SpecificationsRAID Controller HP P410i (1024MB BBWC)Drive Write Cache Disabled from system BIOSDisks under Test 1x 15K-rpm SAS, 1x SSDHypervisor VMware ESXi 5.5 Update 2CPU 8Memory 16 GBFilesystem EXT4Operating System Fedora 20 (3.16.2-200)Database Server PostgreSQL 9.4beta2postgresql.conf shared buffers = 10GB

22 / 29

23 / 29

Local Storage – DBT2

Type ResultSAS 88955.97 NOTPMSSD 86796.97 NOTPM

24 / 29

25 / 29

Local Storage – DBT3

Type Power Throughput CompositeSAS 49.25 11.92 24.23SSD 143.63 119.52 131.02

26 / 29

Summary

Storage Systems

Benchmarks

Results

27 / 29

Questions?

28 / 29

References

PostgreSQL http://www.postgresql.org/

Transacton Processing Performance Council (TPC)http://www.tpc.org/

VMware Virtual SAN (VSAN)http://www.vmware.com/products/virtual-san

Database Test Suitehttp://sourceforge.net/projects/osdldbt/

Virtual Machine File System (VMFS) http://www.vmware.com/products/vsphere/features/vmfs

29 / 29