oaktable world 2014 kevin closson: slob – for more than i/o!

49
1 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved. SLOB Topics for Oaktable World 2014 Kevin Closson Chief Performance Architect 1 © Copyright 2014 EMC Corporation. All rights reserved.

Upload: kyle-hailey

Post on 28-Nov-2014

264 views

Category:

Software


1 download

DESCRIPTION

SLOB – For More Than I/O! Oracle I/O performance benchmarking

TRANSCRIPT

Page 1: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

1 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Topics for Oaktable World 2014

Kevin Closson Chief Performance Architect

1 © Copyright 2014 EMC Corporation. All rights reserved.

Page 2: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

2 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

xtremio.com/slob

Page 3: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

3 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Page 4: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

4 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

xtremio.com/slob

Page 5: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

5 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

>$100,000,000 <6 months >40PB sold

#1 All-Flash Array in the Market XtremIO

5 © Copyright 2014 EMC Corporation. All rights reserved.

Page 6: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

6 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Agenda �  The obvious things you can do with SLOB �  SLOB without physical I/O?

�  SLOB for Oracle Database 12c In-Memory Option?

�  SLOB for Oracle Multitenant?

�  SLOB to test Oracle Database contention?

�  A peek: Testing 11g on Windows 2012 with SLOB

Page 7: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

7 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Typical Platform Testing With SLOB

Page 8: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

8 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

..but first, quick SLOB fundamentals...

Page 9: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

9 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Fundamentals �  Single design center

–  Maximum SQL execution with minimum CPU utilization –  Maximum physical I/O per unit of DB CPU

�  No application contention –  Schema per session –  Single row per block –  100% random data access

Page 10: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

10 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Fundamentals �  Predictable and Repeatable

–  Results vary less than 3% in the worst case. Generally 1-2% variation

–  Semaphore trigger. Timed-completion or fixed SQL execution count

–  SELECT/UPDATE workload. Tables never need reloaded, single index never needs maintenance

Page 11: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

11 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Fundamentals

�  Predictable and Repeatable

–  Synchronous reads

▪  Key Performance Metrics (Executions/sec, PIOPS, etc) directly tied to I/O service times

Page 12: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

12 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Fundamentals �  Simple

–  All you need ▪  A tablespace to store the SLOB schemas

▪  Enough storage to store ~4:1 ratio of SLOB data to db_cache_size —  Example: 1GB db_cache_size, 32 Sessions, for 4GB use: slob.conf->SCALE=16384 —  16384 * 8192 * 32 == 4GB

▪  Connection by bequeath or SQL*Net

Page 13: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

13 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB Fundamentals �  SLOB is a Linux kit, not ported

–  Use Oracle client on Linux

▪  Small physical or virtual as the driver to test Windows, AIX, Solaris, etc

▪  The client does not require CPU during test execution. It’s 100% foreground PL/SQL

Page 14: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

14 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Testing Physical IOPS With SLOB

Examples based on EMC XtremIO

Page 15: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

15 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Single Host 2s16c32t Redo Payload vs LGWR Write Latency - Tip: Tweak SLOB/procedure.sql

Page 16: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

16 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Single Host 2s16c32t Redo Payload vs Random Read Latency

Page 17: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

17 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Cached SLOB

Page 18: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

18 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB: slob.sql

Page 19: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

19 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Cached SLOB – Study CPU Scalability 2s16c32t E5-2600

3020 5215

24397

34150

41657

49059

55820

0

10000

20000

30000

40000

50000

60000

0 5 10 15 20 25 30 35 40 45

SQL EXECUTIONS/Second

EXECUTES

Page 20: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

20 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Cached SLOB – Study CPU Scalability 2s16c32t E5-2600

776967 1341608

6280211

8791012

10723697

12629035

14369615

0

2000000

4000000

6000000

8000000

10000000

12000000

14000000

16000000

0 5 10 15 20 25 30 35 40 45

LIOPS

LIOPS

Page 21: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

21 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Cached SLOB – Study CPU Scalability 2s16c32t E5-2600

Page 22: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

22 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Cached SLOB Focus on Intel SMT

Page 23: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

23 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Understand Intel SMT

Page 24: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

24 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Perf(1) top - skinny.sql

Page 25: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

25 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Perf(1) top – fat.sql

Page 26: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

26 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Understand Intel SMT

Page 27: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

27 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Understand Intel SMT

Page 28: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

28 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

2-socket x86 server performance in the last decade

•  With CPU threading skinny.sql and fat.sql are oil and water as skinny forces fat to run on a thread == starvation since fat stalls less (see SQL)

•  Same number of “noise” sessions

•  Top case N fat.sql •  Bottom case N skinny.sql

+ 1 fat.sql.

Page 29: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

29 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

In-Memory Column Store

Page 30: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

30 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database �  Study OLTP / In-Memory Database Option co-

hosting

–  In-memory cache population (ingest) rates

–  Think “data flow”. Who is a producer and who is a consumer ▪  inmemory_max_populate_servers and PQO slaves

–  Co-hosted with OLTP

Page 31: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

31 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Top(1) – In-Memory Database Option

Page 32: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

32 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 33: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

33 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 34: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

34 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 35: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

35 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 36: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

36 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 37: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

37 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on In-Memory Database

Page 38: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

38 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Multitenant Oracle

Page 39: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

39 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on Oracle Multitenant

�  Use SLOB to study Oracle Multitenant

�  What better way to understand a simple premise than to rely on a simple, predictable workload and test kit?

Page 40: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

40 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on Oracle Multitenant �  http://www.oracle.com/technetwork/database/multitenant/

learn-more/oraclemultitenantt5-8-final-2185108.pdf, pg 23:

�  Hold it. To achieve great savings in CPU consumption, doesn’t that mean we must all accept the notion that background processing consumes a significant amount of CPU bandwidth?

“In Oracle Multitenant, great savings in CPU consumption arise from the sharing of background processes among databases, which can significantly reduce the amount of cores needed to support a given number of databases. “

Page 41: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

41 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on Oracle Multitenant �  Background CPU

–  Scrutinize with SLOB. Know your platform. Now your costs and rates. –  We are looking at BG behavior so this is UPDATE intensive SLOB –  2s20c40t E5-2690v2 host. –  This is a single database!

Page 42: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

42 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – A Focus on Oracle Multitenant �  Testing to further understand a simple assertion.

�  The assertion: –  Consolidating from multiple databases/instances into a

single Oracle Multitenant deployment significantly reduces CPU overhead due to shared background processing

Page 43: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

43 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Multitenant – Huge CPU savings? Simple assertion, simple baseline?

Page 44: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

44 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Multitenant – Huge CPU savings? �  Testing to further understand a simple assertion. �  Should be simple enough, right?

–  SLOB – Simple to use, simple to understand. ▪  40 simple schema users with zero data sharing – simple workload ▪  40 databases each with

—  A single SLOB session —  slob.conf->SCALE=668734 (5GB 100% randomly visited active data set) —  slob.conf->UPDATE_PCT=25 (SQL mix 75% SELECT, 25% UPDATE) —  Simple init.ora (next slide) —  slob.conf->WORK_LOOP=100000 —  Test on a 2s20c40t E5-2690v2 server

�  The metric is job completion – fixed workload.

Page 45: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

45 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Multitenant – Huge CPU savings? �  Testing to further understand a simple assertion. �  The metric is job completion – fixed workload.

�  Which model pushes through 4,000,000 SQL executions faster?

Page 46: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

46 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

Testing Database Contention With SLOB?

Page 47: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

47 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – Testing Database Contention �  slob.conf->SHARED_DATA_MODULUS

Page 48: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!

48 © Copyright 2014 EMC Corporation. All rights reserved. © Copyright 2014 EMC Corporation. All rights reserved.

SLOB – Testing Database Contention �  slob.conf->SHARED_DATA_MODULUS

Page 49: Oaktable World 2014 Kevin Closson:  SLOB – For More Than I/O!