h-store - sigmod 2014 jim gray awardpavlo/slides/sigmod-award2014.pdf · txn/sec . nodes (8 cores...

16

Upload: others

Post on 07-Aug-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000
Page 2: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000
Page 3: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000
Page 4: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

HOW TO SCALE UP WITHOUT GIVING UP

TRANSACTIONS?

Page 5: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

High-Performance Transaction Processing System

Page 6: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

MAIN MEMORY STORAGE

SERIAL EXECUTION

COMMAND LOGGING

STORED PROCEDURES

Page 7: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

0

25,000

50,000

75,000

100,000

125,000

1 2 3 4 5 6 7 8

H-Store

13x

TXN/SEC CPU CORES

MySQL Postgres

Japanese “American Idol” VOTER BENCHMARK

Page 8: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000
Page 9: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000
Page 10: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

DISTRIBUTED TRANSACTIONS

Page 11: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

TXN/SEC NODES (8 CORES PER NODE)

10% Distributed Transactions VOTER BENCHMARK

0

20,000

40,000

60,000

80,000

100,000

1 2 3 4

H-Store

Page 12: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

Identify Distributed Transactions ON PREDICTIVE MODELING FOR OPTIMIZING TRANSACTION EXECUTION IN PARALLEL OLTP SYSTEMS Proc. VLDB Endow., vol. 5, pp. 85-96, 2011.

Utilize Transaction Stalls THE ART OF SPECULATIVE EXECUTION In Progress (July 2014)

Optimize Single-Partition Execution H-STORE: A HIGH-PERFORMANCE, DISTRIBUTED MAIN MEMORY TRANSACTION PROCESSING SYSTEM Proc. VLDB Endow., vol. 1, iss. 2, pp. 1496-1499, 2008.

Minimize Distributed Transactions SKEW-AWARE AUTOMATIC DATABASE PARTITIONING IN SHARED-NOTHING, PARALLEL OLTP SYSTEMS Proceedings of SIGMOD, pp. 61-72, 2012.

Page 13: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

TXN/SEC NODES (8 CORES PER NODE)

All Optimizations Enabled VOTER BENCHMARK

0

100,000

200,000

300,000

400,000

500,000

1 2 3 4

H-Store

Page 14: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

Stan Zdonik

Mike Stonebraker

Sam Madden

Ugur Cetintemel

David DeWitt

Dan Abadi

Justin DeBrabant

Saurya Velagapudi

Aaron Elmore

Xin Jia

Carlo Curino

Evan Jones

Yang Zou

Ning Shi

Visawee Angkana.

Page 15: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000

@ANDY_PAVLO END

db.cs.cmu.edu

Page 16: H-Store - SIGMOD 2014 Jim Gray Awardpavlo/slides/sigmod-award2014.pdf · TXN/SEC . NODES (8 CORES PER NODE) 10% Distributed Transactions . VOTER BENCHMARK . 0. 20,000. 40,000. 60,000