net flix kafka seattle meetup

38

Upload: nitin-kumar

Post on 16-Mar-2018

161 views

Category:

Engineering


1 download

TRANSCRIPT

Page 1: Net flix kafka seattle meetup
Page 2: Net flix kafka seattle meetup

●○○

●○○○

Page 3: Net flix kafka seattle meetup

●●●

Page 4: Net flix kafka seattle meetup

A NETFLIX ORIGINAL SERVICE

Page 5: Net flix kafka seattle meetup

Stream Consumers

Router

EMR

FrontingKafka

EventProducer

ConsumerKafka

Management

HTTPPROXY

Page 6: Net flix kafka seattle meetup

Fronting Kafka Clusters Consumer Kafka Clusters

Number of clusters 24 15

Total number of instances 1700+ 1100+

Instance type d2.2xl i2.2xl

Replication factor 2 2

Retention period 8 to 24 hours 2 to 4 hours

Page 7: Net flix kafka seattle meetup

●○○○

●○

Page 8: Net flix kafka seattle meetup

○●

Page 9: Net flix kafka seattle meetup

●○

●●

○○

Page 10: Net flix kafka seattle meetup

●●

0.1% 0.5% 1% 5% Percent loss

Page 11: Net flix kafka seattle meetup

●●

○○

Page 12: Net flix kafka seattle meetup

●●

Page 13: Net flix kafka seattle meetup

●○○

● …

Page 14: Net flix kafka seattle meetup
Page 15: Net flix kafka seattle meetup

○ →

Page 16: Net flix kafka seattle meetup

●●

○○○ →

Page 17: Net flix kafka seattle meetup
Page 18: Net flix kafka seattle meetup

●●

○○○

Page 19: Net flix kafka seattle meetup

●○○○

●●

Page 20: Net flix kafka seattle meetup

●○ →

●○ →

●○ →

Page 21: Net flix kafka seattle meetup

●●

○●

Page 22: Net flix kafka seattle meetup

Rack 0 Rack 1

0

Broker 0 Broker 1 Broker 2 Broker 3

3 0 1 1 2 2 3

N = Partition N for a topic with 2 replicas

0 ← Off line partition

Page 23: Net flix kafka seattle meetup

Rack 0 Rack 1

0

Broker 0 Broker 1 Broker 2 Broker 3

3 1 2 0 1 2 3

N = Partition N for a topic with 2 replicas

No offline partition

Page 24: Net flix kafka seattle meetup

●○

Page 25: Net flix kafka seattle meetup

●○○○

●○○

Page 26: Net flix kafka seattle meetup

EventProducer

Kafka

Buffer exhausted and message drop Slow replication

Broker with networking problem

Disk read causes slow responses

X

X

X

Page 27: Net flix kafka seattle meetup
Page 28: Net flix kafka seattle meetup

28

Page 29: Net flix kafka seattle meetup

29

Page 30: Net flix kafka seattle meetup

●●

○○○

Page 31: Net flix kafka seattle meetup

●○○○

Page 32: Net flix kafka seattle meetup

●○○

●●●

Page 33: Net flix kafka seattle meetup
Page 34: Net flix kafka seattle meetup

●●

●●

Page 35: Net flix kafka seattle meetup

RouterFrontingKafka

EventProducer

XConsumer

Kafka

Copy topic metadata

Consumer

Page 36: Net flix kafka seattle meetup

Fully Automated

Page 37: Net flix kafka seattle meetup
Page 38: Net flix kafka seattle meetup