fluxx streaming

Lee Sheng

lsheng@yelp.com

Fluxx is a simple card game where the rules

and goals are ever changing. Cards include:

• Rules - how to play the game

• Goals - victory conditions

• Keepers - help you achieve goals

• Creepers - prevent you from winning

INTRODUCTION TO

Per Fluxx rules, we start with basic

logging:

Log one line:logging.info(“Playing Streaming Fluxx!”)

Read one line:tail -1 streaming_fluxx.log

BASIC LOGGINGB

AS

IC L

OG

GIN

G To log data:

Log one line

Read one line

CENTRALIZED LOGGINGC

EN

TR

AL

IZE

D L

OG

GIN

G

FACEBOOK SCRIBEF

AC

EB

OO

K S

CR

IBE

OVER 9000 HOSTSO

VE

R 9

000 H

OS

TS

!

LOG AGGREGATORSL

OG

AG

GR

EG

AT

OR

S

ALL THE USE CASES!A

LL

TH

E U

SE

CA

SE

S!

APACHE KAFKAA

PA

CH

E K

AF

KA

TRAFFIC IMBALANCE!T

RA

FF

IC I

MB

AL

AN

CE

!

BUFFER NODESB

UF

FE

R N

OD

ES

RELIABLE MESSAGESR

EL

IAB

LE

ME

SS

AG

ES

KAFKA ACKSK

AF

KA

AC

KS

publish(acks=all)

ACK

INFINITE RETENTIONIN

FIN

ITE

RE

TE

NT

ION

PINTEREST SECORP

INT

ER

ES

T S

EC

OR

Build incrementally!

KEY TAKEAWAY 1

Don’t shy from replacing what used to work

KEY TAKEAWAY 2

FINAL PRODUCTION SIDE ARCHITECTURE

WINNING SYSTEM! (for now…)

TA

LK

OV

ER

CO

NT

AC

T C

AR

D

Lee Sheng

lsheng@yelp.com

@bogosort