Performance PlumbingAdam Bechtel 24 June 2008

WARNING

These slides won’t make any sense unless you hear the presentation.

The beginning….

Server

Internet

You grow a little….

Server

Internet

SwitchLoad Balancer

ServerServerServerServerServer

ServerServerServer

Sites evolve….and so does a Backbone…

You’re global!

KNOBS Cost

Packetloss

Latency

Maintenance

Diversity

Isolation

*Special*

ANYCAST

Network address and routing scheme used for proximity

Also useful for load absorption

ANYCAST ADDRESS

West Central East

ANYCAST SERVICES

NameServer1:

NameServer2:

NameServer3:

Anycast Cloud1 Anycast Cloud2

ANYCAST SCALING

Global Scaling

Add more sites

Local Scaling

VIP

ECMP

ANYCAST CONSIDERATIONS

How are you going to monitor your service?

Can your service handle transient network events?

How much control do you want over where your users go?

CACHE

Locate caches near users to minimize latency

Need intelligent system to direct users to caches

PROXY

Offload work from your users

Make your service faster

PLACEMENT

Cache and Proxy at edge of network

Thanks