think like an ant, distribute the workload - phpday, italy, 2011

Distribute the workload

Helgi Þormar ÞorbjörnssonPhpDay, Italy, Verona, 13th May, 2011

Saturday, 14 May 2011

Who am I?


VP of Engineering at Orchestra.io



Developer at PEAR



Developer at PEAR

From Iceland



Developer at PEAR

From Iceland

@h on Twitter


Why Distribute?


Why Distribute?

Budget


Why Distribute?

Budget

Efficiency


Why Distribute?

Budget

Efficiency

Perception


Budget


Budget

Spend wisely


Budget

Spend wisely

Commodity servers


Budget

Spend wisely

Commodity servers

Low overhead, high yield


Budget

Spend wisely

Commodity servers

Low overhead, high yield

Cloud Computing (EC2)


Efficiency

10 small servers > 1 big


Venue Security


1000 people can exit quicker through 10 small doors than 1 big


1000 people can exit quicker

through 10 small doors than 1 big


1000 people can exit quicker through 10 small doors than 1 big


Perception


Perception

Defer intensive processes


Perception


Give instant feedback


Perception


Give instant feedback

Users keep on browsing


Chapter from Nature


Ant Colonies


Algorithms


Algorithms

Scheduling


Algorithms

Scheduling

Vehicle Routing


Algorithms

Scheduling

Vehicle Routing

Assignment


Algorithms

Scheduling

Vehicle Routing

Assignment

Sets


Algorithms

Scheduling

Vehicle Routing

Assignment

Sets

Other


How do ants fit?


How do ants fit?

Strength in numbers


How do ants fit?

Strength in numbers

Work together


How do ants fit?

Strength in numbers

Work together

Size benefits them


Teamwork

When faced with a problem they will solve the problem as one.


What if they were bigger?


Types of Ants


Types of Ants

Military


Types of Ants

Military

Maids


Types of Ants

Military

Maids

Tunnel diggers


Types of Ants

Military

Maids

Tunnel diggers

Food gatherers


How does this map to my application?


Colony = Application


Colony = Application Ants = Components


Colony = Application Ants = Components

Ants do many different types of work to keep their colony running


Architect for Distribution


Characteristics


Characteristics

Decoupling


Characteristics

Decoupling

Elasticity


Characteristics

Decoupling

Elasticity

High Availability


Characteristics

Decoupling

Elasticity

High Availability

Concurrency


Decoupling


Application

DB API

Cache FE


ApplicationDB API

Cache FE


ApplicationDB API

Cache FE

Cache


ApplicationDB API

Cache FE

Cache

API


ApplicationDB API

Cache FE

Cache

API

API


Elasticity


Cloud Computing


Load Balancing


HA Proxy

Nginx

My Favourite


Monitoring


Automation


High Availability


Benefits


Benefits

Easy management


Benefits

Easy management

Ability to stop / start servers quickly


Benefits

Easy management


Responsibilities are separate


Benefits

Easy management



Quickly move to a new cluster


Benefits

Easy management



Quickly move to a new cluster

Reduced risk


What to avoid


What to avoidLocal:


What to avoidLocal:

Sessions


What to avoidLocal:

Sessions

Files


What to avoidLocal:

Sessions

Files

Memory


What to avoidLocal:

Sessions

Files

Memory

Uploads


What to avoidLocal:

Sessions

Files

Memory

Uploads

Writing to /tmp


Solutions


Solutions

Store sessions in DB / Memcache


Solutions


Use S3 to store uploaded files


Solutions



Use networked Memcache


Solutions




Serve up static files from a CDN


Solutions




Serve up static files from a CDN

Or... A multi domain solution


Internal APIs


Application

MySQLMongo FS

Internal Storage API


SOA


Service Oriented Architecture


Sort of :-)


Eventually Consistent


CAP Therom


Consistency

Availability

Partition Tolerance


Queue Systems


Good for


Good forImage Processing



Distributed Logs



Distributed Logs

Data Mining



Distributed Logs

Data Mining

Mass Emails



Distributed Logs

Data Mining

Mass Emails

Intensive transformation



Distributed Logs

Data Mining

Mass Emails

Intensive transformation

Search


Common Tools


Common Tools

Gearman


Common Tools

Gearman

Hadoop


Common Tools

Gearman

Hadoop

Zero MQ (0MQ)


Common Tools

Gearman

Hadoop

Zero MQ (0MQ)

RabbitMQ


Common Tools

Gearman

Hadoop

Zero MQ (0MQ)

RabbitMQ

And many others!


Gearman


Your Client Code

Gearman Client API(C, PHP, Perl, MySQL UDF, ...)

Gearman Job Servergearmand

Gearman Worker API(C, PHP, Perl, Python, ...)

Your Worker Code

Your App Gearman


Story time


Questions?

[email protected]: @h

Joind.in: http://joind.in/3027


mailto:[email protected]

mailto:[email protected]

http://joind.in/3340

http://joind.in/3340

think like an ant, distribute the workload - phpday, italy, 2011

Technology