principles of microservices - ndc 2014

PRINCIPLES OF MICROSERVICESSam Newman NDC London, December 2014

1

@samnewman#ndclondon


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service

Small Autonomous services that work together

@samnewman#ndclondon4

Show Gilt, Groupon, Netflix, Amazon


Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

@samnewman#ndclondon http://www.12factor.net/

http://www.12factor.net/


Strategic Goals Architectural

Principles Design and Delivery

Practices

Enable scalable business More customers/transactions Self-service for customers

Support entry into new markets Flexible operational processes New products and operational processes

Support innovation in existing markets Flexible operational processes New products and operational processes

Reduce inertia Make choices that favour rapid feedback and change, with reduced dependencies across teams.

Eliminate accidental complexity Aggressively retire and replace unnecessarily complex processes, systems, and integrations so that we can focus on the essential complexity.

Consistent interfaces and data flows Eliminate duplication of data and create clear systems of record, with consistent integration interfaces.

No silver bullets Off the shelf solutions deliver early value but create inertia and accidental complexity.

Standard REST/HTTP

Encapsulate legacy

Eliminate integration databases

Consolidate and cleanse data

Published integration model

Small independent Services

Continuous deployment

Minimal customisation of COTS/SAAS


Small Autonomous services that work together


Principles Of Microservices



Modelled Around Business Domain




Culture Of Automation




Culture Of Automation Hide Implementation

Details





Details

Decentralise All The Things





Details


Deploy Independently





Details


Isolate Failure Deploy Independently





Details



Highly Observable


Accounts

Returns

Invoicing

Shipping

Inventory

Customer Service





Details



Highly Observable

✔


3 Months

2 Microservices


3 Months

2 Microservices

12 Months

10 Microservices


3 Months

2 Microservices

12 Months

10 Microservices

18 Months

60 Microservices


Infrastructure Automation



Automated Testing



Continuous Delivery

Automated Testing





Details



Highly Observable

✔ ✔





Hide Implementation Details



Highly Observable

✔ ✔


DB


DB

HIDE YOUR DATABASE

@samnewman#ndclondonhttp://martinfowler.com/bliki/images/boundedContext/sketch.png





Details



Highly Observable

✔ ✔ ✔


What is autonomy?


What is autonomy?

Giving people as much freedom as possible to do the job at hand


DEVOLUTION?


SELF-SERVICE

https://www.flickr.com/photos/katsrcool/15184711908/

@samnewman#ndclondonhttp://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice

SHARED GOVERNANCE


OWNER-OPERATOR

https://www.flickr.com/photos/stevendepolo/5939055612


INTERNAL OPEN SOURCE


DUMB-PIPES, SMART ENDPOINTS

Magical Mystery Bus


Magical Mystery Bus





Details


Highly Observable

✔ ✔ ✔

Decentralise All The Things ✔


ONE SERVICE PER-HOST

Host

Service


ONE SERVICE PER-HOST

Host

Service

Host

Service Service

Service Service

VS


CONSUMER-DRIVEN CONTRACTS

Shipping Inventory



Expectations

Shipping Inventory



Expectations

Prod

Shipping Inventory


https://github.com/realestate-com-au/pact

https://github.com/realestate-com-au/pact


CO-EXIST ENDPOINTS

Customer Service

Shipping


CO-EXIST ENDPOINTS

Customer Service

Shipping

V2V1


CO-EXIST ENDPOINTS

Customer Service

Shipping

V2





Details

Isolate Failure

Highly Observable

✔ ✔ ✔


Deploy Independently✔


1 in 100


4 in 100


Strangler App


Strangler App

Legacy App

Legacy AppLegacy App


Strangler App

Legacy App

Legacy App

Requests

Legacy App


Strangler App

Legacy App

Legacy App

Requests

Legacy App

30 - 60 Concurrent Requests


Strangler App

Legacy App

Legacy App

Requests

Legacy App

30 - 60 Concurrent Requests

> 800 Concurrent Requests


Strangler App

Legacy App Legacy App Legacy App

Thread Pool


Strangler App


Thread Pool

Failing…slowly!


Strangler App


Thread Pool

Failing…slowly!

Thread-pool exhausted


Strangler App


Thread Pool

Failing…slowly!


No requests to other downstream apps


Strangler App


Thread Pool

Failing…slowly!


Requests Building Up

No requests to other downstream apps


Strangler App


Thread Pool


Strangler App


Fix Timeouts

Thread Pool


Strangler App


Fix Timeouts

Thread Pool Thread PoolThread Pool


Strangler App


Fix Timeouts

Thread Pool Thread PoolThread PoolBulkhead

Downstream Connections


Strangler App


Fix Timeouts

Thread Pool Thread PoolThread PoolBulkhead

Downstream Connections

Circuit Breakers





Details

Highly Observable

✔ ✔ ✔


Deploy Independently✔Isolate Failure✔


AGGREGATION


LOGS

AGGREGATION


LOGSSTATS

AGGREGATION


CORRELATION IDS


CORRELATION IDS

ID 8964


CORRELATION IDS

ID 8964

ID 8964

ID 8964

ID 8964

ID 8964





Details





Details


Deploy Independently





Details







Details



Highly Observable


Sam Newman

Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS

http://buildingmicroservices.com/

http://buildingmicroservices.com/

Sam Newman @samnewman

THANKS!

principles of microservices - ndc 2014

Technology

scalable business

complex processes

thingsisolate failure

ndclondon4show gilt

ndclondon http

accidental complexity

cleanse data

integration databases