testing & deploying microservices - xp days ukraine 2014
TRANSCRIPT
TESTING & DEPLOYING MICROSERVICESSam Newman XP Days Ukraine, December 2014
1
@samnewman#xpdays
Accounts
Returns
Invoicing
Shipping
Inventory
Customer Service
@samnewman#xpdays
Accounts
Returns
Invoicing
Shipping
Inventory
Customer Service
Small Autonomous services that work together
@samnewman#xpdays
Independently Releasable
@samnewman#xpdays
Testing
Deployment
@samnewman#xpdays
Host
Service
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
VS
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
VS
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
Easier To Provision
VS
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
Easier To Provision
Fewer Side-effects
VS
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
Easier To Provision
Fewer Side-effects
VS
Enforces Interdependence
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
Easier To Provision
Fewer Side-effectsLower host-management overhead
VS
Enforces Interdependence
@samnewman#xpdays
Host
Service
Host
Service Service
Service Service
Much Easier To Reason About
Easier To Provision
Fewer Side-effectsCheaper!
Lower host-management overhead
VS
Enforces Interdependence
@samnewman#xpdays
Reducing Host Management Overhead?
@samnewman#xpdays
API-driven Host Provisioning
@samnewman#xpdays
Virtualisation Platforms
@samnewman#xpdays
VMWare
Virtualisation Platforms
@samnewman#xpdays
VMWareAWS
Digital Ocean
Virtualisation Platforms
@samnewman#xpdays
Step 0: Provision Host
@samnewman#xpdays
Step 0: Provision Host
Step 1: Configure Host
@samnewman#xpdays
Step 0: Provision Host
Step 2: Install Service
Step 1: Configure Host
@samnewman#xpdays
Step 0: Provision Host
Step 2: Install Service
Step 1: Configure Host
@samnewman#xpdays
@samnewman#xpdays
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
Apps
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
AppsPacker Image
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
Apps
VM
OS
AppsPacker Image
STANDARD VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
Apps
VM
OS
Apps
VM
OS
AppsPacker Image
STANDARD VIRTUALISATION
@samnewman#xpdays
Ansible
Puppet
Chef
@samnewman#xpdays
Ansible
Puppet
Chef
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
Immutable Servers
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
Immutable Servers
Fast Spin-up
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
Immutable Servers
Fast Spin-up
Provider Agnostic
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
Immutable Servers
Fast Spin-up
Provider Agnostic
Feedback Can Suffer
@samnewman#xpdays
Ansible
Puppet
Chef
AWS
Digital Ocean
OpenStack
VMWare
Vagrant
Immutable Servers
Fast Spin-up
Provider Agnostic
Feedback Can Suffer
Cycle Time
@samnewman#xpdays
Immutable Servers
@samnewman#xpdays
Cost?
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
Apps
VM
OS
Apps
VM
OS
Apps
@samnewman#xpdays
Machine
Base OS
Hypervisor
VM
OS
Apps
VM
OS
Apps
VM
OS
Apps
Expensive!
@samnewman#xpdays
@samnewman#xpdays
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
Container
OS
Apps
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
Container
OS
Apps Linux Only
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
Container
OS
Apps
Same Kernel
Linux Only
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
Container
OS
Apps
Same Kernel
Linux OnlyFine-grained control
CONTAINER VIRTUALISATION
@samnewman#xpdays
Machine
Base OS
Container
OS
Apps
Container
OS
Apps
Container
OS
Apps
Same Kernel
Linux OnlyFine-grained control
Very fast to provision
CONTAINER VIRTUALISATION
@samnewman#xpdays
@samnewman#xpdays
DOCKER
@samnewman#xpdays
DOCKER
Machine
@samnewman#xpdays
DOCKER
Machine
Base OS
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps Apps
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps Apps Apps
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps Apps Apps
Docker Image Registry
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps Apps Apps
Docker Image Registry
@samnewman#xpdays
DOCKER
Machine
Base OS
Docker
Apps Apps Apps
Docker Image Registry
@samnewman#xpdays
@samnewman#xpdays
@samnewman#xpdays
Semi-permanent Servers
@samnewman#xpdays
Semi-permanent Servers
Image-based Deployments
@samnewman#xpdays
Semi-permanent Servers
Image-based Deployments
Docker
@samnewman#xpdays
@samnewman#xpdays
@samnewman#xpdays
@samnewman#xpdays
kubernetes
@samnewman#xpdays
Testing
@samnewman#xpdays
Unit
Service
UI
MIKE COHN’S TEST PYRAMID
@samnewman#xpdays
Unit
Service
UI
MIKE COHN’S TEST PYRAMID
Increasing Scope
More Confidence
@samnewman#xpdays
Unit
Service
UI
MIKE COHN’S TEST PYRAMID
Increasing Scope
More Confidence
Faster!
Better Isolation
@samnewman#geecon25
DB
Unit
UI
Service
@samnewman#geecon25
DB
Unit
UI
Service
@samnewman#geecon26
DB
Unit
UI
Service
@samnewman#geecon26
DB
Unit
UI
Service
@samnewman#geecon27
DB
Unit
UI
Service
@samnewman#geecon27
DB
Unit
UI
Service
@samnewman#geecon27
DB
Unit
UI
Service
@samnewman#xpdays
InventoryAccounts
Returns
Invoicing
Shipping
Customer Service
@samnewman#xpdays
InventoryAccounts
Returns
Invoicing
Shipping
Customer Service
Inventory
@samnewman#xpdays
InventoryAccounts
Returns
Invoicing
Shipping
Customer Service
Inventory
@samnewman#xpdays
Shipping
InventoryAccounts
Returns
Invoicing
Customer Service
@samnewman#xpdays
Shipping
InventoryAccounts
Returns
Invoicing
Customer Service
@samnewman#xpdays
Shipping
InventoryAccounts
Returns
Invoicing
Customer Service
@samnewman#xpdays
Shipping
InventoryAccounts
Returns
Invoicing
Customer Service
@samnewman#xpdays
Shipping
InventoryAccounts
Returns
Invoicing
Customer Service
@samnewman#xpdays
@samnewman#xpdays
Browsers
@samnewman#xpdays
Timing
Browsers
@samnewman#xpdays
Provisioning of Environments
Timing
Browsers
@samnewman#xpdays
Provisioning of Environments
Networks
Timing
Browsers
@samnewman#xpdays
Deployment
Provisioning of Environments
Networks
Timing
Browsers
@samnewman#xpdays
Deployment
Provisioning of Environments
Networks
Timing
Browsers Diagnosis
@samnewman#xpdays
Shipping Inventory
CONSUMER-DRIVEN CONTRACTS
@samnewman#xpdays
Expectations
Shipping Inventory
CONSUMER-DRIVEN CONTRACTS
@samnewman#xpdays
Expectations
Shipping Inventory
CONSUMER-DRIVEN CONTRACTS
@samnewman#xpdays
Expectations
Prod
Shipping Inventory
CONSUMER-DRIVEN CONTRACTS
@samnewman#xpdays
Expectations
Prod
Shipping Inventory
CONSUMER-DRIVEN CONTRACTS
@samnewman#xpdays
@samnewman#xpdays
https://github.com/realestate-com-au/pact
@samnewman#xpdays
No Integration Tests?
@samnewman#xpdays
Journeys
@samnewman#xpdays
Testing
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests Production
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests Production
Monitoring & Alerting
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests Production
Monitoring & Alerting
Testers
@samnewman#xpdays
Testing
S/M TestsBuild Large Tests Production
Monitoring & Alerting
Testers Operations
@samnewman#xpdays
Monitoring & AlertingTesting
@samnewman#xpdays
Prod
Prod
Prod
Prod
@samnewman#xpdays
Prod
Prod
Prod
Prod
QA
@samnewman#xpdays
Monitoring & Alerting
Testing
@samnewman#xpdays
Monitoring & Alerting
Testing
@samnewman#xpdays
Monitoring & Alerting
Testing
@samnewman#xpdays
Monitoring & Alerting
Testing
@samnewman#xpdays
@samnewman#xpdays
@samnewman#xpdays
SEMANTIC MONITORING
@samnewman#xpdayshttps://www.flickr.com/photos/robdray/3138644233
@samnewman#xpdays
Testing
Deployment
@samnewman#xpdays
Testing
Deployment
One-server per host
@samnewman#xpdays
Testing
Deployment
One-server per host
Image/docker based artefacts
@samnewman#xpdays
Testing
Deployment
One-server per host Immutable ServersImage/docker
based artefacts
@samnewman#xpdays
Testing
Pre-Release Validation
Consumer-driven Contracts
Isolated Service Tests
Journey Tests
Deployment
One-server per host Immutable ServersImage/docker
based artefacts
@samnewman#xpdays
Testing
Post-Release Validation
Semantic Monitoring
Pre-Release Validation
Consumer-driven Contracts
Isolated Service Tests
Journey Tests
Deployment
One-server per host Immutable ServersImage/docker
based artefacts
@samnewman#xpdays
Sam Newman
Building MicroservicesDESIGNING FINE-GRAINED SYSTEMS
http://buildingmicroservices.com/
Code: AUTHD
Sam Newman @samnewman
THANKS!