stackengine problem space demo
DESCRIPTION
Docker Adoption comes with a set of problems for productions operations. Tools simply do not exist for the problems a Not Pets, Not Cattle but Ants application topology comes with. StackEngine demos its Beta release in the context of each of these problems and how it proposes to address them.TRANSCRIPT
Managing Docker Applications in Production
Boyd E. Hemphill @behemphi @stackengine
History - BoydOracle Developer, MySQL DBA, PHP Developer, System Architect, DevOps Director (yea, really)
Started Austin DevOps In 2012
Co-Organizer of DevOps Days Austin
Became involved in Docker Austin in August.
Working with Docker for the first Docker Days Austin
Keep an eye on @stackengine to see if we can make it happen!
History -StackEngine
CopperEgg
Started in May 2014 to address problems arising due to Docker adoptions
Funding announcement October
Currently in private beta
Common Ground
What is The Goal of Your
Company?
What is The Goal of Your
Company?Make Money!
So … What is DevOps?
Is DevOps a Process?
Is it an intersection of overlapping concerns?
Is DevOps a Culture?
DevOps:
DevOps is the way in which a technology organization embeds itself in a business to the benefit of that business.
The Ideal Docker Application
Netflix (unicorn)Service Oriented Architecture
BenefitsIncrease developer velocity using containers to model application topology
Decrease build and test times using containers as build/test agents rather than VMs
Density - Reduce Costs
Separation of Concerns - “Code to an interface” moves to the infrastructure level
Taken together a company that can get to the end state has a significant and lasting competitive advantage
Today’s Docker Reality
ConcernsThis is still very early days for Docker
Tools to support Dockerized applications immature or do not exist
Service oriented architecture is hard
Increasing developer is only a local optima, thus a false economy
Its the first major DevOps initiative not driven by Ops.
SDLC
Developers are moving forward
QA sees production modeling and large test grids
Build engineers see easier build grids
Operations panics - no tools or instrumentation
The Final Mile
The Final Mile
Developer uses containers
System is built and images are produced
Images stored in a private repo
Now we need to deploy to a QA environment
Umm ….
Docker DeploymentCompleting the final mile
DeploymentContinuous Deployment was published in 2010
In general we still talk about build and integration, not deployment
This is true for all applications, not just those that are Dockerized
Docker promises A/B deployment
StackEngine is working on making A/B deployment a policy based activity
Container Sprawl
Container Sprawl
First there was VMware and suddenly a large corps departments could easily spin up environments
Then there was the cloud and developers could complete circumvent Ops
Now there is Docker and Developers are creating numerous abstractions that are not managed like traditional VMs
Containers on VMs on phyical hardware located in availability zones in data centers in geographic regions.
My Head HurtsContainer Sprawl
Inventory Management
Where’s My StuffHosts
Where’s My StuffImages
Where’s My StuffContainers
Telemetry
Telemetry
What does monitoring a docker app look like?
What does log aggregation look like?
Telemetry
Container size matters - blog
Log aggregation solution - blog
What’s my stuff (not) doing
Containers
What’s my stuff (not) doing
Containers
What’s my stuff (not) doing
Containers
Components
Components
Components are infrastructure abstractions (cloud provider, data center, docker registry, docker image)
Components can be arranged in logic ways to represent physical infrastructure.
Composing and AppComponents
Composing and AppComponents
Composing and AppComponents
Service Discovery
Service Discovery - Consistency Models
Zookeeper
Etcd / Consul
Chef Server / Heira
Service DiscoveryDue out in December
Allows multiple deployments of the same service on the same host.
Containers register themselves upon startup and are found by tags rather than URI’s, fixed ports, etc.
A step towards cattle containers instead of pet containers
Roadmap
Roadmap
Service Discovery
User Management
Addition of new Components
Better telemetry
Scheduling
A/B Deployment support
Live Product DemoAl Gore and his gremlins willing
Boyd Hemphill @behemphi
@stackengine
Thank You for Your Time and Comments.