building devops with beer & whiteboards
DESCRIPTION
Velocity 2013 - How Edmunds learned from failure, begin opening communications between silos, and build a DevOps culture over beer and whiteboards. (HINT: Download to see the presenter's notes for what may not make sense without a speaker!)TRANSCRIPT
BUILDING DEVOPS
WITHBEER AND
WHITEBOARDSJOHN MARTIN@tekBuddha
STEVE BURTON@BurtonSays
CALL OF DUTY:DEV OPS
the challenge
GAME SELECT
DEVELOPERDEVELOPER
OPERATIONSOPERATIONS
DEVOPSDEVOPS
NOOPSNOOPS
AA
DEVOPS
MISSION PARAMETERS:
MISSION OBJECTIVESKILL YOUR COMPETITORS
- DEVELOP, TEST, DEPLOY, OPERATE- AUTOMATION & BUSINESS AGILITY
RECOMMENDED ESSENTIALS BEER, WHITEBOARDS, COMMUNICATION
but what is success?
“success is going from failure to failure without
losing enthusiasm”
Winston Churchill
failure
mean time to innocence (MTTI)
mean time to resolution (MTTR)
Weeks, Days, Hours or Minutes?
mean time between failure (MTBF)
Weeks, Days, Hours or Minutes?
availability?
99.9%The most meaningless metric in IT today.
business metrics
> revenue
> throughput
> performance
> productivity
Edmunds.com
EXPERT CAR ADVICE
FOUNDED IN 1966
550 EMPLOYEES
650K DAILY UNIQUES
whoami
SR DIRECTOR PRODUCTION ENGINEERING
A DECADE SUPPORTING JAVA ARCHITECTURES
FUELED BY METRICS, WHITEBOARDS, LOGS, AND BEER
Our environment.
Compelling Events
Source: http://is.gd/iJU4et
Growing Pains
Communication
2010 Redesign
Source: http://is.gd/L77vl1
COMPLETE REWRITE OF PLATFORM
QA & BETA WORKED GREAT!
BETA BECOMES PROD
3 MONTHS IN A WAR ROOM
LIKE THIS
Source: http://is.gd/iJU4et
IN TO HERE
Source: http://is.gd/iJU4et
ONE OF THE MOST UNDER RATED TOOLS YOU ALREADY HAVE.
THE WHITEBOARD
The Toolshed
Communicating with Metrics
Source: http://is.gd/L77vl1
DATA DRIVEN CULTURE
CHECK THE GUT
DRIVE ACCOUNTABILITY
LEARN FROM FAILURE
Putting It All Together
Source: http://is.gd/L77vl1
UNCHARTED WATERS
FAMILIAR TOOLING
IMPROVED COMMUNICATIONS
MEASURABLE SUCCESS STORIES
The Business Proposition
Source: http://is.gd/L77vl1
THE CLOUD ISN’T FREE
COST PER HOST CAN GET SCARY
LOOK FOR THE FREEBIES
AWESOMENESS
Source: http://is.gd/iJU4et
Measuring Success
Source: http://is.gd/L77vl1
Before After Benefit $ Savings
Application Availability % 99.91% 99.95% > 0.04% $167k revenue protection
# of High Severity Incidents 21 10 < 50% $307k productivity
# of Help desk Tickets 196 99 < 50%
MTTR in Pre-Production 5 Days 2 Days < 45% $320k productivity
Time To Build Runways 3 Months < 1 Week Seriously?!
Operating Costs $$$$ TBD
Team Morale Bummered Beer
IN TO HERE
Source: http://is.gd/iJU4et
JOHN [email protected]@tekBuddha
STEVE [email protected]@BurtonSays
QUESTIONS?We’re hiring!
Stop by our booth!