microsoft developer division’s transformation to...
TRANSCRIPT
![Page 1: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/1.jpg)
Microsoft Developer Division’s Transformation to DevOps
![Page 2: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/2.jpg)
![Page 3: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/3.jpg)
Continuous Value Delivery
![Page 4: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/4.jpg)
Continuous Delivery?
![Page 5: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/5.jpg)
Visual Studio& TFS
Update 2
Visual Studio& TFS
Update 3
Visual Studio& TFS
Update N
Visual Studio Online
One Code Base with Multiple Delivery Streams
![Page 6: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/6.jpg)
Let‘s talk about transforming our Organization…..
![Page 7: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/7.jpg)
DevOps Lifecycle
![Page 8: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/8.jpg)
Looking back....
![Page 9: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/9.jpg)
Before - Quality
Code Test & Stabilize Code Test & Stabilize
Beta
Code
Complete
RTM
Planning
![Page 10: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/10.jpg)
Before - Debt
![Page 11: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/11.jpg)
Adopting Agile
![Page 12: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/12.jpg)
Roles
Organization
Teams
Cadence
Plan
Practices
Guiding principles
Alignment
Autonomy
![Page 13: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/13.jpg)
Organization
Program Management Development QA
![Page 14: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/14.jpg)
Organization - New
Program Management Engineering
![Page 15: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/15.jpg)
Cross discipline
8-12 people
Self managing
Autonomous backlog
Intact for 12-18 months
Physical team rooms
Teams
Version Control
![Page 16: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/16.jpg)
Team Rooms
![Page 17: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/17.jpg)
Vision
18 month vision
Planning Horizons
Sprint
3-week sprints
Planning Chat
3 sprints
Season
6 month season
![Page 18: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/18.jpg)
Internal Sprint Cadence
6 weeks
10 – 12 weeks
3 weeks
![Page 19: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/19.jpg)
3 week Sprints
Sprint Planning
Backlog Grooming
Deployment!
Sprint Planning
Done!
Week 1 Week 2 Week 3
Week 1 Week 2 Week 3
![Page 20: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/20.jpg)
Sprint Mails
Week 1 Week 2 Week 3
Week 1 Week 2 Week 3Week 2 Week 3
Sprint 57Sprint 56 Sprint 58
The sprint plan What we accomplished
![Page 21: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/21.jpg)
Sprint mails
Plan Accomplished
![Page 22: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/22.jpg)
Vision
18 month vision
Planning Horizons
Sprint
3-week sprints
Planning Chat
3 sprints
Season
6 month season
![Page 23: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/23.jpg)
Continuous Planning & Learning
SpringFallSpring Fall
6 month plan
Experience
Reviews
18 month vision
Scenario
Review
Done!Done!
![Page 24: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/24.jpg)
What about the details?
![Page 25: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/25.jpg)
Experience
User Story
Task
Our Backlog
![Page 26: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/26.jpg)
DevOps Lifecycle
![Page 27: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/27.jpg)
Deployment automation
• Online operation – service stays up
• Fully automated
• Multiple versions must coexist peacefully
• Staged, incremental rollout
• Exposure control
• Feature flags and experiments
![Page 28: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/28.jpg)
Feature Flags
![Page 29: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/29.jpg)
Live Site Culture
![Page 30: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/30.jpg)
DevOps Lifecycle
![Page 31: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/31.jpg)
Live
Site
Culture
![Page 32: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/32.jpg)
![Page 33: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/33.jpg)
Our telemetry system collects rich data for both real-time and latent analysis
We needed 24x7 monitoring system that ran reliably all the timeParticularly when the service was down or misbehaving
![Page 34: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/34.jpg)
Activity Logs
TracesKPI
MetricsJob
HistoryCustomer
IntelligenceSynthetic
Perf Counters
Customer IntelligenceBusiness IntelligenceOperational Intelligence
DependentServices
![Page 35: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/35.jpg)
Perf Counters
ActivityLogging
TracesKPI
MetricsJob
HistoryCustomer
IntelligenceSynthetic
Customer IntelligenceBusiness IntelligenceOperational Intelligence
DependentServices
![Page 36: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/36.jpg)
Ping Mesh
ActivityLogging
TracesKPI
MetricsJob
HistoryCustomer
IntelligenceSynthetic
Perf Counters
Customer IntelligenceBusiness IntelligenceOperational Intelligence
![Page 37: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/37.jpg)
We follow a core principle: Fail Fast, Detect Fast and Recover Fast
Alerting is key to fast detection
![Page 38: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/38.jpg)
Alerting – making it right is not easy
We set alerting goalsEvery alert must be actionable and represent a real issue with the system.
Alerts should create a sense of urgency –false alerts dilutes that
But poor alerting makes DevOps unhappyRedundant alerts for same the issue
Needed to set right thresholds and tune often
Stateless alerts contributed to further noise
![Page 39: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/39.jpg)
Health model in action
• 3 errors for memory
and performance
• All 3 related to same
code defect
• APM component mapped to feature team
• Auto-dialer engaged Global DRI
Eliminated alert noise
~928 alerts per week to
~22 and reduced DRI
escalations by ~56%
![Page 40: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/40.jpg)
DevOps Lifecycle
![Page 41: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/41.jpg)
Hypothesis-driven development
HYPOTHESIS
EXPERIMENT (MVP)
LEARNING
MEASURE
![Page 42: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/42.jpg)
We believe developers want a simplified project creation experience so they can quickly leverage VSO and its rich development platform in the cloud.
HYPOTHESIS
Have a simplified project creation experience for web and IDE featuring smart defaults and contextual information.
EXPERIMENT
% of accounts creating a project the same day they created an account
LEARNING
Sample - Experiment
![Page 43: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/43.jpg)
Old project creation experience
Too many actions and distractions
preventing customers from taking
the next natural step of creating a
project.
![Page 44: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/44.jpg)
WEB
IDE
Experience
Focused project creation
experience and also
integrated in IDE flow
![Page 45: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/45.jpg)
Learnings
First project creation
jumps from 15% to 50%First account creation from IDE
jumped from 3% to 20%
Another experiment running in parallel
negated results
![Page 46: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/46.jpg)
Why?
• React to market/competitive changes quickly
• Maximize investments in what customers want
• Empower the Organization to be a great workplace
• Tight Customer Feedback loop
![Page 47: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/47.jpg)
Christian Binder
ALM Architect Microsoft
Twitter - @xcbinder
http://blogs.msdn.com/cbinder
![Page 48: Microsoft Developer Division’s Transformation to DevOpsdownload.microsoft.com/download/F/7/E/F7E9A431-DD1D-4082... · 2018-10-17 · Version Control. Team Rooms. Vision 18 month](https://reader033.vdocuments.us/reader033/viewer/2022060214/5f057f647e708231d41341e3/html5/thumbnails/48.jpg)