![Page 1: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/1.jpg)
Is your Gatekeeper Locking out Quality?
Amy Phillips
Songkick
![Page 2: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/2.jpg)
Songkick - Track your favorite artists and never miss them live
Amy Phillips - Songkick - @itjustbroke
![Page 3: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/3.jpg)
Amy Phillips - Songkick - @itjustbroke
More than 500,000 people across the UK and Europe signed up
235,000 tickets sold
53,000 scalpers identified
![Page 4: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/4.jpg)
A story about moving to frequent releases
Amy Phillips - Songkick - @itjustbroke
![Page 5: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/5.jpg)
The problem with releases
• Pressure to deliver
• Tight timeframes
• Often infrequent
Amy Phillips - Songkick - @itjustbroke
![Page 6: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/6.jpg)
A typical release
Code Release candidate
Bug ReportBug
ReportBug
Report
Developer Build Manager Tester Ops Engineer
Release to Production
Sign off
Business Rep
Amy Phillips - Songkick - @itjustbroke
![Page 7: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/7.jpg)
But is this going to deliver quality?
Amy Phillips - Songkick - @itjustbroke
![Page 8: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/8.jpg)
What is Quality?
Do you consider LinkedIn to be a quality website?
Amy Phillips - Songkick - @itjustbroke
![Page 9: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/9.jpg)
Some comments on LinkedIn’s quality
Hardly any problems with it, no glitches. Nice UX and usability.
Bad UI, too many crashes and bugs. Overloaded with features.
It meets my needs but can be a hassle to use at times.
I have found it very buggy lately
Amy Phillips - Songkick - @itjustbroke
![Page 10: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/10.jpg)
What is Quality?
“Quality is value to some person who matters“
- Jerry Weinberg
Amy Phillips - Songkick - @itjustbroke
![Page 11: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/11.jpg)
What is Testing?
Tested = Checked + Explored
“You’re not done testing until you’ve checked that the software meets expectations and you’ve explored whether there are additional risks.”
- Elisabeth Hendrickson
Amy Phillips - Songkick - @itjustbroke
![Page 12: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/12.jpg)
The Gatekeeper process
Can I commit? Can I deploy? Can I release?
Automated integration test and build
Regression test Monitor
Release Commit
Code
Amy Phillips - Songkick - @itjustbroke
![Page 13: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/13.jpg)
The Gatekeeper process
Can I commit?Can I deploy? Can I release?
Automated integration test and build
Regression test Monitor
Release Commit
Code
Who broke the
build?
When will testing be
finished?
How important is this
bug?
When will this be released?
It doesn’t
work
Amy Phillips - Songkick - @itjustbroke
![Page 14: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/14.jpg)
What are we trying to achieve with releases?
Releases when we want them.
Deliver quality products to users.
Without the unexpected surprises of downtime, bugs, unhappy users.
Amy Phillips - Songkick - @itjustbroke
![Page 15: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/15.jpg)
A common problem
Releases require people from different teams to come together to make them happen.
We release something that doesn’t meet the requirements.
Somebody wants reassurance that the release will be successful.
Technical limitations make releases more difficult.
Amy Phillips - Songkick - @itjustbroke
![Page 16: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/16.jpg)
The Songkick Technology Team
Developers
Testers
Tech Ops
Designers
Product Managers
Cross functional teams, Agile approach
Service Oriented Architecture
Ruby on rails, Go, PHP, JavaScript, Java, C#, Swift
Amy Phillips - Songkick - @itjustbroke
![Page 17: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/17.jpg)
The Songkick Gatekeeper process
Automated integration test and build
Manual testing of feature and release Release Commit Code
CI Server Test Environment
~1 hour ~2 hours
Amy Phillips - Songkick - @itjustbroke
![Page 18: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/18.jpg)
Fix the right problem
Step 1 - Identify the single biggest (perceived) bottleneck. Remove it.
Step 2 - Identify the next biggest (perceived) bottleneck. Remove it.
Repeat until you run out of bottlenecks.
Amy Phillips - Songkick - @itjustbroke
![Page 19: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/19.jpg)
A DevOps Approach
Automated integration test and build
Automated release testing
Release Commit
Code
CI Server Test Environment
~20 minutes
Test Test Monitor
Developer Environment Production
Amy Phillips - Songkick - @itjustbroke
![Page 20: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/20.jpg)
The result: Releases month on month
0.00
28.0056.00
84.00
112.00140.00
Category Title
Mar Jul Nov Mar JulAmy Phillips - Songkick - @itjustbroke
![Page 21: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/21.jpg)
In Summary
Locking down a release process and introducing sign offs doesn’t guarantee quality.
Good quality doesn’t just mean bug-free.
Collaborative nature of DevOps can remove the need for gatekeepers AND improve quality.
Amy Phillips - Songkick - @itjustbroke
![Page 22: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/22.jpg)
Songkick is hiring
songkick.com/jobs
Amy Phillips - Songkick - @itjustbroke
![Page 23: DOES16 London - Amy Phillips - Is Your Gatekeeper Locking Out Quality?](https://reader031.vdocuments.us/reader031/viewer/2022030317/5a6678117f8b9a494c8b4715/html5/thumbnails/23.jpg)
Thanks!
Amy Phillips - Songkick - @itjustbroke