HOW AND WHY IT WORKS

Agile QA at Etsy

1

Agenda

Main Section One

Main Section Two

Main Section Three

2

• About Etsy’s QA Team• What We Do• How We Work• Why It Works• What Makes This

Possible• Wrap Up

DISCLAIMER

There is no one way to achieve great software quality. The goal of this

presentation is to share our QA practices with you. Enjoy.

3

ABOUT THE TEAM• Centralized QA Function

• Promote Continuous Learning• Prevent Burnout• Refine Integration Testing Skills• Share Expertise & Practices

• Project Based Allocation• Team of QA Leads (not Analysts)

4

ABOUT THE TEAM• Roles

• PQ Analyst• QA Manager• Program Manager• Software Engineer in Test

5

WHAT WE DON’T DORegression/Specialized TestingDev/VM/Stage TestingTrack Standard MetricsMaintain Formal Test Case Suites

6

WHAT WE DON’T DORely on External QA ResourcesTeam Dedicated ResourcesTreat QA as a Gatekeeper

7

WHAT WE TESTNew Features and Products

Integration TestingExploratory TestingCross Platform Testing

8

WHAT WE TESTMobile Release VerificationsUser Impacting Changes

9

WHAT ELSE DO WE DO?AdvocacyEngagement/DogfoodingTraining & DevelopmentCareer Progression

10

HOW WE WORK

12

Production Testing

Production Testing

13

Minimize Deployment IssuesEffective Integration TestingVisibility Restriction

REMOVE FEAR & BLAME

14

REMOVE FEAR & BLAME

15

Concentration & Focus ImprovesReduce Repetition of ErrorComprehension IncreasesPromote Just Culture

COLLABORATION IS KEY

16

COLLABORATION IS KEY

17

Everyone is Seeking a Successful Outcome

Communication Flows FreelyEveryone is Doing Their Best

FEEDBACK OVER METRICS

18

FEEDBACK OVER METRICS

19

Adjust Actions to Desired Outcomes

Practice Objective FeedbackStrengthen Communication Skills

PERSONALIZED CAREER PATHS

20

PERSONALIZED CAREER PATHS

21

Growth in the Areas of StrengthDefining New Roles on the TeamTransition to a Different TeamTransition between IC and Management

LET GO AND TRUST

22

LET GO AND TRUST

23

Reduce Micromanagement (Back Off)

Be Available and ApproachableIncrease AccountabilityPromote Work/Life Balance

EMPOWER TEAM MEMBERS

24

EMPOWER TEAM MEMBERS

25

Instill a Sense of OwnershipBreed Motivation & CuriosityIncrease Employee Retention Rates

DO MORE WITH LESS

26

DO MORE WITH LESS

27

Group Test SessionsFacilitated TirekicksAdmin Rotation Sessions

HAVE FUN

28

HAVE FUN

29

Celebrate AchievementsReward GrowthAcknowledge Hard WorkTake Time to Reflect

WHY IT WORKS

31

Driven by values Fueled by a common purpose

Connected to community

Photo by Emily Andrews

WHY IT WORKS

WHY IT WORKSWe Invest in Role ComprehensionWe’re Stronger TogetherWe Value Work/Life BalanceWe Remove CompetitionWe Repeat What WorksWe Champion Learning/Growth

32

WHAT MAKES THIS POSSIBLE?

WHAT MAKES THIS POSSIBLEContinuous Integration/DeploymentUser ResearchPrototypingExperimentationSupport PracticeCollaborative Culture

34

Wrap Up

We DiscussedAdvantages of Centralized QA teamsThe Value of Feedback LoopsDo More With LessThe Power of CollaborationCareer DevelopmentRepeating Successful Strategies

36

37

THANK YOU!!