the tester role in the agile release train

6/2/2015

1

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

The Tester Role in the Agile Release TrainMalcolm Isaacs, June 2015

[email protected]

@MalcolmIsaacs

© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.2

Agenda

Introduction

The Agile Enterprise

Teams and Individuals

Roles

6/2/2015

2


Agenda

Introduction



Roles


Industry Trends

Source: 2014-15 World Quality Report, October 2014, from CapGemini, Sogeti and

HP

83 93

177

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

2013 2014

% of Organizations doing Agile Testing

At least some Agile testing No Agile approach

6/2/2015

3


Industry Trends

54%

57%

45%

43%

0% 20% 40% 60% 80% 100%

2013

2014

Involvement of Testers in App Delivery Lifecycle

Planning

ImplementationEarly stage Late stage


HP


Industry Trends

4%

6%

19%

26%

0%

5%

10%

15%

20%

25%

30%

2011 2012 2013 2014

Organizations with Fully-Operational Testing Centers of Excellence


HP

6/2/2015

4


Agenda

Introduction



Roles


Continuous agility throughout the organization


Implementation

Releas

e

Discovery

PORTFOL

IO

PROGRA

M

TEAM

6/2/2015

5


PORTFOL

IO

PROGRA

M

TEAM

Roles in the Agile Enterprise

Portfolio

OwnerEnterprise

Architect

Product

Manager

Project

Manager

Scrum

Master

Testers

Product

Manageme

nt

Release

Manageme

nt

Product

Owner

Devs

Agile

Team

Busines

s

Analyst

System

ArchitectUser

Experienc

e

Test

Architect

VP of

QualityVP of

Development

Testers DevOps

System

Team


PORTFOL

IO

PROGRA

M

TEAM

Who is Responsible for Quality in the Agile

Enterprise?

Portfolio

OwnerEnterprise

Architect

Product

Manager

Project

Manager

Scrum

Master

Testers

Product

Manageme

nt

Release

Manageme

nt

Product

Owner

Devs

Agile

Team

Busines

s

Analyst

System

ArchitectUser

Experienc

e

Test

Architect

VP of

QualityVP of

Development

Testers DevOps

System

Team

6/2/2015

6


PORTFOL

IO

PROGRA

M

TEAM

Who Actually Tests in the Agile Enterprise?

Portfolio

OwnerEnterprise

Architect

Product

Manager

Project

Manager

Scrum

Master

Testers

Product

Manageme

nt

Release

Manageme

nt

Product

Owner

Devs

Agile

Team

Busines

s

Analyst

System

ArchitectUser

Experienc

e

Test

Architect

VP of

QualityVP of

Development

Testers DevOps

System

Team


Agenda

Introduction



Roles

6/2/2015

7


Testers on the Agile Release Train

Agile

Teams

System

Team

Supportin

g Cast


Developers/Testers/DevTesters

Testers in the Agile Team

Contribute to Defining ‘Done’

Develop and execute test scripts

Testing frameworks and automated testing

Identify edge cases and prepare test data

Review testability

6/2/2015

8


Build Engineers, Integrators, Load Testers, End-to-End Testers

Testers in the System Team

Test-platforms and automation frameworks

Continuous Integration, Continuous Deployment

System integration

Testing end-to-end, Performance, etc

Cross-system concerns

System Team

Agile Team

Agile Team

Agile Team

Agile Team


Test Architect Automation Architect System Architect

User Experience Business Analyst Product Owner

Supporting Cast**Scott Ambler, Roles on Agile Teams

6/2/2015

9


Interactions

Tester

Developers

Product Owner

Scrum/Agile Master

System Architect

Test/Auto. Architect


Communities of Practice

Collaboration and knowledge sharing between teams

Team ATeam B

Team C

6/2/2015

10


Innovation and Planning Sprints


Agenda

Introduction



Roles

6/2/2015

11


Scope and Estimate


Help Define ‘Done’

Image: http://scalingsoftwareagilityblog.com/a-scalable-definition-of-

done

6/2/2015

12


Assess Testability

Image: https://www.flickr.com/photos/31690139@N02/2965956885/in/photostream, by chwalker01, under CC license:

https://creativecommons.org/licenses/by/2.0/


Design and Execute Test Cases

http://commons.wikimedia.org/wiki/File:Drive_test_(9787693024).jpg By Oregon Department of Transportation (Drive test Uploaded by AlbertHerring) [CC BY 2.0

(http://creativecommons.org/licenses/by/2.0 )], via Wikimedia Commons

6/2/2015

13


Automate

Image: http://www.getprice.com.au/gaggia-accademia-automatic-coffee-maker.htm


Collaborate

Image: http://despicableme.wikia.com/wiki/File:BO-

d5u_CMAAJdtR.jpg

6/2/2015

14


Verify Fixes

"CBP checking authenticity of a travel document" by James R. Tourtellotte, CBP, U.S. Dept. of Homeland Security - Original link:

http://www.cbp.gov/xp/cgov/newsroom/photo_gallery/afc/inspectors_airports/air_05.xml (file Air_5fphoto_5f05.jpg) Now available at: link. Licensed under Public Domain via Wikimedia Commons -

http://commons.wikimedia.org/wiki/File:CBP_checking_authenticity_of_a_travel_document.jpg#/media/File:CBP_checking_authenticity_of_a_travel_document.jpg


Attend Daily Stand-Up Meetings

6/2/2015

15


Track Different Metrics

http://upload.wikimedia.org/wikipedia/commons/0/05/SampleBurndownChart.png By Pablo Straub (Own work) [Public domain], via Wikimedia

Commons


Fail Fast, and Learn from Failure

"Paris Tuileries Garden Facepalm statue" by Alex E. Proimos - http://www.flickr.com/photos/proimos/4199675334/ . Licensed under CC BY 2.0 via Wikimedia Commons -

http://commons.wikimedia.org/wiki/File:Paris_Tuileries_Garden_Facepalm_statue.jpg#/media/File:Paris_Tuileries_Garden_Facepalm_statue.jpg

6/2/2015

16


Embrace Change

Image: http://www.slideshare.net/faro00oq/were-great-at-welcoming-change-but-suck-at-accommodating-

it

- Farooq Ali, Blank Canvas


Learn

Image: http://upload.wikimedia.org/wikipedia/commons/2/2b/Radcliffe_Camera%2C_Oxford_-_Oct_2006.jpg By Diliff (Own work) [GFDL (http://www.gnu.org/copyleft/fdl.html), CC-BY-SA-3.0

(http://creativecommons.org/licenses/by-sa/3.0/ ) or CC BY 2.5 (http://creativecommons.org/licenses/by/2.5 )], via Wikimedia Commons

6/2/2015

17


Adopt New Practices and Responsibilities

Image:

http://en.wikipedia.org/wiki/File:ST_TNG_Season_One_Cast.jp

g


Summary

Early Involvement

‘Done’ Collaborate

Teams Constraints Patience!

6/2/2015

18


Resources and Further Reading

• World Quality Report 2014-15 (HP, CapGemini, Sogeti)• http://www.capgemini.com/thought-leadership/world-quality-report-2014-15

• Scaled Agile Framework (SAFe)• http://scaledagileframework.com

• Roles on Agile Teams: From Small to Large Teams (Scott Ambler)• http://www.ambysoft.com/essays/agileRoles.html

• Meet Big Agile: Testing on Large-Scale Projects (Geoff Meyer, Dell, STAREast

2014) • http://www.agileconnection.com/presentation/meet-big-agile-testing-large-scale-projects

• The Three Pillars Approach to Your Agile Test Strategy (Bob Galen,

STAREast 2014)• http://www.agileconnection.com/presentation/three-pillars-approach-your-agile-test-strategy

• LinkedIn Groups: ‘QA in an Agile World’, ‘Agile Testing’


Thank you

6/2/2015

19


the tester role in the agile release train

Software

agile enterprise teams

agile testing

agile approach

hp copyright

individuals roles copyright

malcolmisaacs copyright

team roles

world quality report