agile testing techniques - wordpress.com · 2010-12-09 · agile testing techniques how to...

28
Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Upload: others

Post on 23-Jul-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Agile Testing Techniques

How to Incorporate Testers onto Agile Teams

Alex Kell 12/2010 Twitter: @wiggly

Blog: ManageToTest.com

Page 2: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Testers are like tigers

Photo by Michelle Meiklejohn

Page 3: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

The Problem

AGILE!

Page 4: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Agile Testing Quadrants

Slightly modified from Crispin/Gregory “Agile Testing – A Practical Guide for Testers and Agile Teams”

Copyright © 2009

Page 5: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Slightly modified from Crispin/Gregory “Agile Testing – A Practical Guide for Testers and Agile Teams”

Copyright © 2009

Page 6: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

The Automation Pyramid

1 hour of testing at code complete

equals 24 hours of testing 3 weeks

later.

- Jeff Sutherland

Copyright © 2007 Bob Galen

Page 7: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

We need automated tests to provide fast

feedback.

Someone needs to write these tests.

It has the word “test” in it, so it must belong

to the QA/Test group.

The QA/Test group doesn’t have much in

the way of programming skills. Copyright © 2010 Elisabeth Hendrickson post on July 26th (http://www.testobsessed.com)

Page 8: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

No So, do testers need to be programmers?

But it can help.

Page 9: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Dev Shadowing/Pairing

Testers and Devs…together!

Page 10: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Test/Build Integration

Check-In

Unit tests

Code-level automated tests (if fast)

Migration

All automated tests (including GUI)

Page 11: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Slightly modified from Crispin/Gregory “Agile Testing – A Practical Guide for Testers and Agile Teams”

Copyright © 2009

Page 12: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Story Acceptance Test Collaboration

• Check for gaps

• Clarify, clarify, clarify

The Tester must drive the process!

• Verify Testability

Page 13: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Tester Inclusion!

Page 14: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Automation

• Should it be automated?

• How will it be automated?

Page 15: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Automation:

• Encourages Experimentation and Innovation

• Is fast and persistent

• Allows for deeper and wider Exploration

• Is not free…

Page 16: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

ROI of Automation

Copyright © 2003-2008 Gerard Meszaros

“Goals of Test Automation” – http://xUnitpatterns.com

Page 17: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Slightly modified from Crispin/Gregory “Agile Testing – A Practical Guide for Testers and Agile Teams”

Copyright © 2009

Page 18: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Exploratory Testing

• Vs. Automation

• Discover tests, seek problems

• Vs. Scripted Testing

• Frequent feedback

Emphasizes individuals and interactions over processes and tools

Emphasizes responding to change over following a plan

Emphasizes working software over comprehensive documentation

Emphasizes customer collaboration over negotiated contracts

Page 19: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Session-Based Testing

Page 20: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Slightly modified from Crispin/Gregory “Agile Testing – A Practical Guide for Testers and Agile Teams”

Copyright © 2009

Page 21: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

Four Basic Questions

• How Fast?

• How Long?

• How Often?

• How Much?

Performance

Stability

Reliability

Scalability

Page 22: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

What did you say again? • Use the “Whole Team Approach”

• Get testers involved in all phases

• Continuous Integration

• Automation

• For feedback and to aid testing

• Executable Specifications

• Techniques

• Pairing

• Exploratory Testing (and SBTM)

• Time for learning

• Do Performance/”ilities” continuously

Page 23: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

What we do

Page 24: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com
Page 25: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com
Page 26: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com
Page 27: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com
Page 28: Agile Testing Techniques - WordPress.com · 2010-12-09 · Agile Testing Techniques How to Incorporate Testers onto Agile Teams Alex Kell 12/2010 Twitter: @wiggly Blog: ManageToTest.com

References • Lisa Crispin, Janet Gregory – Agile Testing – A Practical Guide for Testers and

Agile Teams

• Brian Marick – http://www.exampler.com

• Michael Bolton – http://www.developsense.com/

• Matt Heusser – http://xndev.blogspot.com/

• Elisabeth Hendrickson – http://testobsessed.com/

• “Goals of Test Automation” – http://xUnitpatterns.com

• Selenesse -- http://chrismcmahonsblog.blogspot.com/2009/12/selenesse-nee-webtest.html

Contact info -- Alex Kell • @wiggly – Twitter

[email protected]

• http://ManageToTest.com