advanced topics in agile testing - the future - agile testing days 2014

55
Advanced Topics in Agile Tes0ng Agile Tes0ng Days 2014 Lisa Crispin and Janet Gregory Agile Tes)ng: A Prac)cal Guide for Testers and Agile Teams More Agile Tes)ng: Learning Journeys for the Whole Team

Upload: lisacrispin

Post on 02-Jul-2015

1.077 views

Category:

Technology


3 download

DESCRIPTION

Slides for Janet Gregory and Lisa Crispin's workshop

TRANSCRIPT

Page 1: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Advanced  Topics  in  Agile  Tes0ng  Agile  Tes0ng  Days  2014  

Lisa  Crispin  and  Janet  Gregory  Agile  Tes)ng:  A  Prac)cal  Guide  for  Testers  and  Agile  Teams  More  Agile  Tes)ng:  Learning  Journeys  for  the  Whole  Team  

Page 2: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

A  li=le  about  us  

Janet  First  agile  team:    2000  

Currently  coaching,    training  Twi=er:    janetgregoryca  

Email:  [email protected]  

Agile  Tes0ng;  2009  More  Agile  Tes0ng:  Oct  2014  

Website:    www.agiletester.com    www.agiletester.ca  

Lisa      First  agile  team  –  2000  

Currently    tes0ng  at  Piviotal  Tracker  Twi=er:    lisacrispin  

Email:  [email protected]  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 3: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

The  Day…  Maybe!  

1.  Introduc0ons  2.  What  do  we  want  to  talk  about?  3.  Priori0ze  the  topics  4.  Start  tackling  one  problem  at  a  0me,  using  

different  brainstorming  techniques  

5.  Perhaps  0me  at  the  end  for  general  discussion  or  mini-­‐open  space  for  topics  not  discussed  earlier  

   

 

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 4: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Collabora0ve,    problem  solving  a_tude,  open  •  Workshop  –  explore  some  new  fron0ers!  •  Some  slides  –  if  we  need  them  for  

explana0on  •  You’ll  leave  with  some  experiments  to  help  

with  your  biggest  problems  and  goals    

Expecta0ons  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 5: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

What  might  we  talk  about?  It’s  up  to  you!  

•  Skills  needed  •  Selec0ng  tools  •  Technical  debt  •  Automa0on  •  Pairing  pa=erns  •  Exploratory  tes0ng  •  Experimen0ng  •  Agile  tes0ng  quadrants  

     

 

Tes)ng  in:    •  distributed  teams  •  with  out-­‐sourcing  •  enterprise  environments  •  data  warehousing  /  BI  •  regulatory  environments  •  embedded  systems  •  mobile  apps  

Others?????  Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 6: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Introduc0ons  

•  What  is  your  specialty?    

•  What’s  your  goal  for  today?  

•  Self  organize  into  table  groups!  If  possible,  get  some  diverse  special0es.    

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 7: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Let’s  get  started  …    •  Use  the  s0cky  notes  on  the  tables  to  iden0fy  your  problems  

•  Try  be  specific  because  we’ll  be  grouping  them  later  

 

7  

Page 8: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Now  …    Let’s  priori0ze  Put  your  s0ckies  on  the  wall  chart  

Group  similar  issues  Dot  vote  for  your  “favorites”  (three  votes  each)      

8  

Page 9: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Next…  •  Set  SMART  goals  for  the  top  3  problems  we  have  iden0fied.  

•  What  might  be  a  measure  for  each.  

20  minutes  

Page 10: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

4  Problems  –  4  Approaches  

Brainstorming  techniques  experimenta0on  –  to  help  achieve  goals  –  to  reduce  problem  size  

Techniques  we’ll  experiment  with  are:  1.  Impact  mapping  2.  Brain  wri0ng  3.  Communica0ng  around  a  whiteboard:  drawing,  mind  

mapping,  flow  diagrams  4.  Brain  wri0ng  with  a  twist    

Debrief  on  each  technique,  sharing  stories  and  experiences,  possibly  short  exercises  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 11: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  1:  Impact  Mapping  –  Gojko  Adzic  

•  Why  are  we  doing  this?                        -­‐-­‐-­‐  the  goal  •  Who  can  help  or  hinder?                    -­‐-­‐-­‐  the  stakeholders  •  How  can  they  help  or  hinder?  -­‐-­‐-­‐  the  impacts!  •  What  can  we  do  to  help?                  -­‐-­‐-­‐  the  deliverables      

 

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 12: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Impact  Map  Example  

Page 13: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Problem  #1  on  our  list  

Use  impact  mapping  to  help  iden0fy  possible  solu0ons  1.  Take  your  group’s  highest  priority  goal.  That’s  

the  Why?  of  your  impact  map.  2.  Create  an  impact  map  with  Whos,  and    

Hows  for  each  Who,  and  Whats  for  each  How.        

3.  What’s  the  first  experiment  you’d  try?  Choose  one  path  in  the  map  to  share  with  other  groups.  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

15  minutes  

Page 14: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  1:  Outcomes  –  Impact  Mapping  

•  What  experiments  do  you  want  to  try?  •  Any  interes0ng  stories?  •  Any  outstanding  ques0ons?  

•  Any  surprises  about  using  impact  mapping?  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 15: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  2:  Brain  Wri0ng  

What  is  brain  wri0ng?  •  It’s  a  way  to  share  your  ideas  in  wri0ng  and  for  others  to  add  theirs  

 h=ps://en.wikipedia.org/wiki/6-­‐3-­‐5_Brainwri0ng  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 16: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Problem  #2  on  your  list  

Use  brain  wri0ng  to  help  iden0fy  possible  solu0ons  1.  Each  of  you  take  a  sheet  of  paper.  2.  Write  your  ideas  for  ways  to  work  towards  the  

goal  on  the  paper.  3.  Ater  three  minutes,  pass  your  paper  to  the  

next  person.  (we’ll  call  0me)  4.  Read  the  ideas  on  the  paper  you  got,  and  add  

more  of  your  own.  5.  Con0nue  un0l  each  person  has  wri=en  on  each  

paper.    

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

20  minutes  

Page 17: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  2:  Outcomes  –  Brain  Wri0ng  

•  What  experiments  do  you  want  to  try?  •  Any  interes0ng  stories?  •  Any  outstanding  ques0ons?  

•  Any  surprises  about  using  brain  wri0ng?  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 18: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  3:  Using  a  Whiteboard  

It’s  about  :  •  Collabora0ng  •  Visualizing  •  Asking  ques0ons  •  Clarifying  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 19: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Sub  topic  

Sub  topic  

Sub  topic  

Mind  Mapping  as  a  Tool  

MAIN  TOPIC  

Sub  topic  

Sub  topic  

first  &me  

change  

new  account  

password  rules  

encryp&on  

save   user  name  

rules  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 20: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Problem  #3  on  your  list  Use  the  flip  chart  paper  to  draw  to  help  clarify  ideas  and  generate  possible  solu0ons  

1.  Gather  around  the  flip  chart  paper  2.  Start  discussing  ideas  for  working  towards  the  goal.  

Draw  as  you  talk.  You  can  draw  a  mind  map,  flow  diagram,  pictures,  whatever  helps  you  think.  

3.  Capture  ideas  and  experiments  to  try  

  15  minutes  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 21: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  3:  Outcomes  -­‐  Drawing  

•  Did  drawing  help?  •  What  experiments  or  ideas  did  you  capture?  •  Any  interes0ng  stories?  •  Any  outstanding  ques0ons?  

•  Any  surprises  about  drawing?  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 22: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  4:    Brain  Wri0ng  with  a  Twist  Use  other  groups  to  help  iden0fy  possible  solu0ons    

15  minutes  Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 23: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Choose  your  next  problem  1.  Start  on  your  flipchart  2.  Write  your  ideas  for  ways  to  work  towards  the  

goal.  3.  Ater  five-­‐ten  minutes,  move  right  to  the  next  

team’s  flip  chart    (we’ll  call  0me)  4.  Read  the  problem/goal  and  the  ideas  wri=en  

down,  and  add  more  of  your  own.  5.  Con0nue  for  3  rounds  

  30  minutes  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 24: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Round  4:  Outcomes  -­‐  

•  Take  a  look  at  all  the  ideas  •  Can  you  turn  those  ideas  into  realis0c  experiments  to  try?    

•  Any  surprises  about  this  way  of  thinking?  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 25: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

What’s  next?  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 26: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  The  following  slides  may  be  helpful  for  topics  we  discussed  or  for  future  reference.  

•  We’ll  write  down  resources,  and  there’s  a  separate  list  of  useful  links  

More  Resources  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

•  Guiding  development  with  examples  •  Tes0ng  •  Automa0on  tools  •  Learning  /  skills  

Page 27: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

√  

Page 28: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

ATDD  (Acceptance  Test  Driven  Development)  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 29: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

The  discussion  is  the  important  part  •  Try  this  in  your  groups  –  discuss  this  word  

•  Think  of  different  aspects  •  How  many  different  perspec0ves  can  you  get?  •  Does  it  have  different  consequences  based  on  how  you  use  it?  

Page 30: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Pairing  for  Tes&ng  Tester-Designer

Tester-Support

Tester-Tester

Tester-Coder

Analyst, DBA, Sys Admin, Customer…

Tester-Marketer

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 31: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Story  Mapping  

Ac0vi0es  by  0me  

Child  Storie

s  

From  Janet  Gregory  &  MaA  Barcomb  

Jeff  Pa=on:  h=p://www.agileproductdesign.com/blog/the_new_backlog.html  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 32: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Story  Mapping  

Example  Story  Map  From  Steve  Rogalsky  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 33: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Let’s  Talk  Tes&ng  ….  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 34: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

34

Agile  Tes0ng  Quadrants                

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 35: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Varia0on  from  Gojko  Adzic  Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 36: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Think  Tes&ng  at  Different  Levels  of  Precision  

Page 37: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Test  Automa0on  Volcano  

Original  idea  from  Ma=  Barcomb;  

Image  by  Jenn  Sinclair  Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 38: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

The  key  is  “sustainable  pace”  

Technical  debt  slows  us  down    

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 39: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Whole  team  =  project  team  

•  Team  is  responsible  for  tes0ng  ac0vi0es  

–  Includes  automa0on  

•  Whole  team  has  all  the  skills  needed  

•  Team  designs  for  ease  of  test  automa0on  

•  Whole  team  is  ‘automa0on-­‐infected’  

Whole  Team  Approach  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 40: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Choosing  Your  Tools  

One  size  does  not  fit  all  !  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 41: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Focus  on  the  problem,  not  the  tool  •  What’s  being  automated?  •  What  are  the  exis0ng  tools,  environment?  •  What  is  the  life  span,  or  future  use  of  tests  

Understand  the  Purpose  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 42: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Exis0ng  skills  on  the  team  •  Who’s  doing  what?  •  What  are  your  constraints?  •  Language  of  the  applica0on  under  test  

What  Fits  Your  Situa0on  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 43: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Enables  testers  /  business  to  define  tests  

•  test  code  can  be  in  programming  language  

•  Programmers  can  run  tests  as  they  code  

•  Testers  can  ask  programmers  for  help  

•  Takes  0me  from  ‘coding’  produc0on  code  

•  Tests  are  usually  through  the  UI  

•  Programmers  aren’t  usually  willing  to  help  

•  Tests  are  implemented  ater  the  code  is  wri=en  

•  Testers  create  and  implement  all  tests  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 44: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014
Page 45: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

•  Business  readable  •  Once  passing,  must  always  pass  

Tests  as  Living  Documenta0on  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 46: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Learning  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 47: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Mul0-­‐  discipline  skills  

Expert  /  Discipline  skills  

T-­‐Shaped  Skills  

Page 48: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Breadth of Skills

Dep

th o

f Ski

lls

Square-­‐shaped  Team  

See  links  for  more  by  Rob  Lambert  and  Adam  P.  Knight  

Page 49: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Context  Sensi0vity  

Large  organiza0ons  

Page 50: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Supportive Culture

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 51: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

The right infrastructure

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 52: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

The right people

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 53: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

1.  Use  real  examples  2.  Perform  exploratory  tes0ng  3.  Test  your  features  (and  the  system)  4.  Learn  con0nually  5.  Sensi0vity  to  your  context  6.  Keep  it  real  

Confidence  Building  Prac0ces  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 54: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

References  

See  the  “Recommended  Resources”  handout  

Advanced  Topics  on  Agile  Tes0ng:  Lisa  Crispin  &  Janet  Gregory  

Page 55: Advanced Topics in Agile Testing - The Future - Agile Testing Days 2014

Currently  Available  Agile  Tes)ng:  A  Prac)cal  Guide  for  Testers  and  Agile  Teams  

By  Lisa  Crispin  and  Janet  Gregory    

www.janetgregory.ca  email:  [email protected]  

Twi=er:  @janetgregoryca  55  

Soon  Available  More  Agile  Tes)ng:  Learning  Journeys  for  the  Whole  Team  By  Janet  Gregory  and  Lisa  Crispin  www.agiletester.ca    www.agiletester.com    

lisacrispin.com  email:  [email protected]  

Twi=er:  @lisacrispin