carl shaulis agile_td2014

27
INJECT TESTING TO ACHIEVE CONTINUOUS DEPLOYMENT Carl Shaulis - HomeAway

Upload: carl-shaulis

Post on 05-Jul-2015

59 views

Category:

Presentations & Public Speaking


0 download

DESCRIPTION

Slides for presentation at Agile Testing Days 2014

TRANSCRIPT

Page 1: Carl shaulis agile_td2014

INJECT TESTING TO ACHIEVE CONTINUOUS DEPLOYMENT

Carl Shaulis - HomeAway

Page 2: Carl shaulis agile_td2014
Page 3: Carl shaulis agile_td2014

What are the Goals of Continuous Delivery?

• Better Quality Software

• Find and Fix Defects Faster

• Automated Feedback loops throughout the delivery pipeline

• Make informed decisions using KPIs and positively influence them faster

• Less Outages

• Less Errors due to mismatched configurations

• Minimize human error from the deployment equation

Page 4: Carl shaulis agile_td2014

Foundations for Continuous Delivery

• Design

• Develop

• Accept

• Automate

• Monitor

• Perform

• Immunize

Page 5: Carl shaulis agile_td2014
Page 6: Carl shaulis agile_td2014

• Drive the collaboration

• Frequently ask questions

• Demonstrate the testing work (skills)

• Be involved in the entire process

• Be willing to step outside your comfort

zone

• Facilitate Excellence

Page 7: Carl shaulis agile_td2014
Page 8: Carl shaulis agile_td2014

Design

• “Foster testability as we build with change in

mind” : Michael Bolton

• Articulate your opinion

• Ask Questions (primary actions)

• Locators (CSS, XPath, IDs)

• Importance of Responsive UI

• Mobile world accessibility attributes

Page 9: Carl shaulis agile_td2014
Page 10: Carl shaulis agile_td2014

White Box

• Pairing

• Unit Test Review

• Heuristics Inputs: Elizabeth Hendrickon

• Assertions

• Fearless of Code

• Advocate for coverage growth

Page 11: Carl shaulis agile_td2014
Page 12: Carl shaulis agile_td2014

Acceptance

• BDD - Cucumber

• Write Test Ideas before the code

• Collaborate -“Three Amigos”

• Apply SBTM

• Rapidly test

• Share the Results

Page 13: Carl shaulis agile_td2014
Page 14: Carl shaulis agile_td2014

Automation

• Learn to write code

• Collaborate with others

• Document critical actions

• Design important flows

• Automate Layers

• Demonstrate your code

• Teach the team

Page 15: Carl shaulis agile_td2014
Page 16: Carl shaulis agile_td2014

Monitoring

• Actively review logs

• Production Automation

• Explore the Data

• Participate in Active Alerting

• Collaborate on KPI’s

Page 17: Carl shaulis agile_td2014
Page 18: Carl shaulis agile_td2014

Performance

• JMeter - HASTE

• Blazemeter

• Load Runner

• OpenSTA

• Netgend

• SoapUI

• Emphasize Performance

• Test Performance

• Develop Complex Scripts

• Collaborate with the team

• Form repeatable mechanics

• Critical analyze the results

Page 19: Carl shaulis agile_td2014
Page 20: Carl shaulis agile_td2014

Multi-Variant

• Understand the purpose

• Help design the experiment

• Very the configurations

• Analyze the results

• Challenge the results

Page 21: Carl shaulis agile_td2014
Page 22: Carl shaulis agile_td2014

Immunization

• Trust automation

• Communicate

• React Quickly

Page 23: Carl shaulis agile_td2014
Page 24: Carl shaulis agile_td2014

Deliver

• Be the glue that unites the team

• Start your testing at Design

• Assist the team with Unit test review

• Rapidly provide feedback on new stories

• Actively plan, build, execute automation

• Acute & timely testing sessions

• React to changes in KPIs

• Know the performance of the system

• Understand objectives and results of A/B Testing

• Do not be afraid to immediately roll back a release

Page 25: Carl shaulis agile_td2014
Page 26: Carl shaulis agile_td2014

–Carl L. Shaulis

“Thank you”

Page 27: Carl shaulis agile_td2014

referenceshttp://testobsessed.com/

http://www.satisfice.com/sbtm/

https://saucelabs.com