black and white: software testing for scientists...

Commercial in Confidence | Assurity Consulting Limited 2013

Black and white: Software testing for scientists

Let’s Test Oz 2014

Katrina Clokie @katrina_tester




Introduction Visualising

Strategy

Visual

Modelling

Session Based

Test

Management


Context

• Test consultant embedded in a scrum team for three days a week

• Create cross-skilled resources by training the existing team of

developers, business analysts and subject matter experts in testing

• Specialist financial domain

• Team was University educated

> Economics & Finance

> Mathematics

> Computer Science


100% Automation


Testing 101 Workshop



Strategy

Visual

Modelling

Session Based

Test

Management




Testing 101 Workshop


IDEA PRODUCTION


In our test strategy and we’re doing it

In our test strategy and we’re not doing it

Not in our test strategy, but should be

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing



Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro


Starting Together



Strategy

Visual

Modelling

Session Based

Test

Management




Think Talk Act

What do you think this does?

Does everyone agree that’s all?

How are you going to test this?

Are you happy that this testing will mean the story is done?


Test Ideas

• That the acceptance criteria are met

• That each function does what it is supposed to do (positive testing)

• The problems that each function could have (negative testing)

• Input data for typical, boundary and invalid cases

• Output data for typical, boundary and invalid cases

• A flow through the system, with functions in different orders

Reference: Bach, James (2013). Heuristic Test Strategy Model


What should we automate?

• What matters most?

• Are there any problems with high impact?

• Are there any problems with high probability?

Reference: Marick, Brian (1998). When should a test be automated?


The greatest enemy of knowledge is not ignorance, but the illusion of knowledge

Stephen Hawking



Strategy

Visual

Modelling

Session Based

Test

Management




Manual Testing Tasks


Session Based Test Management


Peer Review


What happened?

• Multiple manual testing tasks for a story

• Focused investigation with consistent reporting

• Review improved testing by creating competition

• Increased SME confidence in testing by the team

• Reduced duplication


Conclusion

Disaster

Recovery Unit

Testing

Exploratory

Testing

Component

Testing

Integration

Testing

System

Testing

Automated

Testing

Regression

Testing

Specification

Workshops

SME

Interaction

SpecFlow

Testing

Manual

Testing

Mind Maps

Package

Testing

End-to-End

Testing

Acceptance

Testing

Manual

Testing

Security

Testing

Availability

Operations

Performance

Testing

Usability

Release

Testing

Parallel

Testing



Not in our test strategy, but should be Read more: http://tiny.cc/teststrategyretro


Session Based Test Management



Let’s Test Oz 2014


black and white: software testing for scientists...

Documents