Develop your inner tester

Name: Anne-Marie CharrettE-mail: amcharrett@testingtimes.com.auWEB: www.testingtimes.com.au Phone: 0410560923

2

• Analytical• Eye For Detail • Skeptical

Tester Mindset

Can you work out the Rule ?Identify a rule that applies to series of triples of

numbers.For example the following series of numbers match the

rule• 2,4,6• 4,6,8• 6,8,10To find out what the rule is, construct other sets of three

numbers to test your assumptions I will tell you if they satisfy the rule or notIf you think you know the rule put your hand up.

Wason’s Discovery Rule

Pattern

The Rule is: Sequence of incremental numbers

21% of subjects did not find the solution in 45 mins

5

Challenge in Testing

• Confirmation Bias “Tendency for people to seek evidence to verify

their hypothesis rather than refute them”

Test to Pass instead of Test to Fail

Discredit your code......

6

Counter Balance

Logical Reasoning

StrategicHypothesis

Thinking

ConfirmationBias

7

Testing similar to Scientific Thinking

Testing = Determine Hypothesis + Test Hypothesis + Evaluate Hypothesis

Get better at determining Hypothesis or

In other words

Generate new testing ideas

Strategic Hypothesis Thinking

8

GENERATE NEW TESTING IDEAS

9

Different Models raise new questions == Different Hypothesis == Different Tests == Different Bugs

• What model does your customer have?

GENERATE NEW TESTING IDEAS

Quality is Value to Some PersonCapability Can it perform the required functions?Reliability Will it work well and resist failure in all required situations?Usability How easy is it for a real user to use the product?Performance How speedy and responsive is it?Installability How easily can it be installed onto its target platform?Compatibility How well does it work with external components &configurations?Supportability How economical will it be to provide support to users of theproduct?Testability How effectively can the product be tested?Maintainability How economical will it be to build, fix or enhance the product?Portability How economical will it be to port or reuse the technologyelsewhere?Localizability How economical will it be to publish the product in another language?

James Bach Heuristic Risk-Based Testing http://www.satisfice.com/articles/hrbt.pdf

Pen Exercise You’re mission is to test a pen.

Pen Exercise

Pen Tests Does it write? Does it write on paper? Other mediums?Does it leak? Is it the right colour? Does it write on an angleDoes it write upside down? Does it not write when I want it to? Does the clicker work? Does it run out of ink too soonDoes it take too long to get the ink flowing? Does this nib get sticky?

14

Lots of Models– Code Coverage– Requirements Model– Multiple Environments, Multiple Models

Infinite number of tests Could keep testing forever!!!And...the clock’s a tickin’

Problem - Exhaustive Testing

15

• Risk is context dependent• Capacity for Risk differs

*Perfect Software G.Weinberg

Risk Likelihood of Failure*

Least Testing Moderate Testing

Moderate Testing Most Testing

Consequence of Failure

One Risk ListComplex Anything disporportionality large, intricate or convolutedNew Anything that has no history in the productChanged Anything that has been tampered or "improved"Upsteam Dependency Anything whose failure will cause cascading failures in the rest of the systemDownstream Dependency Anything that is especially sensitive to failures in the rest of the systemCritical Anything whose failure could cause substantial damagePrecise Anything that must meet requirements exactlyStrategic Anything that has special importance to your business, such as a feature that sets you apart from the competitionThird-Party Anything used in the product, but developed outside of the projectDistributed Anything spread out in time or space, yet whose elements must work togetherBuggy Anything known to have lots of problemsRecent Failure Anything with a recent history of failure

James Bach Heuristic Risk-Based Testing http://www.satisfice.com/articles/hrbt.pdf

17

Review • Use different approaches – mix them up– Risk Based to Focus– Quality to Abstract Out– Creep & Leap Heuristic

• Test To Fail – Be Sceptical – Be critical

• Feedback – Peer Reviews– Pair up in Testing

• Decision Tree

FOCUS

DEFOCUS

Focus

Follow up

• Perfect Software – G M Weinberg• James Bach – Strategic & Critical Thinking• Mind Map of Testing Resources • Email me: amcharrett@testingtimes.com.au• FREE Online Coaching – skype: charretts

We would like to thank our sponsors and supporters for helping us bring you this event

Please complete the feedback form in your delegate pack for a chance to win some great

prizes.

Please remember to return the form before you enter the lock note, or leave the event.