Smoke TestingIntegration testing done right

or

Not integration testing

Michael Lyons - @michaellyons_

Work @ Paychoice (http://www.paychoice.com.au)◦ CIO – Chief information officer◦ CISO – Chief information security officer◦ SRE – Software reliability engineer

Paychoice is an Australian payment gateway that allows businesses to process credit card payments on their website

◦ Powering eCommerce websites◦ No internet merchant bank account needed◦ PCI DSS level 1 provider

Who am I?

Smoke testing refers to physical tests made to closed systems of pipes to test for leaks. By metaphorical extension, the term is also used for the first test made after assembly or repairs to a system, to provide some assurance that the system under test will not catastrophically fail.

After a smoke test proves that "the pipes will not leak, the keys seal properly, the circuit will not burn, or the software will not crash outright," the system is ready for more stressful testing.

http://en.wikipedia.org/wiki/Smoke_testing

Smoke Testing

Smoke testing is preliminary testing to reveal simple failures severe enough to reject a prospective software release

As the book “Lessons Learned in Software Testing“ puts it, “smoke tests broadly cover product features in a limited time ... if key features don't work or if key bugs haven't yet been fixed, your team won't waste further time installing or testing”

Smoke Testing means...

Microsoft claims that after code reviews, “smoke testing is the most cost effective method for identifying and fixing defects in software“

Lets your team know if your systems core functionality is working

Becomes a base for your regression testing

Why Smoke Test?

Smoke Testing @ PayChoice Online portal

Critical for users to see their reports and make online transactions through terminal facilities

Web service API’sCritical for merchants to send payment requests through to Paychoice

Example

Architecture

Page Object Generally powered by an

automation framework (eg Selenium)

Encapsulates functionality

Create a proxy for web services

Page Object

Test

Page objects do the heavy lifting and know how the site works

Tests become simplified and precise

Modified how a component works; update the page object

Maintainability

Security testing

Performance testing

User acceptance testing

Regression testing

Going further with smoke testing...