“create tests automatically? it’s possible!” practical model-based testing
TRANSCRIPT
ALM User Group
© Copyright SELA software & Education Labs Ltd. | 14-18 Baruch Hirsch St Bnei Brak, 51202 Israel | www.selagroup.com
May 2016
Natalia Meergus, Ilia German
“Create Tests Automatically? It’s possible!”Practical Model-Based Testing
AgendaMBT in a nutshell
Demo with Conformiq Creator
Q&A
Test automation evolutionManual
Automatic
Testdesign
Testexecution
Testing skills + Scripting skills + Modeling skills
Trad
ition
al m
anua
l te
stin
g
Trad
ition
al a
utom
atic
test
ing
Mod
el-
base
d te
stin
g
MBT idea
MBT output
Test SUT
Test Step
Expected Result
Test Step
Test Step
…Expected Result
A model
A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
A model and testsvoid test1(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
void test3(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Close();}
void test2(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Close();}
void test4(){ StartBrowser(); VerifyBrowserStarted(); EnterBaseUrl(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Login(); VerifyLogin(); Logout(); VerifyBaseUrl(); Close();}
MBT workflow
MBT tools
MaTeLo Conformiq Designer TestOptimal Atos TEMPPO Smartesting CertifyIt Conformiq Creator Elvior MOTES/TestCast MBTReactis MBTsuite Bender RBTGraphWalker NModel Microsoft SpecExplorer
ISTQB Certification MBT Extension
MBT benefits/ROIOrganizations using MBTreport reduction of:
escaped bugs by 27%testing costs by 35%testing duration by 31%
(on average, source: MBT User Survey 2014 by Robert Binder)
Demo
Main pointsTests can be automatically generated (given a model of the system and a test harness)MBT is finding bugs missed by manually designed testsMBT makes test coverage systematic, visible and measurableMBT takes an upfront modeling effort but considerably accelerates extension of test suites and their maintenanceMaintaining a system model improves overall process and benefits all disciplines
[ ]/Thanks;