© copyright inc., 2010 1 © copyright inc., 2012 testing of a net banking application using...
TRANSCRIPT
© Copyright Inc., 2010 1 © Copyright Inc., 2012© Copyright Inc., 2012
Testing of a Net Banking Application using Selenium Framework
MBT in BFSI
Document No : IBSIPL-016/2012
© Copyright Inc., 2010 2 © Copyright Inc., 2012
Agenda
Evolution in Software TestingChallenges in Test AutomationChallenges Back at HomeModel Based TestingMBT with Selenium ArchitectureCase study on Banking ApplicationSummary
© Copyright Inc., 2010 3 © Copyright Inc., 2012
Evolution of Software Testing
Manual
Scripts-BasedCapture/Replay
FrameworksKeyword Driven
MBT
More advanced approach in testing where we create a test-framework to automatically execute the automated test cases/scripts, without manual intervention, & get test results. Lower test – reusability and maintainability
Latest Test Design approach, where we feed in functional requirements/business-logic to get automatically generated test design models, test cases, automation scripts and test documentation. 100% test reusability and Req. coverage with 50% less time/effort, higher defect tracking, higher maintainability
Advanced approach of recording and replaying test automation scripts (e.g. Visual Studio etc.) using Record/Play feature. The challenges include maintaining test data, data-source connectivity and identifying functional defect, . lower test – reusability and maintainability
Traditional approach of writing test manually, with higher efforts & resource allocation. Significant efforts on test collaboration documentation,, higher Fault-Slip-Throughs (FST), higher efforts in regression testing, absence of test reusability
© Copyright Inc., 2010 5 © Copyright Inc., 2012
Challenges in Test Automation
Initial investment of creating the test scriptsAutomation is long term strategy : Investment is justified when product is evolving and Market penetration is growingMaintainability of volume Test cases/Test scriptsDemands for different types of test suites (Build Sanity test, Regression suites, Priority based test suites) with little or no additional effortFaster test cycles with scripting demands due to Faster product builds, Agile processMigrating between framework/scripting language
© Copyright Inc., 2010 14 © Copyright Inc., 2012
Model Based Testing
Automated Test Design TM
Automates ”thinking” of test cases based on a system model
Integrates with existing test execution automationProvides
Faster test designBetter test coverageHigher test qualityEasier test maintenance
CONFORMIQ DESIGNER
Fig: Test flow, with Manual Test Design replaced by MBT
© Copyright Inc., 2010 15 © Copyright Inc., 2012
Automated Test Design flow
DevelopSystem Model
Conformiq Modeler
Manually capture system functionality
Direct & ReviewTest Design
ConformiqDesigner
Generate and verify test case completeness and correctness
Use Test Scripts& Documentation
ConformiqPublisher
Output reports and executable scripts
© Copyright Inc., 2010 16 © Copyright Inc., 2012
Paradigm Shift in Test Automation
Input: Customer requirements,Function Specifications, Function Descriptions, Interwork Descriptions, etc.Model
design
(UML) Modeling tool
Input
MBT tool(e.g. Conformiq)
Generate
Automated test scripts
Test automationtool/framework
Test cases
Generate
Test documentation
Test Management tool
Test resultsExecute
Import
Test Development Test Execution
© Copyright Inc., 2010 17 © Copyright Inc., 2012
**Note: This is a suggestive list. Ideabytes can create plug-ins for any scripting language output
MBT Test scripts
Scripting Backend Languages1 Excel 14 FitNesse2 Word (OpenDocument Scripter) 15 JUnit3 PDF (OpenDocumentScripter) 16 SOATest4 HTML 17 TTCN with call flow5 C Language 18 TCL6 C++ 19 Python7 C# 20 Ruby8 QTP(VBScript) 21 TTCN9 AutoIT (VBScript) 22 SIPp
10 Perl 23 XML11 Test Partner(VBScript) 24 PHP12 JavaScript 2513 SQL scripter 26
Others proprietary scripters can be obtained on demand within couple of weeks
© Copyright Inc., 2010 18 © Copyright Inc., 2012
Model at a Glance - Sample
• Modeling can be done using Conformiq Modeler, Rational RSA, Rational Rhapsody, Enterprise Architect.
• The Models can be given as input to Conformiq Designer to derive automatic test cases, scripts and documentation
© Copyright Inc., 2010 20 © Copyright Inc., 2012
Benefits of Choosing Selenium
Platform, Browser IndependentScripting possibility in popular programming languages:C#, Java, Groovy, Perl, PHP, Python and RubyOpen Source – Cost advantageReusable components and LibrariesOpen Source community ContributionsSeveral variants ( IDE, RC, Web Driver, Grid) depending on the test environment
© Copyright Inc., 2010 21 © Copyright Inc., 2012
SUT – Banking Application
MySQL
Banking Application
Testing:- GUI Operation- Banking Functionality
…Web Browser
© Copyright Inc., 2010 22 © Copyright Inc., 2012
Tested Functionality
Login, LogoutCreate New AccountModify Account InformationFunds TransferReports
© Copyright Inc., 2010 23 © Copyright Inc., 2012
MBT Architecture with Selenium
System Model of NetBanking App
C#Test Scripts
Test Plans and Documentation
(Word/Excel/HTML)
NetBanking App
Test Harness(Framework APIs)
Scripting Plugin
Selenium Server
Test Reports(Test Mgmt)
© Copyright Inc., 2010 24 © Copyright Inc., 2012
System Interfaces
Banking Application
FromUser:”Login”,”Click”,
ToUser:Show Home Page,Show Account page
UI
FromDBHandler:QueryResponse
ToDBHandler:Query
© Copyright Inc., 2010 25 © Copyright Inc., 2012
Demo
Please visit our booth for a Short Demo of Banking application test automation using MBT using Selenium framework
© Copyright Inc., 2010 26 © Copyright Inc., 2012
Motivate Testers to efficiencyMBT is a revolutionary technology
Well managed introduction of Test Automation and MBT motivates adoption by testersCompanies achieve immediate benefits Kick-start plan with ramp-up with Competence build-up planning
MBT is suited to all software testing domainsItem Domain Time/Test Case Effort
1 Enterprise (IT, Web Services) 20 mins Low
2 BFSI 20 mins Low
3 Health care – DICOM, HL-7 75 mins Medium
4 Embedded, ERP, Workflow 50 mins Low - Medium
5 Telecom Protocol Testing 120 mins Medium - High
Table: Typical end -2- end automation results from active and completed projects at Tier - 1 Customers
© Copyright Inc., 2010 27 © Copyright Inc., 2012
MBT Advantages in BFSISurvey at 2011 MBT User Conference in Berlin (ETSI)
Fault Slip Through (FST) reduction: 59% Testing duration reduced by 25%Testing costs reduced by 17%Usage spans application stackssoftware processes, application domainsMBT is accessible and practical
Other AdvantagesEarly detection of specification faultsNo Dependence on scripts, and Test Infrastructure ( Leads to Future proof technology)Documentation : 100% automatically generated and its by-product of Model - Always in synchSignificant reduction in Effort for regression test cyclesOne Model – Many test suites ( Functional, Regression, Sanity, Priority)
© Copyright Inc., 2010 28 © Copyright Inc., 2012
[email protected]© Copyright Inc., 2012
THANK YOU
Development Centre, IndiaIdeabytes Software India Pvt. Ltd
Jayabheri Enclave, HyderabadPhone : +91 40 6453 5959
Corporate Office, CanadaIdeabytes Inc.
Ottawa, OntarioPhone : +1 613 692 9908
South East Asia Kuala Lumpur, Malaysia
Phone: +60 16 220 1365
USA3389, Napoli pl,
San Jose, CA - 951 35Phone: +14086238278
Srinivas Reddy Katta /
Mrinal Chatterjee
Ideabytes Software India Pvt. Ltd.
email: [email protected] /
Website: www.ideabytes.com