Download - BPT & QTP
MercuryBusiness Process Testing
Faster, Easier and Smarter Quality Assurance
SPAN Technologieswww.spantechnologies.com
Copyright: SPAN Technologies and Mercury 2006.2
Agenda
Objective
BPT: Other Benefits
Challenges with Traditional Automation
BPT: the Big Picture
BPT Addresses Traditional Automation Challenges
Need for Automation
Case Studies
Q & A
Copyright: SPAN Technologies and Mercury 2006.3
Objective
To promote an understanding of business process Testing and its benefits for:
– Users considering Mercury tools for automation– Existing users of QTP and Quality Center – Users who recently acquired BPT
Demographics
Automation Experts
SystemArchitects
LOBOwners
Managers
Directors
Testers
Copyright: SPAN Technologies and Mercury 2006.4
Need for AutomationRapid execution of test scriptsRepeatable, reliable, unattended testingExtensive enterprise environment and test plan coverageAccurate defect replication
5
4
6
1
Data Sets
Business Processes
Front End Clients
Operating Systems
Combinations of various usernames, passwords, search strings, order numbers, ship dates
Login, Search, Order Entry, Order Confirmation, Order Fulfillment
Internet Explorer 6, Netscape 6, Java, Visual C++
Windows XP, Windows ME, Win 2000, Win NT 4, Win 2003
Platforms Intel
15
Total Tests to Run 1 X 6 X 4 X 5 X 15 = 1,440
Copyright: SPAN Technologies and Mercury 2006.5
Challenges with Traditional Automation
Subject Matter Experts design requirements and test cases very early in the life cycle. Test Automation requires a fairly stable application, which is not available till much later in the life cycle.
– Duplication of effort in documentation and application expertise– Lack of collaboration between SMEs and Automation Experts– Planning for automation does not start till stable application is available
Test AutomationSubject Matter Experts
Business Requirements
SMEs and Automation Experts Are Disjointed
Copyright: SPAN Technologies and Mercury 2006.6
Challenges with Traditional Automation
SME
Tester
Automation Expert
Not role-based—too many overlaps in duties
Lack of standards in automation
Decentralized—inefficient use of resources
Project 1QTP Experts
Project 2QTP Experts
High maintenance without intelligent framework
Copyright: SPAN Technologies and Mercury 2006.7
SummaryLack of collaboration between SMEs and automation experts
Not role-based—too many overlaps in duties
Decentralized—inefficient use of resources
Lack of standards in automation
High maintenance without an intelligent framework
Challenges with Traditional Automation
How does BPT address these challenges?
Copyright: SPAN Technologies and Mercury 2006.8
BPT: the Big PictureMercury Quality Center™
Dashboard
TestDirector
RequirementsManagement Test Plan Test Lab Defect
Management
Functional Testing
QuickTest Professional WinRunner
Business Process Testing
Accelerators for SAP, Oracle, Security
Delivery Options
Mercury Managed Services In-house Deployment Combination
Shared Data Repository Central Administration Workflows Open APIs
Foundation
Copyright: SPAN Technologies and Mercury 2006.9
BPT: the Big Picture
Traditional Automation
Business Process Testing
Planning, automation framework
Requirements and design
and test documentation
Development and initial
build
Automation Framework
Map objects Run tests
Modifytests
Automation
DevelopersSMEs QTP Experts QTP Experts QTP Experts
Run tests
SMEs,Testers
Planning, build components, flows
SMEs
Automation
QTP Experts
SMEs,Testers
Testers, QTP
Experts
Modify tests
QTPExperts
Copyright: SPAN Technologies and Mercury 2006.10
BPT: the Big PictureAdditional Quality Center moduleA layer of abstraction between Requirements and Test PlansStructurally, Business Components are similar to reusable functions and actions in QTP
Copyright: SPAN Technologies and Mercury 2006.11
BPT: the Big PictureSME Creates and Defines Business Components
Copyright: SPAN Technologies and Mercury 2006.12
SME Creates and Defines Business ComponentsSME Creates and Defines Business ComponentsBPT: the Big PictureSME Assembles Business Components into Tests
Copyright: SPAN Technologies and Mercury 2006.13
BPT: the Big PictureSME Can Reuse Business Components in Multiple Tests
Login Component
Test Four
Test ThreeTest Two
Test One
Copyright: SPAN Technologies and Mercury 2006.14
BPT: the Big Picture
QTP experts work behind the scenes creating the automation assets for the business components created by SMEs
– Implement function libraries– Create object repositories– Define application areas– Define recovery scenarios– Manage all resources in Quality Center
In this model, QTP experts focus purely on automation, with minimal knowledge of the application. SMEs/Testers then assemble and execute the tests and analyze the results.
QTP Experts Build the Automation Assets
Copyright: SPAN Technologies and Mercury 2006.15
BPT: the Big Picture
Once the automation assets have been developed by the QTP expert, automation is just a matter of using the keyword-driven approach to create test scripts
Easy Keyword-driven Approach for Automation
Copyright: SPAN Technologies and Mercury 2006.16
Summary RevisitedLack of collaboration between SMEs and automation experts
Not role-based—too many overlaps in duties
Decentralized—inefficient use of resources
Lack of standards in automation
High maintenance without an intelligent framework
Challenges with Traditional Automation
How does BPT address these challenges?
Copyright: SPAN Technologies and Mercury 2006.17
BPT Addresses Traditional Automation ChallengesEnables Collaboration of Business Users, Technical Automation Engineers
Automation Experts
Centralized QA automation experts enable business
experts via Mercury Business Process Testing
Subject Matter Experts
Subject-matter experts build, data-drive, and
execute automated tests via web
Mercury Business Process Testing
Business Requirements Data Application
Keywords
Login Component
Invoice Component
PO Component
Early automation Collaboration Reuse of documentation
Copyright: SPAN Technologies and Mercury 2006.18
BPT Addresses Traditional Automation ChallengesRole-based Testing—Optimal Use of Resource Time
Optimal use of expertise Clear definition of roles
Defines business processesDefines and implements the componentsCombines the ready components into complete processes
SME
Builds the object repositoryBuilds user-defined functionsBuilds application areasBuilds recovery scenarios
QTP Expert
Runs and analyzes test results
Tester
Copyright: SPAN Technologies and Mercury 2006.19
Centralized and Standardized
BPT Addresses Traditional Automation Challenges
Each project has its own SMEs and testers, but shares centralized automation experts with other projects in the organization
– Need for fewer specialized automation experts, efficient use ofresources
– Facilitates efficient use of third-party vendors for automation– Sharing of knowledge and best practices between projects– Easier to implement automation standards given a central team
Standardized automation Efficient use of resources
Copyright: SPAN Technologies and Mercury 2006.20
BPT Addresses Traditional Automation Challenges
BPT entails the use of business components as building blocks for more complex business scenarios. This built-in framework enforces modularization.
– When the application changes, all test scripts do not need to change.
– Typically, business components do not change in a logical sense,only the underlying application and objects
– Maintenance is quick and behind-the-scenes
Built-in Framework Reduces Maintenance
Reduces maintenance Enforces modularization
Copyright: SPAN Technologies and Mercury 2006.21
BPT: Other Benefits
Traditional Automation
Business Process Testing
Planning, automation framework
Requirements and design
and test documentation
Development and initial
build
Automation Framework
Map objects Run tests
Modifytests
Automation
DevelopersSMEs QTP Experts QTP Experts QTP Experts
Run tests
SMEs,Testers
Planning, build components, flows
SMEs
Automation
QTP Experts
SMEs,Testers
Testers, QTP
Experts
Modify tests
QTPExperts
Copyright: SPAN Technologies and Mercury 2006.22
BPT: Other BenefitsBusiness Sign-offSince the SMEs are involved in the creation of test scenarios, automation will make intuitive sense to them. This facilitates easier business sign-offs
Auto-DocumentationSingle point of entry for documentation combined with the auto-documenting features of BPT will dramatically reduce the documentation effort.
ScalabilitySince this model is not build around individual contributors, it is highly scalable. Efficient use of resources and a centralized model contributes to the scalability as well.
Faster, easier and smarter quality assurance
Copyright: SPAN Technologies and Mercury 2006.23
Mercury Business Process TestingThe Business-centric Quality Automation Solution
Provides entire QA team with collaborative solution
Provides entire QA team with collaborative solution
Starts quality automation process sooner
Starts quality automation process sooner
Automates maintenance and reduces costs
Automates maintenance and reduces costs
Ensures visibility and verification with auto-documentation
Ensures visibility and verification with auto-documentation
Copyright: SPAN Technologies and Mercury 2006.24
Raymond James
Business Teams unable to use traditional test automation tools QA team unable to handle volume of application changesBuy vs. build test automation framework
Challenge
Mercury Quality CenterMercury Business Process Testing
Solution
Mercury Business Process Testing chosen as a result of buy vs. build feasibility studyTeam of 14 QA engineers and Business Analysts support 200+ Developers50% reduction in compatibility testing time Existing test automation assets leveraged with Mercury
Result
“Mercury Business Process Testing is our standard for functional testing. It enables our QA and Business Teams to operate as one, allowing the testing process to be more efficient and effective. ”
Leanne Stumph, QA Management
Leading US Financial Services Provider
Copyright: SPAN Technologies and Mercury 2006.25
Global Leader in Communications SystemsAvaya
Testing activity for billing app manual and documented in spreadsheetsText execution manual for string/functional and integration testingDefects, daily completion, and pass/fail stats tracked manually
Challenge
Mercury Quality CenterMercury Business Process Testing
Solution
Testing activities more aligned with needs of the businessTesting cycles shortenedTesting and resulting stats more accurate
Result
“Mercury Business Process Testing helps us align our project and testing teams so that line of business owners can set up the right business scenarios and tests for our applications. Instead of a long manual testing process, we now have an agile testing platform that keeps our applications finely tuned to support our business objectives and provide better service to our customers.”
Dave Bishop, Sr. Manager, IT Applications