tmf2014 thinksoft automation presentation
DESCRIPTION
Thanks to the team at Thinksoft for presenting at the Australian Test Managers Forum 2014. If you would like any information on TMF please email [email protected]TRANSCRIPT
Disclaimer: All names, logos are used for identification purposes only and are trademarks or registered trademarks of their respective companies. Trademarks of other third parties used in this document are the property of their respective owners only. No explicit/implicit warranties are made by Thinksoft on any performance.(© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft.)
Thinksoft Automation framework
2RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Ask audience to workshop for 5 mins on what are the key inefficiencies they experience in testing– Looking for issues around the inefficiency of repeated
manual regression testing, and the need to constantly update or re-do very similar test case design work for different versions of products etc.
Testing Efficiency
3RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Include details of what makes knowledge capture hard and how Thinksoft has gone about collecting a repository of specialized application testing knowledge
Key challenge: Knowledge Capture
4RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Discuss how you could improve your own knowledge capture process– What are the barriers?• Funding-wise• Culture-wise• Technology-wise
Discussion Point
5RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Show how Thinksoft has made their captured knowledge re-usable in different situations– Having a narrow but deep focus has been a key approach– How do you overcome each customer being “unique”?
Key challenge: Re-usability
6RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• How could your existing knowledge be made more reusable?– What changes are needed in:• Structuring captured knowledge• Training people• Making knowledge discoverable
Discussion point
7RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• How to re-use captured knowledge efficiently?– Test Automation… BUT• There are lots of challenges:
– Maintenance costs are too high– Skills are too rare– Systems and interfaces change too much
Key challenge: Efficiency
8RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Has test automation been used successfully in your organization– If yes – what makes it work?– If no – what made it fail, and at what point did it fail?
Discussion Point
9RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• The concept of Test Automation Frameworks has been around for a long time
• Test Automation still only achieves about 20% coverage on average
• Yet we’ve achieved XX% across all of our projects• What’s new and different about how we’re
approaching Test Automation?
Test Automation Frameworks
RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
10
TAF (ARTEMIS)
Structured approach: Manual test scripts to
automation
Centralized test execution and
reporting
Reuse of framework / components across
projects
Easy to maintain, enhance and reuse
Key Drivers
Test Management: Easy to use front end
application
11RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
About Thinksoft Automation Framework A domain centric keyword based framework designed to be maintained by
business users with little or no help from technical teams.
Works for both desktop and mobile application
Ensures the focus is on easy maintenance of the automation pack by end users
Centralized repository that can be accessed by both manual and automation test
teams
Customizable reports in different formats
Easy to audit pass and defect logs
Seamless integration with test management tools
12RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
Test Data / Keywords Test Results
Any New Manual Test Script can be automated using the same automation engine and changing the Input data and Object Repository
Software Testers and BA / Functional Subject Matter Experts can directly review the scripts without any technical knowledge
Automation Engine - Reusable Scripts which
executes the test based
on the Inputs
Object Repository
Focus on Maintenance
RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft 13
Centralized front end
• Centralized front end system which can be used for • Test Planning and Execution • Run Plan setup• Test reports in PDF, excel formats• Automation tool setup options
Data Entry module / Reusable Test database• New Script creation • Existing Script enhancements• Test data creation & modification• Easy to use test script maintenance• Reusable test database structure• Can be used as test repository
Support for Mobile Test Automation
ARTEMIS – Enablers / Differentiators
• Framework can be integrated with mobile testing tools
• Combined test results for both mobile and desktop application test execution
RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
TEST AUTOMATION FRAMEWORK
1
5
6
2
Establish connection between Automation & Test management tool
1
2 Loading of resources from Test management tool to Automation tool
3 Execute Test Scripts using Automation scripts
4 Invoke relevant Application/device Under Test
Update Test Execution Status based on Automated Execution
6 Automatic Logging of Defects & status based on actual results
5
4
Rele
ase
&
Requ
irem
ent
Man
agem
ent
Test
M
anag
emen
t
Def
ect &
Sta
tus
Repo
rting
Test Management
2
iOS
Windows 8
Blackberry
Others
Symbian
AUT in different Mobile OSHP QTPTest CompleteSelenium
Automation Test Tools
We b B a s e d
Application Under Test
T h i c k C l i e n t
M a i n f ra m e
M i d d l e wa re
We b S e r v i c e s
Components of Automation Framework
Test Automation
3
4
Script Capture
with single OS
Android
External provider - Offshore
Mobile InfrastructureMobile Technology
RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Include details of:– How automation efficiency is being measured?– How business / IT processes need to be set up to make
automation sustainable over the long term?• Make the point that setting up the business case and
business process (including metrics) for making testing sustainable will also address automation sustainability in general
Staying the course: Automation ROI
RESTRICTED© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft
• Regardless of whether you currently have test automation in place or not, discuss what business and IT process changes you can begin to make which– Improve you ability to capture and reuse knowledge– Measure the efficiency of your testing process– Fund efficient testing sustainably
Discussion Point
Disclaimer: All names, logos are used for identification purposes only and are trademarks or registered trademarks of their respective companies. Trademarks of other third parties used in this document are the property of their respective owners only. No explicit/implicit warranties are made by Thinksoft on any performance.(© Thinksoft Global: This is Thinksoft proprietary and can not be copied or shared out side the intended purpose without explicit written permission of Thinksoft.)
Thank you