![Page 1: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/1.jpg)
Almac Group Leverages Scriptless Test Automation to Improve Application Quality and DeliveryNovember 18, 2015
![Page 2: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/2.jpg)
Brought to you by
![Page 3: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/3.jpg)
Hosted By:
Becky Karch
Vice President of Customer Success
TurnKey Solutions
![Page 4: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/4.jpg)
Today’s Speakers
Shauna Quinn
Software Test Manager
Almac
Becky Karch
Vice President of Customer Success
TurnKey Solutions
![Page 5: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/5.jpg)
• This “LIVE” session is being recorded
Recordings are available to all Vivit members
• Session Q&A:
Please type questions in the Questions Pane
Housekeeping
![Page 6: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/6.jpg)
Webinar Control Panel
Toggle View Window
between
Full screen/window mode.
Questions
![Page 7: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/7.jpg)
Almac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery
Shauna Quinn – Almac Group
Becky Karch – TurnKey Solutions
![Page 8: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/8.jpg)
How to build a better alternative to manual testing methods
How to streamline operations and shrink testing cycles from
weeks to days
How to quickly and easily validate core business systems w/
a comprehensive regression suite
Best practices in developing a solid testing strategy moving
forward
Key Learning Points8
![Page 9: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/9.jpg)
Founded 1989, HP/Mercury technology partner since 1995, HP OEM Partner since 2012
Privately held, HQ in Denver, CO with offshore operations in India
Global presence – growing customer presence across all continents
Our scriptless automated testing solutions are built exclusively on the industry leading HP ALM technology stack*
Scriptless automated testing enables broad use for hundreds of application types using a common set of tools, by business users, TCOE’s and QA experts
About TurnKey Solutions9
![Page 10: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/10.jpg)
10
11/18/2015
• Award-winning global contract development and manufacturing
organization for the pharmaceutical and biotech industries
• Privately owned with headquarters in Craigavon, Northern Ireland;
operations in the UK, across the US (Pennsylvania, North Carolina and
California) and in Asia (Singapore and Tokyo).
• Company has grown organically over 30 years and now employs in
excess of 3,900 highly skilled personnel.
• Almac services include Diagnostics & Biomarker Development, API
Services & Chemical Development, Pharmaceutical Development,
Analytical Services, Clinical Services, Clinical Technologies and
Commercial Services
About Almac
![Page 11: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/11.jpg)
www.almacgroup.com
Need for Automation
![Page 12: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/12.jpg)
12
11/18/2015
• Almac uses Oracle EBS to run
core business critical functions
• 100% manual testing
• Although the knowledge and
skills are within the test team,
we rely heavily on the business
to provide resources
Almac Business Environment
![Page 13: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/13.jpg)
13
11/18/2015
• 9 month project
• 7 manual test cycles (4729 manual tests executed)
• Team 20 (comprised of Business Users & BA’s)
• 12 week end-to-end UAT cycle
March 2014: ERP system upgrade
Conclusion - Automation was required
![Page 14: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/14.jpg)
14
Automation Software Evaluation
11/18/2015
• A lot of research was carried out -
decided to do a POC on 3 test
automation solutions
• POC Process
– Screens are analysed and components
are created
– End users evaluated tools on list of
key criteria
– Also needed extensive support for
the Oracle ERP (eBusiness Suite) –
coverage and maintenance
• The decision was made to go with
TurnKey’s cFactory
Support for Oracle EBS
Integration with QC
Separate data from test
Ease of use
Component reusability
End-to-end flow building
Out of box content
Ease of maintenance
√
√
√
√
√
√
√
√
![Page 15: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/15.jpg)
www.almacgroup.com
Building the Test
Framework
![Page 16: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/16.jpg)
16
11/18/2015
Approach – The Team
• QA Manager – Oracle EBS
• Project Manager / Oracle SME
• 2 Test Leads
• 1 Test Automation Engineer
• Business Analysts
![Page 17: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/17.jpg)
17
11/18/2015
• A core automation team of 2 Almac testers was created
– Ring fenced to ensure 100% dedication to the implementation
• During the implementation stage the Almac automation team worked
alongside Turnkey Customer Success Team (CST) personnel
• Training was conducted for the entire team
• Test creation began
– Created new components
– Amended existing components
– Mentoring through any issues which arose
Approach
![Page 18: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/18.jpg)
Assess Current TestsWhat do your current tests do?How are they written and do they cover what they should cover?How stable is your application?
Training & Mentorship
Staffing The Necessary Testing ResourcesWhat skills does your team have?Can you hire more resources?Can you share/integrate roles & responsibilities?
Assess Test ToolsHow and where do you organize your tests?Do you have an automated test tool? Do you use it? How often?
Getting FeedbackDo you have enhancement request tracking?What services do your customers ask for?What Support issues come in?
18
![Page 19: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/19.jpg)
19
11/18/2015
• The 2 end-to-end business scenarios used during the upgrade UAT
were identified as being the starting point for this work stream
– Full data flows through the system, e.g. creating customer to invoicing
– Targeted for completion Dec 2015
– Manual tests that fulfilled the scenarios were identified and planned in
conjunction with Turnkey Customer Success Team (CST) personnel
• The newly created components were linked together with prebuilt
components to create test scripts
• Test scripts were linked to create test sets for the end-to-end flow
and the datasheets were created and populated
Approach
![Page 20: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/20.jpg)
20
11/18/2015
• 1st Scenario consisted of 273 test scripts linked end-to-end
– Each test script contains an average of 20/30 components
• 1 master datasheet to allow the data to be created and consumed
within the flow
• Reusability of components for future scenarios; therefore reducing
time in future test development
Building the Framework
![Page 21: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/21.jpg)
21
How it works
11/18/2015
Manual Order Entry Form in ERP system
![Page 22: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/22.jpg)
22
11/18/2015
cFactory analyses the screen and creates test components.
How it works
![Page 23: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/23.jpg)
23
11/18/2015
Components are then combined together to make a test script
in the test plan section of QC/ALM.
How it works
![Page 24: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/24.jpg)
24
11/18/2015
The test script is added to the Test lab in QC/ALM and a datasheet is created.
How it works
![Page 25: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/25.jpg)
25
11/18/2015
The datasheet details all the components of the test. Data is
added and multiple scenarios specified.
How it works
![Page 26: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/26.jpg)
26
11/18/2015
273 test scripts linked to create complex end-to-end flow
throughout the entire ERP system.
How it works
![Page 27: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/27.jpg)
27
11/18/2015
Master datasheet – allows data to flow throughout the tests.
How it works
![Page 28: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/28.jpg)
28
Current Uses of Scenario #1
11/18/2015
• 3 Optimisation projects running in parallel in 3 environments
Project 1
– It is being executed repeatedly on 1 environment to identify issues with
a large number of patches and code
Project 2
– It is being executed on a separate environment as part of the formal ST
cycle for regression testing
Project 3
– A subset of test scripts are being used to create data in a separate
environment
![Page 29: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/29.jpg)
29
Current Results
11/18/2015
End-to-end testing initially took 12 weeks to complete;
with TurnKey, this is now done in 3-4 days
Testing required 20 people to assist in the process; this has
been reduced to minimal effort by business resources and 1
person checking and carrying out manual steps
Coverage has allowed us to find issues that were missed in
manual testing as well as defects found earlier in the
development process
![Page 30: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/30.jpg)
www.almacgroup.com
Adding Value Across the
Business
![Page 31: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/31.jpg)
31
Next steps
11/18/2015
• Monthly Support Release
– Will run each month once the support releases have been completed
manual testing; end-to-end validation prior to going Live.
• Project Work
– To test patch impact
– To reduce regression timelines in formal ST
– To create test data
– To run the end-to-end to a point and then create multiple iterations to
challenge specific areas
• The 2nd scenario is in progress - complete Dec 2015
– Able to re-use approx. 50% of components from scenario #1
– Once complete we will have automated the UAT test cycle
![Page 32: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/32.jpg)
32
Next steps
11/18/2015
• Create smaller regression packs for extensions with a high volume of
change
– Use in projects or in support releases
• Use automation to create data within the system – less reliance on
production data
• Automating opening the finance periods in DEV and ST environments
![Page 33: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/33.jpg)
33
Supporting Automation
11/18/2015
• Minimal BA support for on-going automation adoption
• Automation Team consists of 2 testers
• New Team involvement in Agile projects
– Part of the Agile team
– Aiding dedicated ‘manual’ tester
– Identify maintenance required based on changes
![Page 34: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/34.jpg)
34
Current Results
11/18/2015
• Preparation is key
– Know what you want to automate and why
– Have the manual steps and flows documented prior to
commencing any automation
– Design the test flow to create and consume its own data
• Get the right people involved
– Dedicated team to participate fully in the implementation
– Ring fence the resources
– Team should be keen to learn and enthusiastic
– No automation experience is required
• Track progress
– Initial scope nailed down
– Targets tracked
– Key milestones identified
![Page 35: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/35.jpg)
Questions
![Page 36: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/36.jpg)
HP Discover 2015 London
Use this unique Vivit link:
http://hpsw.co/y9T3Bzj
when you register for
Discover 2015 London
Enter your Vivit ID and
you can still receive
the Early Bird discount!
![Page 37: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/37.jpg)
TurnKey at Discover 2015 London
• Join us at Vivit’s Guru Bar for TurnKey’s Roundtable
Discussion on Scriptless Test Automation on Thursday,
December 3, 2015, 9:00 - 10:00 AM BST
• Registration Link for Attendees: http://www.vivit-
worldwide.org/events/event_details.asp?id=709262&group=
• Stop by TurnKey’s Booth #532 for a live demo and enter for
your chance to win an RC Drone Camera!
![Page 38: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/38.jpg)
Vivit’s the Ticket –
Let Vivit be your Ultimate HPE Tour Guide
With having over 30K members worldwide, Vivit is proud to have the best
and brightest as its members and volunteers. Bring your colleagues over
to our booth so that we connect you with other members, special interest
groups, local user groups, and the elected board of directors. We invite
you to take a selfie at our London themed booth and register to win one of
Vivit’s great travel prizes.
Visit the Vivit Booth in the
Transformation Zone
![Page 39: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/39.jpg)
© Copyright 2015 Vivit Worldwide
Register for a Vivit Discover London Breakout
Session
Speaker: Mark Laird
Vivit BSM SIG Leader and Group IM
Technical Architect
Steria Ltd
Session ID: TB7446
Thursday, Dec 3 – 12:30 – 13:30
Title: Improving the customer
experience with HP Propel and Avatars
Speaker: Gordon Appleby
Technical Director
Trust IV Ltd
Session ID: TB7449
Wednesday, Dec 2 – 12:00 – 13:00
Title: Service and Network
Virtualization in testing.
Speaker: Dr. Mik Kersten
Chief Executive Officer and Co-Founder
Tasktop
Session ID: BB7448
Tuesday, Dec 1 – 10:30 – 11:30
Title: Don't let your DevOps transformation fail:
Unleash developers with lifecycle integration
Speaker: Pedro Miguel Jeronimo Mendes
Business Unit Manager
Datasmart
Session ID: BB7447
Wednesday, Dec 2 – 16:30 – 17:30
Title: Protect your Business now
![Page 40: Almac Group Leverages Scriptless Test Automation to ... · PDF fileAlmac Group Leverages Scriptless Test Automation to Improve Application Quality and Delivery November 18, 2015](https://reader031.vdocuments.us/reader031/viewer/2022022005/5ab7dfec7f8b9ad13d8bdf78/html5/thumbnails/40.jpg)
Thank you
• Complete the short survey and opt-in for more information from TurnKey.
www.turnkeysolutions.com
www.vivit-worldwide.org