pre-con ed: there has to be a better way to fast test coverage!
TRANSCRIPT
There Has To Be a Better WayTo Fast Test CoverageMark Braemer - Sr. Principal Consultant - CA Technologies
DO5X28E
DEVOPS
3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.
The content provided in this CA World 2016 presentation is intended for informational purposes only and does not form any type of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.
For Informational Purposes Only Terms of this Presentation
4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
Are you tired of lousy test coverage?
This presentation will show you how to obtain high test coverage without all the hassle most organizations encounter.
See in a demo how CA Test Data Manager and CA Agile Requirements Designer work together to help you build better test cases with better coverage using better data!
Mark BraemerCA TechnologiesSr. Principal Consultant
5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
OVERVIEW OF CA TEST DATA MANAGER
OVERVIEW OF CA AGILE REQUIREMENTS DESIGNER
INTEGRATION OF TDM & ARD IN A BROADER DEVOPS USE CASE
DEMO OF USE CASES
Q&A
1
2
3
4
5
6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Overview of CA Test Data Manager
7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Test Data Manager
Data Discovery, modeling,
visualization and Profiling
Data Subsetting,
Masking and Synthetic
Data Generation
Test Data on Demand™
Review data quality and data errors
Measure coverage and identify gaps
Discover relationships Identify sensitive data
across all systems Identify future trends
Share data across parallel teams
Enable Self-Service on demand access
Provide multiple outsources with secure data
Eliminate manual data creation and masking
Reduce costs and improve quality with short but rigorous test cycles
Improve test coverage
8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Synthetic Test Data Generation“Empty”
CA TDM +
Required Data Characteristics
Provision fit for purpose test data anytime and every time!Provision data without access to production systems!
Reduce cost of creation and maintenance of Test Data.
Ready for Testing!
8
Find/n Demand
9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Synthetic Generation of Flat Files
Create high quality test data to test applications that rely on non-relational database sources.
Generate synthetic data in various formats including XSD/XML, WSDL, RR pair, JSON etc.
Publish RR Pairs to a virtual service via integration with CA Service Virtualization
10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Overview of CA Agile Requirements Designer
11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
What is CA Agile Requirements Designer?
Graphs sophisticated business processes and path modeling.
Defines and optimizes requirements and test case designs
Designs clear requirements, test cases, and even data, in one flow charting tool
Significantly improves the quality of requirements and test cases.
Reduces costs of testing by detecting the smallest number of test cases that have the maximum coverage, removes duplicate or redundant test cases
12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CA Agile Requirements Design – Create perfect test cases
Generate the smallest number of test cases with maximum coverage
Test more functionality in fewer tests
Measure test coverage and know that every requirement has been tested
The cost and complexity tool in CA Test Case Optimizer
With ARD Without ARD
No of Test Cases 450 318
Code Coverage 63 55
Functional Coverage 67% ~70% (Est)
Man Days to Create 3 40
13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Integration of TDM & ARD in a Broader DEVOPS Use Case
14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Big Picture End to End Testing
24 User Stories were identified in CA Agile Central that describe the functional behavior of flat file generation capability
We modeled these stories using Agile Requirements Designer, resulting in 1 Top Flow and 6 Sub Flows
‘Full Coverage – All Paths’ option yielded 17,000 Test Cases. However, an optimal code coverage of 70% was achieved using ‘Full Coverage – All In/Out Edges ’ option resulting in more manageable set of 450 Test Cases
The Test Data was provided in context of each model to drive the automation
The Test Cases were automated by associating a code snippet to each node on the flow so that export of any path resulted in an end-end automation
15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Demo of Use Cases
16 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Today’s Demo
Synthetically generate multiple XMLs using Test Data Manager
Model the paths of the data generation use case using Agile Requirements Designer
Automate the data generation testing using the model from Agile Requirements Designer
17 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Questions?
18 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO5X06L Pre-Con Lab: Test Data Manager - Masking, subsetting and generating synthetic data 11/15/2016 at 9:00 am
DO5T06T TechTalk: Sometimes Less is More –Visualization Can Reduce your Test Data while Enhancing Quality! 11/16/2016 at 3:00 pm
DO5X38S Case Study: GM Financial's Test Data Management and Automated Testing Journey 11/17/2016 at 3:45 pm
19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Must See Demos
Use Model Based Testing
Continuous Delivery
Continuous DeliveryTheater 5
Achieve Max Test Coverage
CA ARDTheatre 5
Deliver Test Data Faster
CA TDMTheater 5
CA ARDTheatre 5
20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Thank you.
Stay connected at communities.ca.com
@CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.21 @CAWORLD #CAWORLD
DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu