leverage service virtualization on your roadmap for success

Leverage Service Virtualization on Your Roadmap for Success

Kazi Whitfield

DevOps: API Management and Application Development

MUFG Union Bank

Director of Quality Engineering

DO3T23S

#CAWorld

2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type of

warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

For Informational Purposes Only

Terms of this Presentation


Abstract

Development and testing tool choices can be overwhelming. What tools are the right tools? When to use them? When not? This session will be a review of how organizations can take on the challenges of overcoming development and testing constraints while being able to keep or improve timelines. Session discusses service virtualization implementation models, proper success measurements, challenges addressed and achievable successes.

KaziWhitfield

MUFG Union Bank

Director of Quality Engineering


Agenda

QA CAPABILITIES & GOALS

DEFINE THE PROBLEM

Q & A

CLEAR ENGAGEMENT MODEL

CHALLENGE AND RESULTS

CA TEST CASE OPTIMIZER USERS

1

2

3

4

5

6


QA Capabilities

Portal development; metrics analysis BUSA intake/fulfillment solutions Developing custom testing solutions Middleware solutions to integrate

w/vendor products

Issue coordination & resolution Configuration management More availability Less defects on environments

Metrics scorecard Defect Analysis Working early in the SDLC phases IMR RCA Compliance/ Develop Standards/practices Process Improvements Testing/QA expertise Tools evaluation

QA organization addressed development needs to improve it’s project delivery process by improving the quality, lowering the cost and shortening the timeline of development. The focused services provided results in improved availability of production environments and greater release velocity.

Test Management

Functional Testing

Test Data Management &

Automation

Tools & Capabilities

Test Environment Management

Quality Assurance

Centralized Quality

Functional automation Performance testing SOA testing Utility tools development Test Data coordination Test Data Bed creation

AT Support SIT testing +ve & -ve test scenarios Regression testing Integration testing UAT support

Test Strategy Definition Test Planning Risk Based Analysis Traceability matrix Clarity management Reporting/Risk management/ coordination within stake holders


All These Terms

Disruptive Thinking

A g i l e

Kan

ban

Continuous Integration

Continuous Delivery

DevOps

Au

tom

atio

n

Del

iver

y Tr

ansf

orm

atio

n

Configuration Management

Iterative DevelopmentP i p e l i n e

Service Virtualization

A3

Pro

cess

Time to market

Met

rics

Lean Thinking

Pro

cess

Flo

w

Qu

alit

y

S h i f t L e f t


Define the Problem

Constraints of dependent systems needed to move the SDLC forward

Increasing Complexity of today’s heterogeneous enterprise IT architectures

Lack of Collaboration creates scheduling conflicts and buffers from development through operations

Need Complete visibility into what happens in production


Software Lifecycle’s Immune Deficiency


Life in Isolation


Clear Engagement ModelP

roje

ct T

eam

SV T

eam

Request SV services through GSQO Engagement

DB

Review discovery documentation submitted

by project

Set up Feasibility Meeting with Project Team

Feasibility Meeting to understand SV

requirements, complexity of requirements and

finalize scope

Create SV sizing and send to PM

Obtain alignment from QA & SA to use SV on project

PM Approves SV sizing

Plan for service virtualization & setup

Deploy services and communicate setup ready

for validation


Clear Engagement Model

-

1,000,000

2,000,000

3,000,000

4,000,000

5,000,000

6,000,000

7,000,000

8,000,000

9,000,000

0

1000000

2000000

3000000

4000000

5000000

6000000

7000000

8000000

9000000

Jan-14 Feb-14 Mar-14 Apr-14 May-14 Jun-14 Jul-14 Aug-14 Sep-14 Oct-14 Nov-14 Dec-14 Jan-15 Feb-15 Mar-15

2014 Total – $6,961,471

2015 Q1 Total - $7,417,622

Virtual Services Transaction count – Time graph


Challenge #2

56% of software defects can be traced back to ambiguities in requirements

Detecting and resolving production defects is over 40x more expensive than in requirements

Industry standard for manual test case design coverage is between 10-20%

Over-testing of some functions by factors of 40 is not uncommon

Change requests to existing software requirements can take up to as much as 60% of the SDLC

If I make a change I have no idea the effect this will have on up stream or downstream systems


Results

Requirements 30% improvement

Test Case Creation Time 95% reduction

Functional Coverage 80% improvement

Over Testing 4 times reduction

Change Request 90% reduction in the time spent manually editing existing test cases

Cost Savings per Project 20 to 30% - varies by complexity of the projects

Quality 100% functional test coverage

CA Test Case Optimizer enables testers to create better test cases directly from requirements faster

Requirement Test Cases Design Time % Coverage % Over Testing

Test Cases Design Time % Coverage % Over Testing

Waterfall Project 1 14 5:00 16% 0% 17 2:00 100% 0%Agile Project 1 40 4:00 100% 1029% 8 0:30 100% 0%Waterfall Project 2 150 5:00 80% 1900% 19 0:50 100% 0%Agile Project 2 3 4:00 5% 0% 12 0:30 100% 0%

207 18:00 56 3:50

Baseline Agile Designer


Who Would use CA Test Case Optimizer

Business Users

Business Analyst

Programmers Testers Outsourcing Partners

Clearly define a process as they think of it

Define the process, which will be verified by the user, create logic flows for programmers and test cases for testers

Verify the process with the Business Analyst before coding and Testers with test cases

Quickly define functional logic flows and verify them with the Programmer, as well define the smallest set of test cases to verify the program

Get stable requirements and clearly defined work packages, which result in lower ongoing costs


Q & A


Recommended Sessions

SESSION # TITLE DATE/TIME

DO4T05S The CA Roadmap for Test Data Management 11/18/2015 at 1:00 pm

DO3T06SThe CA Roadmap for Service Virtualization and the Dev

and Test Portfolio11/18/2015 at 2:00 pm

DO3T24SAccelerate DevTest with Microsoft® Azure™ and Service

Virtualization on Demand11/19/2015 at 3:00 pm


Must See Demos

Test Data ManagementEmbrace Test Data Management

Theater 4

DevOps Sim

DevOps Simulation Experience

Theater 3

Continuous App InsightAutomate Tests for Better Apps

Theater 4

Service VirtualizationDeliver Better Apps Faster with SV

Theater 3


Follow On Conversations At…

Smart Bar

Theaters 3 & 4

Tech Talks

Theaters 3 & 4


For More Information

To learn more, please visit:

http://cainc.to/Nv2VOe

CA World ’15

http://cainc.to/Nv2VOe

http://bit.ly/1wbjjqX

leverage service virtualization on your roadmap for success

Technology