driving continuous delivery with service virtualization

Welcome! Driving Continuous Delivery with Service Virtualization

September 21, 2016

© 2016 CA. ALL RIGHTS RESERVED. ALL TRADEMARKS, TRADE NAMES, SERVICE MARKS AND LOGOS REFERENCED HEREIN BELONG TO THEIR RESPECTIVE COMPANIES. NO UNAUTHORIZED USE, COPYING OR DISTRIBUTION PERMITTED. PLEASE NOTE THAT THIS PRESENTATION IS FOR YOUR INFORMATIONAL PURPOSES ONLY DOES NOT SERVE AS ANY TECHNICAL USER GUIDES OR DOCUMENTATION. THERE IS NO DIRECT OR INDIRECT WARRANTY PROVIDED PERTAINING THE PRODUCTS AND ACTUAL USE MAY VARY FROM THE ILLUSTRATIONS PROVIDED.

2 © 2016 CA. ALL RIGHTS RESERVED.

Agenda

PERSPECTIVE

INTRO TO SERVICE VIRTUALIZATION AND DEMO

THE VALUE OF SERVICE VIRTUALIZATOIN

Q AND A

1

2

3

4


Businesses no longer have the luxury of time. Rising customer expectations, competitive threats, and increased consumer choice have turned rapid delivery and iteration of software applications into a competitive differentiator.

Optimizing the delivery value chain has become the new means to better business outcomes.

TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015

“

”2014 Vanson Bourne study commissioned by CA

UNPRECEDENTED

94%of executives face increased pressure to release appsmore quickly

“The Need for SPEED


No visibility across the

app lifecycle

Lack of Integrated Tool Sets

Poor customer

experience

Deploy to Production

Developers Release Team Operations

TESTBUILD DEPLOY

Testers

OPERATE

RE-WORK

RE-WORK

IDLE TIME

Code | Integrate | Build

DELAYS

defect

DELAYS

defect Functional

& UA Testing defect

DELAYS

Performance Testing

Over Testing/ Poor Coverage/ Manual Process

Constrained Environments/ Brittle Stubs &

Mocks

Developers Deadlocked

Limited Access to Test Data /

PII Risk

Challenges to Delivering Innovations … Continuously

of teams experience delays in development and QA due to unavailable dependencies*

Over

80% 79%of teams face prohibitive restrictions, time limits or access fees on needed 3rd party services*

*Source: voke Market Snapshot TM Report: Service Virtualization – January 2015


“Achieving speed and flexibility – Safely.From Agile to DevOps to Continuous Delivery”

Freeform Dynamics Executive Insight Paper in Association with CA Technologies, June 2016

Download the full report at: http://cainc.to/IWWTm3

http://cainc.to/IWWTm3




Continuous Feedback

Pillars of Continuous Delivery

Agile

Transformation

Continuous Build &

Integration

ContinuousTesting

Configuration Management

Continuous Release &

Deployments

Source: Blog – Pillars of Continuous Delivery – www.servicevirtulization.com

Break into Continuous Delivery into smaller more manageable work-streams. By focusing on areas you can get quick wins in... you can move forward faster.

http://www.servicevirtulization.com/


OptimizedOrganization for DevOps

*Application release automation view

Continuous Testing How do You Get There?Testing Technology Adoption and Maturity

AGIL

E M

ATU

RITY

Silos, manual handovers, waterfall, one release/year, monolithic apps, long term project/resource planning, error prone release processes

DevOps, end-to-end delivery, incremental agile/sprint release cadence, multi-

component micro apps, automation enabled, the right people with the right skills.

Where are you?

UI Test Automation

Modeling & Test Generation Automation

API Test Automation & Service Virtualization

Continuous Testing


Industry Research: Gartner Market Guide for API Testing and Service Virtualization Key findings include:

– The need for API testing and service virtualization is becoming increasingly important as IT organizations develop bimodal capability to support mobile, digital business transformation initiatives and the Internet of Things (IoT).

– Service virtualization enables earlier, continuous, complete and parallel development and testing of software in a highly complex, heterogeneous and distributed environment. It can also reduce overall test lab costs.

https://www.ca.com/us/collateral/industry-analyst-report/gartner-market-guide-for-api-testing-and-service-virtualization.register.html

https://www.ca.com/us/collateral/industry-analyst-report/gartner-market-guide-for-api-testing-and-service-virtualization.register.html


Service VirtualizationWho Benefits and How?

Reduce Infrastructure Costs: Eliminate the need to procure equivalent hardware/software for dependent systems to support production-like load on the system under test.

Eliminate Environment Sharing: The ability to isolate the system under test via virtual back ends eliminate environment sharing. This greatly minimizes scheduling, coordination & troubleshooting effort.

Scalability : Allow environments to scale to conduct performance, load and endurance test

Reduce Transaction Costs : Reduce the cost incurred due to the load supported by third party systems.

Eliminate Wait Time: No more waiting for downstream systems to start test cycles and verify defects.

Negative Test Coverage : Provide the ability to test application behavior for negative/ exception scenarios.

Provide Stable Test Environment : Minimize testing delays due to the lack of a stable middleware or backend environments impacting you ability to develop and execute tests.

Eliminate Wait Time : Eliminate waiting on dependent systems to continue development , reproduce defects or fix a defect.

Enable Parallel Development : Eliminate waiting for other systems undergoing changes to provide “finished” services.

Eliminate Mocking/Stubbing : No more creation/maintaining of brittle stubs and mocks

Improve Agility : Easily update virtual service behavior as requirements rapidly evolve

Shift Left : The ability to create more test scenarios allow you to catch defects early in the development stages.

Development Teams QA and Testing Teams Performance Teams


Leverage Service Virtualization to Drive Continuous Testing

-

ESB

Mainframe System ofRecord

ERP SaaS/API

Simulate unavailable systems across the software development lifecycle (SDLC), allowing developers, testers, integration, and performance teams to work in parallel.

I have everything I need, when I need it!“

http://www.ca.com/us/products/ca-service-virtualization.html?intcmp=headernav


Make Test Environments as “Life-Like” as PossibleWhat’s the Difference Between Stubs, Mocks, and Service Virtualization?


Intro to CA Application Test – Included with CA SV!

CA Application Test

Test Data – TDM

API Tests

Web UI testsMobile Tests

Realistic Performance

Continuous Testing - SV

Full-Stack Automated Scriptless Testing Complete test coverage across tech stack

(e.g. APIs, Web UI, Mobile Devices, Web Services, JMS, MQ, SQL, File-based, etc.)

Invoke and verify at each component level across the end-to-end application

Portable, executable test suites that are easy to chain into workflows with other tests

Easier to Create and maintain REST API tests

Collaborate and re-use automated tests

Readily execute tests against different environments with different underlying data

Continuous Validation using CVE integrated with various notification mechanism

CA Application Test 10.0

Not your usual “test automation” suite…CA Application Test shifts testing to left by moving testing closer to the logic.

http://www.ca.com/us/products/ca-application-test.html


Web App(Action Servlets, JSP)

Port 8080

JBoss 4.2.1

Security Token Service

User Control Service

Account Control Service

Web Services(JAX-WS)

EJB3

Database(Derby)

Kiosk

JMSOther Apps

Other Apps

Other Apps Virtual Service Port 8001

SV Architecture


DemoView a demo of CA Service Virtualization at:

https://www.youtube.com/watch?v=uXSSnS0vHKY


Performance Testing

Innovate Faster while Delivering a High Quality Experience

Use the same test cases created and optimized for functional testing

Simulate backend load by running test thru an API

Simulate life like test environments Generate purpose built test data Control outlier conditions Adjust think times

Save Millions in infrastructure costs

and 3rd party fees

Detect Defects earlier in the SDLC

Eliminate capacity constraints

for performance testing

Reduce delayswith high-performance

masking and subsetting, and automated data discovery

Application “X”

Test Cases

Thousands oftransactions

Agent


Mainframe

Risk Solution Providers

Credit Bureau

SMS Gateway Providers

Teleconference Service Provider

Card Processing Services

VOIP Phone / Conference Bridges

Bill Payment Services

Motor Vehicle Records (MVR) System

ESB

Virtualize Almost Any IT Asset


Real World Results


CA Service Virtualization: Real ValueForrester Total Economic Impact (TEI) Study for CA Service Virtualization

Based on three-year, risk-adjusted financial model for the composite organization

“So without Service Virtualization, as highly integrated as our systems are, there is no way we could have speeded things up and moved to an Agile methodology.”— Senior manager, software engineering

“In order to do performance testing required, we were able to virtualize a lot of back-end systems and hardware simulation, avoiding $1.8 million.”— AVP, quality assurance

The Total Economic Impact™ Of CA Service Virtualization, a commissioned November 2015 study conducted by Forrester Consulting on behalf of CA Technologies

Service Virtualization can help improve software quality, speed up time-to-market, and reduce costs.

ROI273%

NPV$4.30M

PAYBACK3.2 mos.

IMPROVED RELIABILITYIdentifying 150 defects earlier in QA per release

IMPROVED PRODUCTIVITY640 hours of savings in Dev/QA processes per release


99% reduction in testing times-------------------

25% reduction in software defects

BusinessAutotrader sells advertising that allows private and trade buyers and sellers to exchange vehicles. More than 18 million people use Auto- Trader.com each month.

ChallengeTo meet customer demand for new online features and accessible across multiple devices, Autotrader needed to release software updates on a weekly basis. Testing, however, had become complex, costly and time-consuming.SolutionCA Service Virtualization enables Autotrader to virtualize and test new services and apps on a multitude of devices, while simulating both apps working normally and while experiencing performance issues. CA Services completed implementation and training in just six weeks.

Autotrader Avoids $300,000 in Testing C

osts with CA Service Virtualization

Autotrader is improving the customer experience with faster time-to-market.

“The CA Technologies team blew the competition away with their

knowledge and passion.”

http://www.ca.com/us/collateral/case-studies/autotrader-avoids-300000-in-testing-costs-with-ca-service-virtualization.html


























Upcoming Events!

TechWell STARWest Oct 5 & 6– RECORDED Virtual Sessions

CA World – Nov 14 -18– Live Simulcasts

https://starwest.techwell.com/program/virtual-conference



http://www.ca.com/us/caworld.html


CA Continuous Delivery Portfolio

Development OperationsTestPlanning Deploy

CA Agile Requirements Designer

CA Test Data Manager

CA Continuous Application Insight

CA Application Test

CA Release Automation

Agile Ops

Agile Central

CA Service Virtualization

CA Release Automation Standard + Continuous Delivery Edition

APIM APM

http://www.ca.com/us/products/ca-agile-requirements-designer.html

http://www.ca.com/us/products/test-data-management.html



http://www.ca.com/us/products/ca-agile-central.html




http://www.ca.com/us/products/ca-release-automation.html

http://www.ca.com/us/products/api-management.html?intcmp=headernav

http://www.ca.com/us/products/application-performance-monitoring.html


Resources

Forrester SV TEI Study – http://bit.ly/CASV-TEI Service Virtualization Today – www.servicevirtualization.comGartner Market Guide for API Testing and Virtualization – http://bit.ly/Gartner_SV-GuideKey Capabilities of CA Service Virtualization Whitepaper - http://bit.ly/CASV_WPReal Customers. Real Results – Service Virtualization customer success stories www.ca.com/CDResultsIT Central Station – Real User Reviews and Comparison Guide https://www.itcentralstation.com/products/ca-service-virtualizationCA Service Virtualization Home Page - http://www.ca.com/us/products/ca-service-virtualization.html?intcmp=headernav

http://bit.ly/CASV-TEI

http://www.servicevirtualization.com/

http://bit.ly/Gartner_SV-Guide



http://bit.ly/CASV_WP



http://www.ca.com/CDResults

https://www.itcentralstation.com/products/ca-service-virtualization

https://www.itcentralstation.com/products/ca-service-virtualization
