shift-right' - rapid evolution with designops
TRANSCRIPT
‘Shift-Right’ - Rapid Evolution with DesignOpsJonathon Wright
DO5X47S
DEVOPS
2 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
For Informational Purposes Only
Terms of this Presentation
© 2016 CA. All rights reserved. All trademarks referenced herein belong to their respective companies. The presentation provided at CA
World 2016 is intended for information purposes only and does not form any type of warranty. Some of the specific slides with customer
references relate to customer's specific use and experience of CA products and solutions so actual results may vary.
Certain information in this presentation may outline CA’s general product direction. This presentation shall not serve to (i) affect the rights
and/or obligations of CA or its licensees under any existing or future license agreement or services agreement relating to any CA software
product; or (ii) amend any product documentation or specifications for any CA software product. This presentation is based on current
information and resource allocations as of November 1, 2016, and is subject to change or withdrawal by CA at any time without notice. The
development, release and timing of any features or functionality described in this presentation remain at CA’s sole discretion.
Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in
this presentation, CA may make such release available to new licensees in the form of a regularly scheduled major product release. Such
release may be made available to licensees of the product who are active subscribers to CA maintenance and support, on a when and if-
available basis. The information in this presentation is not deemed to be incorporated into any contract.
3 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Abstract
This session will directly address the new delivery paradigm; from ideation to design, development, testing through to operations known as DesignOps that providing a value-driven delivery approach that scales when defining, building and deploying solutions.
Evolution, over revolution shifting to a more cognitive, dynamic, adaptive, continuous model calls for new practices that require accelerated communication, collaboration, integration, measurement and automation. Join Jonathon who will explore some of the new features of CA continuous testing platforms that can accelerate your adoption of modern scaled agile and lean approaches.
Jonathon Wright
CA
Director of Digital Assurance
4 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Agenda
INTRODUCTION
DESIGNOPS
CONNECTED INTELLIGENCE
DIGITAL EVOLUTION
DIGITAL ASSURANCE
DIGITAL ECOLOGY
1
2
3
4
5
6
5 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
VA
LUE-
DR
IVEN
TIME
1960s 1990s TODAY
Cognitive Adoption - ‘Evolution, over Revolution’
1 – “The Battle for Competitive Advantage in the App Economy”, Oxford Economics, 2015
of enterprises believe that they need value-driven algorithmic business models to respond to disruption in the next 3 years.78%
Legacy is your Legacy (API)
Digitalization of your Core (SOA)
Digital (Cognitive Adoption)
6 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Businesses no longer have the luxury of time.
Rising customer expectations, competitive threats,
and increased consumer choice have turned rapid
delivery and iteration of software applications into a
competitive differentiator.
Optimizing the delivery value chain has become the
new means to better business outcomes.
TechRadar™: Continuous Software Delivery, Q2 2015, Forrester Research, May 1, 2015
“
”
2014 Vanson Bourne study commissioned by CA
UNPRECEDENTED
94%of executives face increased pressure to release appsmore quickly
“
Journey to Digital Transformation
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
7 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
78% of Executives in most B2C industries say their business will be disrupted by digital
technologies in the next 12 months. 20% say their business will be massively disrupted.
- Forrester State of Digital Business - Big Bang Disruptions - Larry Downes - RallyON Keynote
8 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Companies Look to DevOps for the Answer
Vanson Bourne – DevOps survey 2014
Benefits of DevOpsPercent improvements in business areas
Co
llab
ora
tio
n
Ap
p q
ual
ity
Cu
sto
mer
s
New
ser
vice
s
Tim
e-to
-mar
ket
Rev
enu
e
Co
st s
avin
gs
Dep
loy
freq
uen
cy
Plan to adopt DevOpsNext 3 to 5years
15%88PERCENT
18% 18%19% 19% 19%
21% 21%
9 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Our Focus…
Dramatically Improve Testing in Digital
Better. Value. Smarter.
*National Institute of Standards & Technology
Per Year of IT Budget for QA and Testing*
Per Year on Testing Tools$60B $2.5B
How about focusing on Minimum Viable Quality?
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
10 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Limited test resources and
lack of Automation
of all testing is still manual
70%
Source: Bloor Research, 2014
Test Datafor setup & staging
of time spent looking for50%
Source: Bloor Research, 2014
Build of various dev & testing
Environments
of critical dependencies are unavailable when dev and test teams need them
56%
Source: voke Market Snapshot TM Report: Service Virtualization – January 2015
Is Testing still the Bottleneck?
Digital TestingAgile Requirements Designer, TDM and RA
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
11 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
DESIGNOPS
Continuous Delivery - Sub-Value Streams
1Continuous
Delivery
2Continuous
Testing
3Continuous
Staging
4Continuous
Release
12 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Continuous Adoption
CognitiveAdaptive Adoption
Continuous Testing
Continuous Improvement
Continuous Delivery
Continuous Intelligence
Continuous Learning
Continuous Innovation
idea
DEVELOPMENT OPERATIONS
‘Shift-Right’ Digital Ecology
‘Shift-Up’ Digital Assurance feat. Connected Intelligence
‘Shift-Left’ Digital Evolution feat. DesignOps
CUSTOMER EXPERIENCE TESTING
DesignDevTestOpsAgility across all 4 increases speed, reliability and efficiency
CognitiveAdaptive Testing
CognitiveAdaptive
Improvement
Cognitive Adaptive Delivery
CognitiveAdaptive
Intelligence
CognitiveAdaptive Learning
CognitiveAdaptive
Innovation
DESIGN
‘Shift-Down’ Digital Archaeology
13 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
WATERFALL / V-MODELDAD, LeSS & SAFE (v4)LEAN STARTUP / UX
Incubate Scale
FASTFEEDBACK
BUSINESS INTELLIGENCEREAL TIMEPREDICTIVEPERSCRIPTIVE
Enhance
SLOW FEEDBACKWHAT IS HAPPENING NOW?
WHAT SHOULD WE DO?EXPERIMENT ASSURE
14 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
‘Shift Left’ Becoming an Digitally Disruptive Business
Digital Evolution feat. DesignOps
PORTFOLIOMANAGEMENT
Easily and securely manage from single location &decrease creation time
by 96%
LIFECYCLEVIRTUALIZATION
Simultaneously access and virtual services
accelerating app development by 97%
SCALED AGILEMANAGEMENT
30–50% improvements in both cost and deliveryduration compared to
traditional projects
SHIFTLEFT
Innovation …. Faster
15 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
* Dave Landis, LitheSpeed.com, LeanUX principles and Design Thinking
Solution & Design Thinking, Lean Digital, Customer & User Experience (DX, CX & UX)
Rapid Evolution
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
16 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Build
Deliver
MonitorMeasure
Learn
Design
Make
Check
Think
Proactive over Reactive
Governance over
Ownership
Maturity over Mastery
Predictive over Continuous
Evolution over Revolution
Engineering over Agility
Intelligence over Things
17 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
INNOVATION (INNOVATION, GROWTH & MATURITY)FAST
INNOVATIONSLOW
INNOVATION
DECOMPOSITIONLIBERATIONIMMUNIZATION
Incubate Scale
WHAT HAPPENED ?WHAT’S HAPPENING NOW? WHAT WILL HAPPEN ? WHAT COULD HAPPEN ?
Enhance
WHAT IS HAPPENING NOW?
Ecologist
DevScrumMaster
Therapist Researcher
Designer
DevOpsEngineer
DisciplinedAgilist
Maker
Creative
Infrastructure Engineer
SDET
BA
Tester
Product Owner PM
Ops
Support
FASTFEEDBACK
SLOW FEEDBACK
18 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
WireframeUser Story Mapping
(DEMO)
Digital Evolution Use Case - Agile Architect Designer
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
19 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
20 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
IdeasBeliefs, Values, Culture
Heuristics
Behaviors
Value
AgileLean
Solution ThinkingExploring Solutions Thinking (Business, Technology & Usage)
Copyright © 2016 nuCognitive LLC. All Rights Reserved.
Methods and Skills
21 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Solution Thinking
Ray Arell
www.solution-thinking.com
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
22 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
‘Shift-Up’ Becoming an Value-Driven Business
Digital Assurance
LIFECYCLEVIRTUALIZATION
Simulate missing systems, to save up to 640 Hrs.
DIGITAL ENGINEERING & AUTOMATION
Test less, cover more, automate 100% of tests.
DATA VISUALIZATION & VIRTUALIZATION
Reduce time spent waiting on data by 95%.
SHIFTUP
VALUE-DRIVEN
Multi-Modal Delivery (Incubate to Lead, Scale for Growth and Enhance the Core)
23 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
CO
GN
ITIV
E A
DA
PTI
VE
AD
OP
TIO
N
Manual
Continuous
Autonomics
Lean Engineering
Connected Intelligence
BUSINESS VALUE
LEVEL 1 LEVEL 2 LEVEL 3 LEVEL 4 LEVEL 5
?
Optimized Organization
for DesignOps
Continuous Insight & Learning
Value StreamMapping
Consistency & Collaboration
Heroes & Heavy Lifting
DIG
ITA
L M
ATU
RIT
Y
• Insight-Driven (Predictive / Prescriptive)• NoOps organized (IoT-Ops/CX-Ops/Sec-Ops)• Self-healing end-to-end autonomic orchestration• Microcontainerization & Microservices enabled• Open Innovation & Connected Intelligence• Quantum Teleportation (Shift X)
Where are you?
Minimum Viable Quality
• Silos, manual handovers, waterfall process• One release/year• Monolithic apps• Long term project/resource planning• Error prone dev/test/release processes
Minimum Viable Product
Minimum Viable Delivery
Organization Change
User Story Mapping InsightBeliefs, Values,
CultureValue Behaviors Heuristics
24 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Cognitive Adaptive Insight (CAI)
Connected Intelligence
Release Management
Environment Management
ApplicationManagement
Network Management
Infrastructure Management
RepositoryManagement
Data Management
Test Data LearnProbe
Connected Intelligence
CA App Experience Analytics
25 © 2016 CA. ALL RIGHTS RESERVED.
REAL TIME, BIG DATA ANALYTICS EMBEDDED THROUGHOUT OUR PORTFOLIO
AGILE MANAGEMENT AGILE OPERATIONS DEVELOPER PRODUCTS
CONTINUOUS DELIVERY MAINFRAME SECURITY
25 © 2016 CA. ALL RIGHTS RESERVED.
API analyticsRelease management dashboard Access incident responseReal-time app performance
Cognitive Adaptive Insight (CAI)
Connected Intelligence
26 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Design QA/TESTDEV PRODUCTIONPRE-PROD
Specification
CI/Build Functional testing UAT Integration
testing Performance engineering
Deploy to pre-prod
Code commit SCM
Design Spec
Requirements
Business Users
TESTData
TESTStub
TESTData
User BA
Product Manager
CustomerUsers
CustomerExperience
CustomerExperience
CustomerExperience
CustomerExperience
Design
Business Value
Business Value
Business Value
Improvement
Innovation
Intelligence
Assessment
Insight
Learning
Maintenance
Operations
Delivery
Testing
Support
Cu
sto
me
r
Digital Assurance
Value Insight
Learn Learn
Monitor Monitor TESTStub
REALUsers
TESTData
REALData
TESTStub
USERCase
Bu
sin
ess
Value-Driven Delivery
idea
27 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Digital AssurancePocketbook
Paul Gerrard
NEW exclusive CA sponsored Pocketbook authored by Paul Gerrard, eminent Test-Transformation consultant, thought leader, teacher and international conference speaker.
Pre-order your FREE copy today from http://bit.ly/digital-assurance
28 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
‘Shift Right’ Becoming an Insight-Driven Business
The Digital Ecology
CONTINUOUS LEARNING & INSIGHT
Improve release quality, processes, and teams —
reduce production
errors by 98%
SEAMLESS, END-TO-ENDORCHESTRATION
Easily leverage existing tool investments to orchestrate
thousands of composite releases across diverse environments
RELEASE CYCLEAGILITY
Fully automate the release of agile applications through dev, test & production — improving
deployment time by 20x
SHIFT RIGHT
DIGITIAL ECOLOGY (ECOSYSTEMS OF ECOSYSTEMS)
29 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
* CA’s Analytics Reference Architecture
Data CollectorsD
ata
Agg
rega
torAgents
…
Probes
Machine/Log File Data
Insight-Driven
Existing Platforms
Custom Platforms
New Platforms
Partner Platforms
Analytics Engine
Dat
a In
ject
ion
AP
I
Dat
a A
cces
s A
PI
Service
Layer
Dat
a Ex
trac
tio
nData Processing (Speed)
Data Processing (Batch)
Data Bus
‘Shift Right’ Becoming an Insight-Driven Business
The Digital Ecology SHIFT RIGHT
30 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
T H E D I G I TA L EC O LO G Y
RUNDEPLOYTESTBUILDPLAN
INTAKE RequirementsUser StoriesRelease Plan
MODEL Import User Stories to Automatically Create, Visualize and Optimize Tests
Initiate Functional, Non-Functional and Security as Code
FUNCTIONAL Subset/Mask Test Data Create/Reserve Test Data Test Automation Library Ensure Mobile Experience
INSIGHT-DRIVEN
CONFIG/DEPLOY Provision Entire Stack Confirm Configurations Approve Changes Successfully Deploy Internal or External Cloud
INTEGRATIONRemove Constraints with Virtual Services Mobile, Web, App Server,
Middleware, Backend, MF 3rd Party Systems / API’s
CODEDevelop and Commit Code, Scan Code, Version Control, Continuous Integration. Complete Build and Initiate Release
AUTOMATION AUTOMATION AUTOMATION
Speed/Time-to-Market Quality/Availability
AUTOMATION
Cost/Financial Mix Risk/Compliance
Requirements Environments
Data Automation
CustomerExperience
NON-FUNCTIONAL Performance Engineering Simulate Backend Load Test Outlier Conditions Ensure Mobile Experience Security / Penetration
Common Goals “Big Picture” Issues
DESIGN SHIFT-LEFT SHIFT-RIGHT OPS
Node.Probe
Node.TestTDDBDD
ATDD
BPMNNimbus
Visio
Node.Data
Node.Learn
MEASURE/FEEDBACK Customer Experience Business Service View Application View Infrastructure View Dynamic Capacity Feedback loop
31 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD © 2016 CA. ALL RIGHTS RESERVED.
The Digital EcologyUse Case - Agile Architect Designer
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
BRINGS TRUE ARTIFICIAL INTELLIGENCE (AI) TO LIFECYCLE VIRTUALIZATION Virtualize services without requiring any knowledge or
decoding of the service protocols
Applies a genome sequence alignment algorithm, discovers byte-level patterns in message protocols
Now virtualize a much wider range of protocols without requiring a new DPH
HIGH ACCURACY: 99.6 – 100%
Increased speed and accuracy with Entropy Weighting + Message Clustering
The more data a service observes the data, more intelligent it becomes
Perfect for performance testing where we deal with tons of data
32 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
NODE PROBESYSTEMATIZED
(EPISTEMIC & SYSTEMICENTROPY)
CHAOS HARMONISATION LIBERATION
SENSE-ANALYZE-RESPONDPROBE-SENSE-RESPONDACT-SENSE-RESPOND
Lear
nin
g C
ult
ure
s Teachin
g Cu
ltures
High Abstraction
Low Abstraction
Complex
Chaotic
Lear
nin
g C
ult
ure
s Teachin
g Cu
ltures
High Abstraction
Low Abstraction
Complex Complicated
Lear
nin
g C
ult
ure
s Teachin
g Cu
ltures
High Abstraction
Low Abstraction
Obvious
Complicated
SENSE-CATEGORIZE-RESPOND
FASTFEEDBACK
SLOW FEEDBACKTHE DIGITAL ECOLOGY
DOMAIN OF DISCOURSE
33 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
The Digital Ecology
Blog - Legacy is your Legacy!
34 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Erik Simmons
Value-Driven Delivery
Copyright © 2016 nuCognitive LLC. All Rights Reserved.
NEW world exclusive CA
sponsored Webinar with nuCognitive.
Register now value-stream.net
35 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
DESIGNOPS
VALUE-DRIVEN DELIVERY
Cognitive Adaptive Adoption (CA-A)
1Cognitive Adaptive Learning
2Cognitive Adaptive Testing
3Cognitive Adaptive
Technology
4Cognitive AdaptiveDelivery
37 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
% of Regression Tests Passed for Provisioning:Virtual Services Test Data
% of Successful:Virtual Services
Provisioned Test Data Deployed
% of Regression Tests Passed for: Environment
Provisioning Build
Deployment
% of Successful: Environments
Provisioned Builds Deployed
# of Automated Tests Executed
% of Tests Passed # of Defects
Found in Test # of Defects
leaked from Dev % Test CoverageQA Feedback Time
(Time to Fully Test a Build – Target: < 4 hours)
% of Virtual Services Defined
% of Test Data Elements Defined
# of Manual Test Cases
% of Automated Test Cases
Deployment Frequency to Stage
Change Lead Time Change Failure RateMTTR*
% of Sprint User Stories Modeled
# of QA builds received per Day
TEST
% of Regression Tests Passed for Application Monitoring Process Configuration
% of Successful App Monitor Initiation
% of Passed Configuration Regression Tests
Cognitive Adaptive Testing (CA-T)
Validate Build Promotion Criteria
Golden Build & Data Stream
Received
Auto Generate Virtual Services
Definition and Test Data Definition
Auto Generate Tests (manual &
automation) Validate Build Configuration
Provision Environmentand Deploy
Build
ProvisionVirtual Servicesand Test Data
Application Monitoring(Measure)
Enhance ModeledRequirements(Feature Level)
Golden Deployment
AutomatedExecution
Connected Intelligence
40 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Cognitive Adaptive Adoption (CA-A)The future is Value-Driven Delivery
40
CA Project & Portfolio Management
Unify long term strategy, investment and portfolio planning.
CA Agile Central
Collaboratively plan, prioritize and track work across the enterprise.
Develop & Test
Synchronize efforts to dramatically speed app development & increase quality
Manage & Monitor
Make a great customer experience a competitive advantage
Release & Deploy
Control the release process, to continuously advance application quality, improve the customer experience and reduce costs.
MinimumViableDelivery
Minimum Viable Experience
Minimum Viable Quality
Value-Driven Delivery
(Minimum Viable-Value-Validated)
Executives
BUSINESS INITIATIVE
Complexity-Informed Organizational Change
The Digital Ecology
MinimumViableProduct
CUSTOMER
THINK
MAKE
© 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
41 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Q & A
42 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
© 2016 CA. All rights reserved.
Thank you!
43 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
What next?
44 © 2016 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD
Recommended Sessions
SESSION # TITLE DATE/TIME
DO5X22EManaging Test Data Across Distributed and Mainframe
Systems 11/15/2016 at 1:00 pm
MFX59EHigh Performance Masking and Test Data Generation for
IMS and DB211/15/2016 at 1:00 pm
@CAWORLD #CAWORLD © 2016 CA. All RIGHTS RESERVED.46 @CAWORLD #CAWORLD
DevOps – Continuous Delivery
For more information on DevOps – Continuous Delivery, please visit: http://cainc.to/PiTFpu
Director of Digital Assurance
Jonathon Wright
@Jonathon_Wright
SlideShare.net/Jonathon_Wright
LinkedIn.com/in/Automation
https://www.ca.com/us/trials/ca-agile-requirements-designer.register.html