devops transformation in the rational collaborative lifecycle organization
TRANSCRIPT
Robbie Minshall
Nov 11th, 2014
Transformation day – 590 Madison Ave, NYC
CLM Development Self Improvement and Transformation
2
Market shifts are fundamentally changing the way businesses approach software driven innovation
Macro Business EnvironmentIncreasing regulatory environments
drive the need to reduce riskEmpowered Users
Consumerization of IT drivesthe need for apps with high quality customer experience
Technology TrendsMobile, social, big data, cloud, intelligent/connected systems
drive the need for agility
Mobile
Cloud
Intelligent/Connected Systems
Social
Big Data
Inhibitors Complexity: Acquisitions, disparate technology, teams, culture, integrations
Culture: Geographically disperse team; cross organizational complexities; cross discipline collaboration, skills
Business: KLO spending outpacing innovation, Processes based on traditional approaches, Failure with clients is not an option but speed is essential, new business
modelsTools: Siloed and perpetuate culture and traditional organizational structures
Multi-sourcingIncreasing outsourcing drive
the need for governance
Systems of Record
Systems of Interaction
Continuousclient
experiencePartner value
chainCloud-based
Services
Systems of Engagement of customers
experience production delays
>45%
of outsourcedprojects fail to meet
objectives
>50%
of budgets devoted to maintenance and
operations
>70%
to deliver even minor application changes to
customers
4-6 weeks
DEVELOPMENT/TESTSpeed mismatch between faster moving front office and slower moving back office systems, delaying time to obtain feedback
SUPPLIERSDelivery in the context of agile
OPERATIONSRapid app releases impact system stability
and compliance
LINE-OF-BUSINESSTakes too long to introduce or make changes to
mobile apps and services
CRM HR
DB ERP
Inefficient software delivery impacts the entire business
3
Acceleratesoftware delivery
–for faster time to
valueBalance speed,
cost, quality and risk –
for increased capacity to innovate
Reduce time to customer
feedback – for improved customer
experience
ContinuousMonitoring
Collaborative Development
Continuous Release and Deployment
ContinuousCustomer
Feedback and Optimization
ContinuousBusiness Planning
ContinuousTesting
Operate Develop/ Test
Deploy
Steer
DevOps –Continuousfeedback
DevOps: IBM Point of ViewDevOps: Enterprise capability for continuous service
delivery that enables clients to seize market opportunities and reduce time to customer
feedback.
People Process Technology+ +
• We will apply DevOps models of Solution Development to two distinct kinds of Application or Solution models
• Legacy Solutions – Updates to solutions already in place, or some new development under constraints that require traditional models
• Next Gen Solutions – Greenfield solutions developed without traditional constraints
• In both cases there is value in applying DevOps models, techniques, and capabilities to enhance IBM software products
Two Models of Development of Next Generation Solutions
Legacy Solutions
Next Gen Solutions
5
Use DevOps to reduce cost and
risk
Use DevOps to increase speed
Our DevOps Practices
6
Next Gen Solutions
Legacy Solutions
Goals Business Benefits
Collaborate across the entire development lifecycle
Reduce Rework and establish priorities across the product stack through SPC.
Experiment with Software as a Service and work with customers on requirements through the delivery of IBM DevOps Services and Cloud Platforms.
Automate to boost development/deployment productivity
Automated Quality assurance (tests) and deployment automation in all areas reduce cost and free up resources with UCD.
Delivery new capabilities to production in hours through DevOps processes using IBM Urbancode Deploy and Softlayer.
Measure and Optimizecontinuously
Measure and improve planned outages, performance and deployment failures improving stability and trust.
Measure active engagement of our offerings and responses to new features such as Quick Planner.
Reduce costs and risk of Legacy Solutions to enable growth and experimentation
IBM Rational CLM team adopts DevOps to deliver innovative solutions
Increased releases by 300% by reducing 12-month
delivery cycles to quarterly cycles
Automated deployments projected to save 2+ million per year
Continuous self hosting (jazz.net) deployments provide
constant feedback
Reduced deployment timesby 92% with IBM Deploy
capabilities
Refocused resources from 58 to 80% of development
focused on innovation and delivering new capabilities like
IBM Bluemix Solution Components
• IBM® Rational® Requirements Composer™
• IBM® Rational® Team Concert™• IBM® Rational® Quality Manager™• IBM® Infosphere® Optim Test Data
Management™• IBM® Security AppScan Enterprise™ • IBM® Rational® Focal Point™
• IBM® Worklight™• IBM® UrbanCode Deploy™
Lifecycle Measurements 2008 2010 2012 – 2014 Total Improvement
Project Initiation 30 days 10 days 2 days 28 days
Groomed Backlog 90 days 45 days On-going 89 days
Overall Time To Development 120 days 55 days 3 days 117 days
Composite Build Time 36 hours 12 hours 5 hours 700 %
BVT Availability N / A 18 hours < 1hour 17 hours
Iteration Test Time 5 days 2 days 14 hours 4 days
Total Deployment Time 2 days 8 hours 4 hours -> 20 minutes
2 days
Overall Time To Production 9 days 3 days 2 days 7 days
Time Between Releases 12 Months 12 Months 3 Months 9 Months
Innovation / Maintenance 58% / 42% 64% / 36% 78% / 22% +20% / -20%
Double-digit revenue growth, increased client adoption, improved client satisfaction
8
How IBM Rational Products have improved!
Summary of Practices from CLM transformation
1) Expand agile practices beyond development and test to include clients, business stakeholders and operations to breakdown silos and improve outcomes.
2) Continuously test using automation and virtualization to eliminate long backend test cycles and increase quality.
3) Build a delivery pipeline leveraging tools-as-a-service that enables developers to commit code, test, and deploy to a production environment in minutes reducing the need for rework and maximizing productivity.
4) Experiment rapidly by delivering instrumented capabilities which enable the team to make fact-based decisions and quickly evolve towards an optimal solution.
5) Create a culture of continuous improvement leveraging measures of effectiveness and efficiency to ensure you’re getting better.
9
Continuous Delivery Pipeline
10
Continuous Delivery Pipeline
DevelopTest (continuous) Interactive
TestingUsability Test
Security Pen testing
Unit Test
Production(on demand)
Production Environment
System Test
Performance Test
Integration Test
Function Test
Build
BuildProduction-Like Environment Production-Like
Environment
• Ship ready at the end of every sprint• Shift testing left and automate as much as possible• Use the same deployment mechanisms everywhere• Strive to maintain a constant state of ship-readiness• Treat Infrastructure as Code
DeploymentsDeploy Golden Topology
Develop DevOps Services
11
Developers launch test from their
workspace
Executes 10000s of Junits
Rapid install and smoke Tests
Functional and systems tests on Golden Topologies
BVT
Continuous Integration and Test
As applications get more complex, test environment set up becomes a key inhibitor • Increasing expense of
standing up complex environments
• Delays caused by lack of system availability
• Third-party services can be especially costly
• Testers spend more time setting up tests than testing
30-50%The average amount of time testing
teams spend on setting up test environments, instead of testing
$5-30 millionThe typical investment to build a single
test lab for a Fortune 500 company. Most have dozens …
Software Defined EnvironmentsTreating Topology Patterns as code
Standardized Golden Topologies evolve over time. How are these patterns managed?
Treat topology definitions and automation as code Version everything Automate deployment Manage Versions Automate Testing Avoid Sprawl
13
IBM Confidential14
Best practices
Capture golden topologies using Infrastructure as a Service and Virtualization
Automate fast moving pieces (applications) on top of Golden Topologies
Provide barrier free access to provisioned topologies
Focus governance on monitoring and usage patterns not restrictions
Standardize Test Automation inputs (properties) targets (golden topologies) outputs (results)
What is The PureApplication System?
System InfrastructureInherits the
capabilities of PureFlex System
Application Platform
Integrated Server, Storage, Network
Power Management Storage & VM Optimization
Virtualization Integrated System Management
Provisioning Security
Monitoring IT Lifecycle Management
System design
Application Optimization System wide Management
Automation & Scaling Caching & Elasticity
Application Centric Provisioning Usage Metering
Security Monitoring
App Lifecycle Management License Management
Self-service Data management
Integrates an application platform
optimized for enterprise
applications
Application patterns from IBM and partners
• 100+ ISV business applications• Business intelligence
• Business process management• Web experience (Portal)
Patterns of Expertise
PureApplication System adds deep application-aware value to its PureFlex foundation!
15
Reduce test deployment costs by 92%
SCM Build Automation
IBM Endpoint Manager
QA PROD
Provision platformExecute application deployment and manage settings
across environments
Patch/update
Publish build
Pull changes
OpenStack
Platform Config Management
Environments
Deploy early and often to ensure
higher quality and faster releases using repeatable, reliable,
and managed automationDEVDEVDEVDEV
IBM PureApplication System
IBM UrbanCode Deploy with Patterns
16
Development cycle
FEATURE / RUN REPO
‘PIP
ELIN
E’
BUILDAUTOMATED INTEGRATION
TEST
UNIT TEST
FEATURE/RUN
SVT
PERFORMANCE
SELF HOST STAGING PROD
IBM IINTERNA
LCUSTOMER
QA and Self Hosting Customer Deployment
IBM Common Cloud Stack
Deploy Golden Topology
Traditional Infrastructure
Deploy and manage Golden Topology
Wants instant access to
topology w/ latest build or to reproduce issue
Easily provision and manage build
infrastructure
Can dynamically provision Golden
Topology to provide a scalable regression Can
automatically deploy to
production servers
based on test results
Can get Golden Topologies for latest builds and focus on
real test engineering
IBM is investigating providing our automation in open source
project via JazzHub
17
IBM Confidential
Build Confidence with a Single View of Quality
18
Ready to deliver?Single view of completenessAbility to quickly drill down on problems
Self Hosting
JAZZ is the production system There are 2 staging systems
BLUES is the continuous upgrade system SOUL is the testfix and pre-prod upgrade system
Staging1 Staging2 Production
Copy back to Staging every 6 months (latest data)
JAZZ.NET SPRINT PROCESS
Upgrade Staging 2 (SOUL)Deploy to production
Copy production to Staging 2
IBM Confidential20
Savings and innovations
21
What is Docker
Simple APIs and readable Dockerfiles promote forking and sharing of code GIT/maven style repositories
Layered images promote Continuous Delivery processes and sharingLight weight images lend themselves to productive local environments to test
distributed scenarios
Wouldn’t it be nice if ….
You never manually installed again You never had any more issues where it “works on my desktop”
Software engineers had self service access to production like topologies Software engineers could write automated tests that could validate production
environments Your software engineers to actually do Behavior and Test Driven Development
You could TRUST your ability to Continuously Deploy your application You could KNOW when issues where introduced and what introduced them
Deployment choices where based on delivering value, not the cost of the deployment
22