dreamforce 2016: releases management
TRANSCRIPT
Forward-Looking Statements
Statement under the Private Securities Litigation Reform Act of 1995:
This presentation may contain forward-looking statements that involve risks, uncertainties, and assumptions. If any such uncertainties materialize or if any of the assumptions proves incorrect, the results of salesforce.com, inc. could differ materially from the results expressed or implied by the forward-looking statements we make. All statements other than statements of historical fact could be deemed forward-looking, including any projections of product or service availability, subscriber growth, earnings, revenues, or other financial items and any statements regarding strategies or plans of management for future operations, statements of belief, any statements concerning new, planned, or upgraded services or technology developments and customer contracts or use of our services.
The risks and uncertainties referred to above include – but are not limited to – risks associated with developing and delivering new functionality for our service, new products and services, our new business model, our past operating losses, possible fluctuations in our operating results and rate of growth, interruptions or delays in our Web hosting, breach of our security measures, the outcome of any litigation, risks associated with completed and any possible mergers and acquisitions, the immature market in which we operate, our relatively limited operating history, our ability to expand, retain, and motivate our employees and manage our growth, new releases of our service and successful customer deployment, our limited history reselling non-salesforce.com products, and utilization and selling to larger enterprise customers. Further information on potential factors that could affect the financial results of salesforce.com, inc. is included in our annual report on Form 10-K for the most recent fiscal year and in our quarterly report on Form 10-Q for the most recent fiscal quarter. These documents and others containing important disclosures are available on the SEC Filings section of the Investor Information section of our Web site.
Any unreleased services or features referenced in this or other presentations, press releases or public statements are not currently available and may not be delivered on time or at all. Customers who purchase our services should make the purchase decisions based upon features that are currently available. Salesforce.com, inc. assumes no obligation and does not intend to update these forward-looking statements.
FY17 Release Management V2MOM Vision, Values, Methods, Obstacles, Measurements
Vision Release high quality, beneficial change to production quickly, frequently and seamlessly. Serve as data-informed, trusted advisors to internal teams and customers. Values 1. Great Customer Experience 2. Strong Leaders 3. Scale for Growth 4. Continuous Delivery
Innovation: 3 Major Releases Per Year Seamless, automatic upgrades with >700 new features each year
51 Major releases delivered
Automatic Updates Customization & integration
Features sourced by customer community
Manage your Agile development on Salesforce
Introducing:
Reports & Dashboards Sprints Teams Bug Tracking Release
Management Chatter
Mobile Update projects anywhere with Salesforce1
Social Collaborate on every sprint, bug, milestone, and team with Chatter
Analytics Custom reporting on every stage of the development cycle
Major Release Process
Feature Freeze
Release Freeze
Done Done Done Release to Internal Sandbox &
Production Instances
SB/R0 Releases • 67% of sandbox instances • Production instance where Salesforce has largest orgs
R1/R2 Releases • 25% of prod instances • All remaining instances
• Branch locked and check-in approval required • Incomplete features are turned off • Development begins on next release
Monthly Sprint Reviews Release Sprint Staggered Release
Scrum Teams and Functional Areas
Sign Off Scrum Teams
Sign Off
Apr May Jun Jul Sep Aug Oct
• 600,000 automated JUnit and Selenium tests • Continuous performance testing
• 120 million Apex tests written by customers • Other production tests
2 Release Roadmap
Using Agile and Automated Tests to Deliver Predictable, High-Quality Releases
• Before Agile transformation in 2006
o Struggle to release once a year
o More customer impacting bugs
• After Agile
o 3 releases per year with >90% on-time rate
o Fewer customer impacting bugs
Thu
Deploying Major Release with Minimal Disruption
Database Scripts Create New Schema for Use After the Application Release
Release Weekend
A Few Weeks Prior to the Release Fri Fri/Sat/Sun
Preinstall Release
5 Minute Downtime
Release Window to Switch to New
Version of DB Schema and Application
Weekend After Coverage
Patch Release Process
Patch Freeze
One Week ‘Sprint’ Finish Testing Staggered Release Without Downtime
Cloud Executives Sign Off on Release Quality
Thurs Thurs Tues Mon Wed Fri Thurs
Branch Locked Check-in Approval Required
AP CSx Release
EUx/NAx Release
Internal and CSx Release
APx Release
Checkpoint with Support
• 600,000 automated JUnit and Selenium tests • Continuous performance testing
Release to sandbox instance used for Salesforce orgs
Daily Release Process
Daily Release Freeze
24 Hour ‘Sprint’ Stage Release and Finish Testing
Staggered Release Without Downtime
Participating Teams Sign Off on Release Quality
12:00pm 12:00pm 3:00pm 3:00pm 6:00pm 8:00am
Branch Locked Check-in Approval Required
NAx Release
Internal, CSx and EUx Release
APx Release
• Minimum 60,000 automated tests • Performance testing as required
We plan for daily releases. Releases outside this schedule
are considered emergency releases.
Transforming How We Manage Releases
Metric Current Goal Downtime for releases 5 minute window for
major release No downtime
Release frequency Daily Continuous deployment of code independent of feature activation
Frequency of database schema changes
3 times per year As frequently as needed to pilot new features
Thank Y u