leveraging analytics for devops
TRANSCRIPT
Sumo Logic Confidential
Michael FloydHead of Developer Programs
Leveraging Analytics for DevOpsBuilding, Running and Securing Modern Applications
Sumo Logic Confidential
Agenda
•Three Pillars of the Digital Transformation•The DevOps Conundrum•Pain points for DevOps Teams•Gauging the Health of your release cycles•Visibility Through Real-time Monitoring •Sumo Logic Solutions
Sumo Logic Confidential
A Perfect Storm - Shift in App DevelopmentCompanies are retooling their entire technology stack, adopting cloud services, and building continuous delivery processes to unlock agility
___________________________
1. The rise of public cloud platforms like AWS2. New technologies like Docker containers 3. DevOps adoption - Frequent release, automate more
____________________________
We are generating an ever-increased variety, velocity, and volume of data.
Sumo Logic helps customers build, run, and secure their applications with confidence in this new world. We help developers get deep, real-time visibility into their entire toolchain and production environment to help create better software faster.
Sumo Logic Confidential
Digital Transformation
DevOps Adoption
• More than 80% of companies are engaged in Digital
transformation initiatives
• Cross-functional DevOps and Continuous Delivery
• CD is having a significant impact on revenue growth
*EMA Automating for Digital Transformation Survey (Oct ‘15)
* 2016 State of DevOps Report, Puppet Labs
Sumo Logic Confidential
The DevOps ConundrumCustomers want reliable, cloud-hosted software applications they can trust to be fast, highly available, easy to use, and bug free.
___________________________
To meet these challenges, DevOps teams are adopting continuous delivery as a way to deliver higher quality software more frequently.
____________________________
Frequent releases leads to greater complexity. Automation obscures complexity. DevOps needs visibility across the DevOps toolchain.
DevOps requires a new breed of log analytics tools that runs at cloud-scale, employs predictive algorithms, and can be integrated with a host of DevOps tools throughout the entire continuous delivery pipeline, not just server data.
DevOps Pain Points
DevOps Pain Points
Sumo Logic Confidential
DevOps Leads to Complexity
Stages of a release cycle: • Commit Stage -
– Pull code from the DB, Compile– Commit tests– Assemble code profiling and analysis– Store reports, metadata, binaries to artifact
repository• Acceptance Stage -
– Configure environment– Deploy binaries– Run smoke test, acceptance tests, UAT
• Capacity Stage• Production Stage
Sumo Logic Confidential
Why is this important?
Machine data comes from:Applications
• App data • System data• Network data
DevOps Tools• Database• Source Control• Continuous Integration• Repo Management• Configuration Management• Build• Release Automation• Testing
We are generating an ever-increasing variety, velocity, and volume of data
Sumo Logic Confidential
The DevOps Challenge
No Consistency • Ops is spending more time troubleshooting • Development is drawn into production
troubleshooting• Performance and availability problems have
increased
No Centralization — Simply put, log data is everywhere
• Logs are distributed across locations in the cloud or various servers
• Many locations of various logs on each server• SSH, GREP, and RegEx doesn’t scale
No Visibility - High-value data is buried in petabytes• Expertise required to mine data• Meaningful views are difficult to assemble• No real-time visibility• Immense size of Log Data
DevOps teams are challenged by accelerated release cycles that lead to new deployment complexity, increased performance and availability issues, and difficulty syncing multiple development workstreams.
Accelerate Cloud Adoption
Visibility and Automation
Real Time and Continuous
Sumo Logic Confidential
How Can Sumo Logic Help?Benefits
Real-time visibility into your application at every stage of the lifecycle
No integration issues - Monitor machine data anywhere, independent of its source, location or format
No more parsing data. DevOps teams can focus on their jobs instead of supporting a log analytics tool
Significantly reduce time developers spend troubleshooting issues in production (up to 90%)
Improved application performance - Monitor and diagnose performance and availability issues in real time
Streamline frequent release cycles, improve software quality
Improve staff efficiency - get a centralized viewpoint that both DevOps and IT Ops can share
Immediate time to value & reduced TCO via SaaS
Sumo Logic practices DevOps, releases latest code to product weekly. Status is publicly available at http://status.sumologic.com/
Sumo Logic Confidential
DataDirect Cloud
IndustryData Connectivity
Sumo Logic Use CaseDev, DevOps, IT Ops
Business Case● Provides data connectivity via OData, ODBC, JDBC.● Collection of Sumologic dashboards that measure key
metrics focused around DataDirect Cloud user experiences.
● Engineering actively monitors the DCCC to detect anomalies in usage patterns and take appropriate actions
● Intuit uses it for real-time connectivity for 10,000 Salesforce users to Oracle data behind their corporate firewall.
● For monitoring JVM memory, code was developed using JMX to feed metrics from AWS into Sumologic providing a 360 view of the systems.
“Sumologic has delivered big data analytics throughout the organization, and we did not have to engage our data scientists for the project.”
-- Eric Brown, Cloud Engineering Manager
Customer Insights
Sumo Logic Confidential
Github AnalyticsGauging the health of your release cycle
Sumo Logic Confidential
Github Basics
Git - 42.9% of all developers; most widely used SCM toolGitHub - 12 million users and more than 31 million repositoriesUses Cases:
• Open source contribution• Traditional Software Development (private)• Content creation (Gists, wikis)• Social sharing
Sumo Logic Confidential
Github Workflow and Continuous Delivery
Workflow:•Create a branch•Add commits •Open a PR•Deploy•Merge
Sumo Logic Confidential
Gauging the Health of Your Releases
Anticipate potential volatility or risk. Indicators of a risky release include:
• Large volume of files committed, lines changed just before a release.
• Large number of PRs opened and left unattended.• Large number of reopened issues.• Significant changes in the branches of specific projects.
Sumo Logic Confidential
Github v3 APIs
Sumo Logic Confidential
Sumo Logic DashboardingMonitoring and charting allows you to visualize trends in activity, repo data in real time.
COMMITS• Commits over time• Commits by
repository• Top 10 Commits by
user
PULL REQUESTS• Pull Requests over
time• Pull Requests
opened by repository
• Pull Requests opened since…
ISSUES• Open, closed over
time• Open, closed by
repository• Oldest Open issues
Sumo Logic Confidential
What can your Repo Tell You?
Sumo Logic Confidential
Sumo Logic Confidential
Visibility into Team Productivity
• Number of commits, pull requests, issues. • Comment activity • Impact of a pull request: the number of both files and lines
added or deleted.• Impact of a process/policy change on team/individual
productivity.
Sumo Logic Confidential
Securing Intellectual Property
•Monitor and identify potential security breaches.•What is considered “normal” access and usage?• Pull, push, change visibility, merge and close PRs • Look for trends that identify patterns • Create a baseline of what’s “normal.”
• Where does your organization’s intellectual property reside and who has access to that IP?
Sumo Logic Confidential
Sumo Logic Confidential
Sumo Logic Confidential
Application Visibility at Every StageSumo Logic delivers a comprehensive strategy for monitoring, tracking and troubleshooting applications at every stage of the build, test, deliver, and deploy release cycle. We help organizations like Chef, Pingboard and Outsmart Games to gain visibility across the entire continuous delivery pipeline as they release frequently and automate more.
Streamline Continuous Delivery
1. Get real-time visibility into your apps from code to deployment.2. Free-up developer resources - No more parsing data. Reduce time
developers spend troubleshooting. Focus on their jobs instead of supporting a log analytics tool.
3. Avoid tools integration hassles - Monitor machine data anywhere, independent of its source, location or format.
4. Deliver software quality - Monitor, track and troubleshoot your entire application stack from code to Docker containers, continuous integration to continuous delivery.
5. Improve staff efficiency - Get a centralized viewpoint that both Dev and Ops can share.
Sumo Logic Confidential
Where Sumo Logic Helps
Sumo Logic Confidential
Summary
• Look for Indicators of a risky release• Consider the number files, lines added/deleted• Use trends to determine Impact of a pull request,
policy or process change.• Set a baseline for “normal” access and usage• Identify where intellectual property resides, who has
access