orchestration panel at cloud connect 2010
DESCRIPTION
Damon Edwards -- DTO SolutionsJohn Willis -- OpscodeAlex Honor -- ControlTier ProjectMark Hinkle -- ZenossDuncan Johnston-Watt -- Cloudsofthttp://www.cloudconnectevent.com/cloud-computing-conference/developing-for-the-cloud.php#WednesdayTRANSCRIPT
![Page 1: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/1.jpg)
Orchestration:The Next Frontier for Cloud Applications
Alex Honor, ControlTier Project
Damon Edwards, DTO Solutions Inc.
John Willis, Opscode Inc.
Mark Hinkle, Zenoss Inc.Duncan Johnston-Watt, CloudSoft Corporation
![Page 2: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/2.jpg)
You worried about…
![Page 3: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/3.jpg)
You worried about…
![Page 4: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/4.jpg)
Now you worry about…
![Page 5: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/5.jpg)
Now you worry about…
![Page 6: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/6.jpg)
How do you make all of that work together in the cloud?
![Page 7: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/7.jpg)
Orchestration!
![Page 8: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/8.jpg)
The Path to Orchestration
![Page 9: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/9.jpg)
The Path to Orchestration
1. Bring “Dev”, “Ops”, and “Biz” points-of-view and practices into alignment
![Page 10: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/10.jpg)
The Path to Orchestration
1. Bring “Dev”, “Ops”, and “Biz” points-of-view and practices into alignment
See also: #DevOps
![Page 11: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/11.jpg)
The Path to Orchestration
1. Bring “Dev”, “Ops”, and “Biz” points-of-view and practices into alignment
2. Fully automated infrastructure
See also: #DevOps
![Page 12: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/12.jpg)
The Path to Orchestration
1. Bring “Dev”, “Ops”, and “Biz” points-of-view and practices into alignment
2. Fully automated infrastructure
See also: #DevOps
See also: “Infrastructure as Code”
![Page 13: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/13.jpg)
Alex Honor (ControlTier)
Damon Edwards (DTO Solutions)
John Willis (Opscode)
Mark Hinkle (Zenoss)
Duncan Johnston-Watt (CloudSoft)
Q&A with Panel
Moderator
Agenda
![Page 14: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/14.jpg)
John WillisVP of Services - Opscode, Inc.
Orchestration and System Administration
![Page 15: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/15.jpg)
Infrastructure is Hard
![Page 16: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/16.jpg)
Fully Automated Infrastructure is Hard!
![Page 17: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/17.jpg)
1999Inventory, packaged file transfers and desktops
2005Unattended bare metal servers “very very” hard7k Nodes took 5 days w/90 success
2007 Unattended bare metal in under 10 minutesFully configured in under 3 mins
2008 Unattended server in 2 minutes 5000 servers in a week
201010k Nodes in under 5 minutes
![Page 18: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/18.jpg)
Managing Infrastructure Is HardHas Always Been
1980
1989
1999
2001
• Solve very little of the problem...
• Reach just a handful of large, enterprise customers
• Require custom implementations with large professional services
• Deployed exclusively on-premise
• Acquired by companies with large consulting organizations (IBM, HP, CA)
Proprietary Solutions
![Page 19: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/19.jpg)
Open Source SolutionsCfengineStarted in 1993 by Mark Burgess. He created a scientific approach to model systems and set a new paradigm for CM. DSL based, declarative, abstract, convergent and self documenting configuration management.
PuppetFounded in 2005 by Luke Kanies. Frustrated with Cfengine syntax and ability to adapt to real world configuration management, he made a quantum leap in making a DSL easier to use for declarative, abstract, convergent and self documenting configuration management.
ChefFounded in 2008 by Adam Jacob. A community leader working with Puppet on massively scalable fully automated infrastructures, Saw the problem as a “systems Integration” problem first and configuration management as a subcomponent.
![Page 20: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/20.jpg)
Industry Shifts
![Page 21: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/21.jpg)
Infrastructure is changing• Easier to get (good!) ...but harder to manage (bad!)
• Demand is dynamic
• Developers are crucial to Operations
• Web / Cloud services are proliferating ...and Enterprise is following along
• Manual configuration no longer a crutch
• Few tools to solve a ubiquitous problem
![Page 22: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/22.jpg)
Core Principles
• System Integration
• Infrastructure as Code
• Infrastructure API
• Community involvement
• Zero touch
![Page 23: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/23.jpg)
Infrastructure as CodeNodes -- Where recipes are applied
Roles -- Allow you to group together nodes
Cookbooks -- Recipes, Definitions, Attributes, Libraries, Files and Templates
Resources -- The basic unit of work in Chef - a resource might be a package, file or service
Providers -- A provider takes actions on resources. A node decides what provider should be used by default.
Metadata -- Defines cookbook dependencies and additional parts.
![Page 24: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/24.jpg)
Cookbooks
Distribution
Recipes, Attributes
Assets
Definitions, LWRP, Libraries
Metadata
![Page 25: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/25.jpg)
Roles
![Page 26: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/26.jpg)
Load Balancer Example
![Page 27: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/27.jpg)
Alex HonorProject Leader, ControlTier Open Source Project
Orchestration and Application Administration
![Page 28: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/28.jpg)
Classic Application Administration Problem
![Page 29: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/29.jpg)
Classic Application Administration Problem
![Page 30: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/30.jpg)
Classic Application Administration Problem
Complexity!
![Page 31: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/31.jpg)
Classic Application Administration Problem
Complexity!Changing procedures!
![Page 32: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/32.jpg)
Classic Application Administration Problem
Complexity!Changing procedures!Environment differences!
![Page 33: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/33.jpg)
Classic Application Administration Problem
Complexity!Changing procedures!Environment differences!Lack of repeatability!
![Page 34: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/34.jpg)
Clouds Make it Worse
![Page 35: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/35.jpg)
Clouds Make it Worse
Complexity!Changing procedures!Environment differences!Lack of repeatability! +
![Page 36: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/36.jpg)
Clouds Make it Worse
Complexity!Changing procedures!Environment differences!Lack of repeatability! +Transient infrastructure!
![Page 37: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/37.jpg)
Clouds Make it Worse
Complexity!Changing procedures!Environment differences!Lack of repeatability! +Transient infrastructure!Dynamic scale!
![Page 38: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/38.jpg)
Clouds Make it Worse
Complexity!Changing procedures!Environment differences!Lack of repeatability! +Transient infrastructure!Dynamic scale!Multiple providers!
![Page 39: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/39.jpg)
Command Dispatcher
![Page 40: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/40.jpg)
Command Dispatcher
![Page 41: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/41.jpg)
Command Dispatcher
![Page 42: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/42.jpg)
• Abstraction at several levels
Command Dispatcher Provides
![Page 43: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/43.jpg)
• Abstraction at several levels– Nodes
Command Dispatcher Provides
![Page 44: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/44.jpg)
• Abstraction at several levels– Nodes – Services
Command Dispatcher Provides
![Page 45: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/45.jpg)
• Abstraction at several levels– Nodes – Services– Management Procedures
Command Dispatcher Provides
![Page 46: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/46.jpg)
• Abstraction at several levels– Nodes – Services– Management Procedures
• Sequenced or parallel execution
Command Dispatcher Provides
![Page 47: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/47.jpg)
• Abstraction at several levels– Nodes – Services– Management Procedures
• Sequenced or parallel execution
• Plug-in control modules
Command Dispatcher Provides
![Page 48: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/48.jpg)
Example: Cluster Management
• Coordinate actions within a larger procedure
• Roll sets of tasks across sets of nodes
• Manage as whole or logical slices
![Page 49: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/49.jpg)
Example: Scale Differences
Wednesday 04:00
![Page 50: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/50.jpg)
Example: Scale Differences
Wednesday 04:00
Wednesday 11:00
![Page 51: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/51.jpg)
Example: Self-Service
![Page 52: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/52.jpg)
Command Dispatcher Projects
• Capistrano (capify.org)
• Fabric (fabfile.org)
• Func (fedorahosted.org/func)
Example command dispatchers…
![Page 53: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/53.jpg)
Command Dispatcher Projects
• ControlTier (controltier.org)– Workflow system on top of dispatcher– Web-based GUI and command line tools– Fine-grain access controls– Logging and reporting framework– Integrated with CMDB
Example command dispatchers (cont’d)…
![Page 54: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/54.jpg)
Mark HinkleVP of Community, Zenoss Inc.
Orchestration and Monitoring
![Page 55: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/55.jpg)
Legacy IT
Cartoon originally copyrighted by the authors; G. Renee Guzlas, artist
Different perspective, lack of coordination
![Page 56: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/56.jpg)
Legacy Monitoring Perspective
Types of Monitoring• Availability Monitoring – Binary, Moment in
Time• Performance Monitoring – Two
Dimensions, Time and State• Change Management – Comparisons of
states in Time• Event Management – Normalizing
Randomness• Synthetic Transactions – Simulated
Experiences• Business Service Management (BSM) –
$$$ Consequences of IT Performance
Data Collection• SNMP• SSH• WMI• Syslog• Proprietary Agents
![Page 57: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/57.jpg)
The Myth of the Nines
Availability % Downtime per Year Downtime per Month Downtime per Week
99.9% (three nines) 8.76 hours 43.2 minutes 10.1 minutes99.95% 4.38 hours 21.56 minutes 5.04 minutes99.99% (four nines) 52.6 minutes 4.32 minutes 1.01 minutes99.999% (five nines) 5.26 minutes 25.9 seconds 6.05 minutes99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds
•Average polling interval for monitoring? 5 minutes? •Even super human operations people can’t be alerted and take action in under 5 minutes. •One outage per year could drop service level to three nines.
![Page 58: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/58.jpg)
Legacy Systems Management: Fragmented Awareness
ConfigurtationDatabase
Process server
Agent
Analytics server
databaseProcess server
Agent
databaseProcess server
Agent
Analytics server
Provisioning Performance & Availability Management
Global dashboard is a difficult mash-up of disparate systems or doesn’t exist. No
communication, No automation
Multiple data models across disciplines with no common object model
Each management discipline managed has its own separate product (UI, process, database, and
domain specific language)Multiple agents required for each discipline and platform
database
Configuration Management
![Page 59: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/59.jpg)
Physical/Virtual/Cloud Infrastructure
Virtual Machine Virtual Machine
Op. System
Application Application
Op. System
Unlegacy Systems Management:Integrated Model, Interactive, Automated
![Page 60: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/60.jpg)
Example – Broadcast Company
• Servers are automatically built using configuration management software
• As servers are brought into service configuration management inserts hosts into CMDB used by monitoring database
• One way interaction between configuration management and monitoring system
• Reports are generated to determine which systems are compliant
Large premium television content provider serves national cable network with content served from Linux servers.
![Page 61: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/61.jpg)
Example - Geeknet
• Servers are automatically built using configuration management software
• Discovery tool finds infrastructure and populates a CMDB then spits out information to scripts that translate information to BIND configurations for DNS
• Monitoring tool adds hosts to polling tool to start monitoring servers for availability
• As infrastructure changes systems are updated automatically
• Servers can be spun up and managed in minutes, not hours automatically with little or no human interaction
Hundreds of servers, serving web, databases, and other infrastructure for some of the world’s most highly trafficked websites – over 40 million visitors per month.
![Page 62: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/62.jpg)
Unlegacy Future: Devops
OperationsDevelopment
![Page 63: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/63.jpg)
Duncan Johnston-WattCEO, Cloudsoft Corporation
Orchestral Manoeuvres in the Cloud
![Page 64: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/64.jpg)
The Application Mobility Manifesto
• Application mobility is the ability to …– Dynamically change some or all of the infrastructure that an
application is using without any disruption of service
– Optimize the location of application components in the cloud
– Bridge the gap between your private cloud and trusted third party cloud services providers
• Application mobility is achieved by orchestrating the cloud
• Application mobility is the “Missing Link” in Cloud Computing
![Page 65: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/65.jpg)
Demo: Application Mobility in Action
• EzBrokerage is implemented using CloudSoft’s Monterey middleware platform
• EzBrokerage benefits from two complementary policies
– Workload policy: ensures the service is adequately resourced based on server demand by managing the size of a pool and distribution of workload across it
– Geolocation policy: ensures the service is hosted in the right region based on client demand by managing the overall distribution of workload across multiple resource pools or clouds
![Page 66: Orchestration Panel at Cloud Connect 2010](https://reader033.vdocuments.us/reader033/viewer/2022060108/554fa255b4c905ad218b4b10/html5/thumbnails/66.jpg)
Alex Honor (controltier.org)
Damon Edwards (dtosolutions.com)
John Willis (opscode.com)
Duncan Johnston-Watt (cloudsoftcorp.com)
@damonedwards
@alexhonor
@mrhinkle
@duncanjw
@botchagalupe
Mark Hinkle (zenoss.com)