cloudstack dc meetup - apache cloudstack overview and 4.1/4.2 preview
Post on 16-Jan-2015
1.864 Views
Preview:
DESCRIPTION
TRANSCRIPT
Chip Childers
VP of Apache CloudStack | Apache Software Foundation
Principal Engineer | SunGard Availability Services
chipchilders@apache.org | twitter: @chipchilders | irc: chipc on freenode
Let’s start with some questions for you..
What’s Apache CloudStack? Apache CloudStack is open source
software designed to deploy and manage large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform.
CloudStack is a Top-Level Project at the Apache Software Foundation.
We Enable Cloud Operators
To design, install, support, upgrade and scale their diverse cloud environments
Application Owners To easily consume infrastructure services, so that infrastructure
gets out of the way of delivering applications to the end users
So They Can Enable
The Application Users
Your end users want access to their applications, all the time from anywhere.
They couldn’t care less about the environment supporting the apps they use…
They care about the business results they achieve using these applications.
Benefits of CloudStackSelf Service
Capit
al Le
vera
ge
Work
forc
e L
evera
ge
Management Automation
WorkloadStandardization
Remove IT as a service delivery critical path
Reduce IT operational costs
Consistent application and service deployment
Usage Metering
CentralizedManagement
SmarterVirtualization
Visibility into user and line of business usage
Manage complete infrastructure, regardless of scale
Drive reduced capital requirements
We’ve got a “few” users…(Literally hundreds)
Why do we care about the users? We are the users Builds the next generation of developers Drives project sustainability Improves quality
Users Driving the Project leads to Strong support for both traditional and cloud-era workloads Flexible deployment options and infrastructure choice Real-world experiences with scale Upgrades that work New technology integrations by and for the operators Testing of our APIs from diverse consumer tools
So what can I do with it?
Layer 3 Networking (EC2 Style)
…
DB Security Group
WebSecurity Group
… …
Web VM
Web VM
Web VM
Web VM
DB VM
Web VM
DB VM
Web VM
Guest Virtual Layer-2 Network
Guest 1 VM 1
Guest 1 VM 2
Guest 1 VM 3
Guest 1 Virtual Network 10.1.1.0/24
Gateway 10.1.1.1
Guest 10.1.1.2
Guest 10.1.1.3
Guest 10.1.1.4
Guest 1 Virtual Router
Guest 2 VM 1
Guest 2 VM 2
Guest 2 VM 3
Guest 2 Virtual Network 10.1.1.0/24
Gateway 10.1.1.1
Guest 10.1.1.2
Guest 10.1.1.3
Guest 10.1.1.4
Guest 2 Virtual Router
Public IP 65.37.141.2465.37.141.80
Public IP 65.37.141.1165.37.141.36
Internet
Multi-tier Network
Private IP10.1.1.112
DHCP, DNSUser-data
Public IP 65.37.141.112
10.1.1.1
Web VM 1
10.1.1.3
Web VM 2
10.1.1.4
Web VM 3
10.1.1.5
Web VM 4
NetscalerLoad
Balancer
Private IP10.1.1.111
Public IP 65.37.141.111 Juniper
SRXFirewall
Virtual Router
Virtual Network 10.1.1.0/24VLAN 100
Virtual Network 10.1.2.0/24VLAN 1001
10.1.2.21
10.1.2.18
10.1.2.38
10.1.2.39
10.1.2.31
App VM 1 10.1.3.21
Virtual Network 10.1.3.0/24VLAN 141
10.1.2.24
App VM 2 10.1.3.45
10.1.3.24DB VM 1
DHCP, DNS, User-data
DHCP, DNSUser-data,Source-NAT, VPN
Public IP 65.37.141.115
Virtual Router
Virtual Router
Unified Multi-tier Network
10.1.1.1
Web VM 1
10.1.1.3
Web VM 2
10.1.1.4
Web VM 3
10.1.1.5
Web VM 4
Virtual Network 10.1.1.0/24VLAN 100
Virtual Network 10.1.2.0/24VLAN 1001
10.1.2.31
App VM 1
Virtual Network 10.1.3.0/24VLAN 141
10.1.2.24
App VM 2
10.1.3.24
DB VM 1
Virtual Router Customer
Premises
IPSec or SSL site-to-site VPN
Internet
Monitoring VLAN
Virtual Router Services• IPAM• DNS• LB [intra]• S-2-S VPN• Static Routes• ACLs• NAT, PF• FW [ingress & egress]• BGP
Load Balancer
How does CloudStack do this?
Infrastructure Model
Management Server Farm Management and provisioning tasks
Zone Collection of pods, network offerings and secondary storage
Pod Collection of clusters in the same failure boundary
Cluster A grouping of hosts and their associated storage
Hosts Servers onto which services will be provisioned
Primary Storage VM disk storage
Network Logical network associated with service offerings
Secondary Storage Template, snapshot and ISO storage
Zone
CloudStack Pod
Cluster
Host
HostNetwork
PrimaryStorage
VM
VM
CloudStack Pod
ClusterSecondary
Storage
Deployment Architecture
Hypervisor is the basic unit of scale. Cluster consists of one ore more
hosts of same hypervisor All hosts in cluster have access to
shared (primary) storage Pod is one or more clusters, usually
with L2 switches. Availability Zone has one or more
pods, has access to secondary storage.
One or more zones represent a cloud
Pod 1
….
Cluster N
L2
Host 2
Cluster 1
Host 1 PrimaryStorage
Zone 1
….
L3
SecondaryStorage
Pod N
Management Server Cluster
Internet
Management Server Cluster
MS is stateless. MS can be deployed as physical server or VM
Single MS node can manage up to 10K hosts. Multiple nodes can be deployed for scale or redundancy
RHEL 5.4+, Ubuntu 10.0.4, Fedora 16
Replica
InfrastructureResources
User API
Admin APILoad
Balancer
Management Server
Management Server
MySQL
Replication
Software Architecture
Management Server
Orchestration Engine- Drives long running VM
operations- Syncs between resources
managed and DB- Generates events
Resource Management
Cluster Management
JobManagement
DB
UICloud Portal
CLIOther
Clients
Deployment Planning
Network Gurus
Network Elements
Hypervisor Gurus
DatabaseAccess
Alert & EventManagement
Plu
gin
AP
I
Resource API
Hypervisor Resources
Network Resources
Storage Resources
ImageResources
SnapshotResources
REST API
OAM&P API End User API EC2 APIPluggable Service API
EngineOther APIs
Security Adapters
Account Management Connectors
ACL & Authentication- Accounts, Domains, and Projects- ACL, limits checking
Services API
Ser
vice
s A
PI
Console Proxy Management
Template Access
HA
Usage CalculationsAdditional Services
Event Bus
Message Bus
Usage Server
Got Scale?
Running in production at >30,000 physical hosts, supported by only 4 management server instances
Even greater scale by using CloudStack in a Regional model Remember: The separation of control, management and data planes is critical for
cloud platform scale.
Upcoming Releases
4.1.0 - currently being voted on for release
4.2.0 - entering feature freeze this week
What’s in 4.1? Lots of internal architectural changes (we want to speed up
development of new integrations) 20 new features 24 “improvements” 155 bug fixes
Architectural Changes Converted from custom injection framework to Spring Lots of refactoring:
Storage plugin model Network plugin model API implementation refactored (remains compatible)
There’s a theme here: We are making CloudStack more flexible, both for developers and operators…
New Features in 4.1API, UI and Integration Options: AWS style regions Event pub-sub framework (RabbitMQ implementation) Advanced search within the UI API Server request throttling API Discoverer Service Users resetting their own passwords Users directly changing their API keys EC2 query API Cloudmonkey CLI
New Features in 4.1Networking: Nicira integration adds L3 functionality Persistent networks without a running VM Autoscale (Netscaler implementation) Juniper SRX & F5 Big IP inline mode Egress FW rules for guest networks Open vSwitch support for KVM
New Features in 4.1Compute: Support for passing custom VMX settings to vSphere on VM
create Adding and removing Virtual NICs from VMs Reset SSH key within a VM
Storage: Volume resizing S3-backed secondary storage
Great, That’s 4.1… What about 4.2?
Many features proposed for 4.1 were moved to 4.2
(Remember that time-based release thing?) 58 New Features scheduled for 4.2!
16 of them are already finished, including testing Some of them won’t make the release (again, time-based!)
40 Improvements (same caveats as features)
Sample 4.2 Features Midonet and BigSwitch SDN
integrations Enhanced Baremetal provisioning VM I/O Throttling Hyper-V 2012 Support LXC Support Cisco VSG integration Cisco ASA 1000V VM Affinity Rules Eliminate NFS layer for S3
secondary storage Zone-wide primary storage Security group isolation in Advanced
Network zones
Dedicating resources to domains and accounts
IP Address reservation w/o a vNIC allocation
Improved synchronization between CloudStack and what’s actually running on the hosts
vSphere DVS support UI Plugin framework
And we’re just getting started…
Come join us at http://cloudstack.apache.org
top related