Intel IT’s OpenStack Journey Das Kamhout, Principal Engineer, Intel IT Cloud Lead Twitter - @dkamhout Email - [email protected]
Copyright © 2012, Intel Corporation. All rights reserved. 2
Agenda
Our Cloud Journey
Intel IT Hybrid Open Cloud – Goals and Reality
Summary
http://preview.tinyurl.com/IntelITOpenCloud
Copyright © 2012, Intel Corporation. All rights reserved. 3
Intel IT Vital Statistics
6,400 IT employees
– 54 global sites
91,500 Intel employees†
– 164 sites, 62 countries
67 Data Centers
– ~75,000 servers
>138,000 Devices
– >109K PCs (80%+ mobile)
– >38,000 Handhelds (60% BYO)
Source: Information provided by Intel IT as of Jan 2012. † does not include wholly owned subsidiaries that Intel IT does not directly support
Copyright © 2012, Intel Corporation. All rights reserved. 4
ODCA and Intel IT Cloud Maturity Model
1 Intel IT future state goals – subject to change – as of June 2012
IT Ops
App Owner
App Dev
End User
Consumers
4 Simple Compute
IaaS
Compute, Storage,
and Network
2010 Intel® Cloud 1.0
Minimal Industry Solutions
Simple SaaS (e.g. exp reports)
Legacy Apps
Industry Normalized?
2014 Intel Cloud 3.0
Federated, Interoperable, and Open Cloud
2011 Intel Cloud 1.5
Simple Compute IaaS
Compute, Storage,
and Network
Complex Compute IaaS
Early Industry Solutions
Simple SaaS (e.g. exp reports)
Cloud Aware Apps
Legacy Apps
2012 Intel Cloud 2.0
Open Industry Materializes
Full Private IaaS
Complex SaaS (e.g. B2B)
Private PaaS
Industry Normalizing
2013 Intel Cloud 2.5
Hybrid IaaS
Hybrid SaaS
Legacy
Hybrid PaaS
Cloud Aware Apps
In 2013 Hybrid applications will be the norm enabling low latency, lowest cost, improved security and seamless data sharing between services for end-user productivity.
Legacy Apps
Cloud Aware Apps
Copyright © 2012, Intel Corporation. All rights reserved. 5
Intel® IT Cloud Strategic Direction
Deliver the necessary changes in how we expose applications/data to improve end user productivity
Drive the transformation to a large-scale automated Hybrid Cloud infrastructure
Accelerate the transformation of the Enterprise IT industry to Cloud
Copyright © 2012, Intel Corporation. All rights reserved. 6
Intel’s Cloud Journey
Tomorrow
Hybrid Cloud Large
Private Cloud Limited
Public Cloud
Today
• 73% Virtualized (Traditional IT)
• 80% of New Services in the Cloud
• Under 1 Hour to Deploy Infrastructure
• Small number of SaaS apps in usage
• Land Applications in Minutes
• Open Cloud for Bursting Capacity
• SaaS for non-differentiated apps
Copyright © 2012, Intel Corporation. All rights reserved. 7
Agenda
Our Cloud Journey
Intel IT Hybrid Open Cloud – Goals and Reality
Summary
Copyright © 2012, Intel Corporation. All rights reserved. 8
Key Concepts
Abstract users from underlying Cloud providers
Support multiple cloud providers, both private and public OpenStack and non-OpenStack is the reality
Common identity and entitlement services for reuse across interfaces
Open Source first, minimize proprietary API lock-in
Minimize internal technical debt, utilize the community to scale
Stay pragmatic, as we scale – not always 100% greenfield
Copyright © 2012, Intel Corporation. All rights reserved. 9
Intel IT Cloud Future
Intel® Atom™ Intel® Xeon® Intel® Xeon® Phi™
Storage Compute Network
Physical Infrastructure
Infrastructure Services
App Platform Services Analytics Messaging Data Web
App Services Location Context Recommendation Identity
End User
Applications
Reusable Services empowering our end users
Copyright © 2012, Intel Corporation. All rights reserved. 10
6 Months
Infr
astr
uctu
re
As a
Serv
ice
Co
ntr
ibu
tors
Compute Storage Network
12-18 Months
Physic
al
Infr
astr
uctu
re
Pro
du
cers
Cloud Operating Environment
Intel Contributions
Compute (Nova)
Block Storage (Nova Volume)
Object Storage (Swift)
Network (Quantum)
Dashboard (Horizon)
OS Images (Glance)
Open-Source (OpenStack*)
Intel® IT Open Cloud IaaS Platform Solution Stack
Manageability
3 Months M
onitori
ng
As a
Serv
ice
Watcher (e.g. Nagios*)
Decider (internal)
Collector (tbd)
Actor (e.g. Puppet*)
Intel Contributions Open-Source Foundation
Inte
rfaces
GUI (Graphical User Interface)
API (Application Programming Interface)
Co
nsu
mers
3 Months
Release Cadence
Copyright © 2012, Intel Corporation. All rights reserved. 11
Function Intel IT Open Cloud (Private)
Compute OpenStack* - Nova Compute
Object Storage OpenStack* - Swift
Block Storage Gap – Cinder as target (reuse existing HW, and support new)
Load Balancers Using HW LB APIs – Direct integration with OpenStack* future
Networking Nova Network Now – move to Quantum with Grizzly
Auto Scaling Gap – Missing APIs (exploring HEAT. Ceilometer)
Monitoring Nagios* - Missing APIs (exploring HEAT, Ceilometer)
Configuration Puppet* - Missing APIs (exploring HEAT)
Backup and Recovery Snapshot to Object Storage
NoSQL Database Cassandra*, MongoDB* – Gap on APIs (exploring options)
Relational DB *SQL – Gap on APIs (exploring options)
Images Glance – Intel IT images, end user images later
Map Reduce – Analytics Hadoop* with APIs but without orchestration
DNS Missing APIs
Copyright © 2012, Intel Corporation. All rights reserved. 12
Intel IT Open Cloud – Details Now Key Technologies • Cloud – OpenStack* Essex • Monitoring – Nagios*
• Configuration – Puppet*
• Hosts – Intel Xeon 5600 Blades • Network – 10GBe • Storage – Scale out on 2U
Running cutting edge Web services, on a predominantly open source cloud.
OPEN CLOUD HOSTING ENVIRONMENT
COMPUTE NODES Cloud Controller Services • Volume Controller • Network Controller • Scheduler • Databases • API
Hosting Services • Authentication • DNS • Automation • Security Services
STORAGE NODES
REMOTE DESKTOP SERVICE
Tenant 1
Tenant 2
Tenant x
Load Balancer
CENTRALIZED MONITORING AND MANAGEMENT • Patch Management • Package Repository • Authentication • Monitoring
INTEL DMZ/ENCLAVE ENVIRONMENT
Load Balancer
NETWORK FABRIC
INTERNET ICC Firewalls
Integration with Support Desk and other Ops capabilities
Copyright © 2012, Intel Corporation. All rights reserved. 13
Focus Area Key Aspects
Technical Active/Active App Design – Software Design for Failure
Unified Monitoring/Manageability/Authentication
IT Service broker handling cloud on-boarding internal and external
Operational IT handling basic IaaS container levels externally, covering all IaaS internally
Business Single contract with Intel IT funding and showback to BUs
Liability/Indemnification at acceptable levels for associated risk
Intel IT Hybrid Cloud
INTERNET
INTEL SITE A
POD POD POD
INTEL SITE B
POD POD POD
EXTERNAL PROVIDER
POD POD POD
GLB
Fully Meshed VPN Tunnels
Copyright © 2012, Intel Corporation. All rights reserved. 14
Self Remediation Framework – for 99.99%
Load Balancer Load Balancer
COMPUTE NODES STORAGE NODES
NETWORK FABRIC
CLOUD ORCHESTRATION SERVICES
VM VM VM VM
APP A APP B APP N Capabilitie
s t
o W
atc
h
Monitor
Event or Alert Initiate Action Actio
n E
xecutio
n
WATCHER (Nagios*)
ACTOR (Puppet*)
DECIDER (Analysis and Correlation)
Copyright © 2012, Intel Corporation. All rights reserved. 15
Rules of Cloud Aware Apps Software Developer Changes
Shift to stateless cloud services − Assume and design for failure at all layers
Scale horizontally − Scaling up always has a break point, scaling horizontally ensures greater scalability
(close to “infinite” if you remove app bottlenecks)
Eventual consistency at the data layer
Shift to DevOps or NoOps model − Set rules/automation for desired effects, utilize APIs, continue to assume failure
− Never wait on IT, never wait on other software developers
− IT Infrastructure team should seem invisible
Implement true Web services for consumption
http://www.opendatacenteralliance.org/docs/DevCloudCapApp.pdf
Copyright © 2012, Intel Corporation. All rights reserved. 16
Areas to Close for Enterprise Keep VMs up for traditional/legacy apps:
1. Shared Block Storage – for boot volumes, and data
2. Live Migration for maintenance of hosts
3. Restart of instances when host fails
Enable a federated Hybrid cloud environment:
1. End users interface allowing for seamless use across zones, regions, and across clouds
2. Identity federated across instances and clouds
3. Orchestration across global/multiple instances
Highly Available Infrastructure Services (cloud built as cloud)
Secure, Auditable – Role Based Access, Regulatory Compliance, Audit Trails
Larger List - http://tinyurl.com/ChipInForEnterprise
Copyright © 2012, Intel Corporation. All rights reserved. 17
Agenda
Our Cloud Journey
Intel IT Hybrid Open Cloud – Goals and Reality
Summary
Copyright © 2012, Intel Corporation. All rights reserved. 18
Wrap Up - Summary
Our Direction = Federated, Interoperable and Open Cloud
• Strong success with our Enterprise Private Cloud
• Open Cloud in production to handle cloud architected apps, enterprise apps up next
• Hybrid now, later just call it Cloud
• Lots of space and opportunity for us all to contribute
• Seeking other large scale Enterprises paving the path
However, Enterprise IT will change massively in next 2-5 years
Copyright © 2012, Intel Corporation. All rights reserved. 19
Resources for You
• Engage with ODCA
• Learn about usage models
• Use the RFP Tool
• www.opendatacenteralliance.org
Over 300 Global IT leaders representing over $100B in annual IT spend
Learn more about IT@Intel best practices www.intel.com/it
Copyright © 2012, Intel Corporation. All rights reserved. 22
Legal Notices
This presentation is for informational purposes only. INTEL MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS SUMMARY.
Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
* Other names and brands may be claimed as the property of others.
Copyright © 2012, Intel Corporation. All rights reserved.