openstack on intel
TRANSCRIPT
OpenStack on Intel Billy Cox
Director, Cloud Builders
Software and Services Group
Intel Corp.
More Devices
>15 Billion Connected Devices2
1. IDC “Server Workloads Forecast” 2009. 2.IDC “The Internet Reaches Late Adolescence” Dec 2009, extrapolation by Intel for 2015 2.ECG “Worldwide Device Estimates Year 2020 - Intel One Smart Network Work” forecast 3. Source: http://www.cisco.com/assets/cdc_content_elements/networking_solutions/service_provider/visual_networking_ip_traffic_chart.html extrapolated to 2015
By 2015…
More Users
>1 Billion More Netizen’s1
More Data
>1 Zetabyte Internet Traffic3
Internet and device expansion drives new requirements for Data Centers
Why is IT Buying in 2011? Primary Triggers for New Server Purchases
29%
18%
17%
10%
20%
6%
Migrating to
Virtualization
Virtualization and host of application-based needs
are driving the majority of server purchases
3
Application
Upgrade New Application
Add Capacity
to Existing
Application
HW Consolidation
Source: Forrester Research survey, January 2011
Other
Common Threads for New Server Purchases
60%
38%
IT’s needs are varied, which requires targeted server platforms
4
…and EVERYONE is
concerned about
SECURITY
Virtualized Hosts
Physical Hosts
Source: Forrester Research survey, January 2011
>60% will be used where
POWER / SPACE is limited
34%
26%
30%
9% No Limitations
Space
Limitations
Power/Cooling
Limitations
Space AND Power/Cooling
Limitations
60% are likely to be VIRTUALIZED
Opportunity to save $25B in annual “excess” IT spend by 20153
Today’s Key IT Challenges
1. IDC Market Analysis, January 2010.
2. Source information in speaker notes
3. Source information in speaker notes
Today’s Technology Would Require Building 45 New Coal Power Plants to
Support 2015 IT Infrastructure2
Efficiency
70% of Respondents Saying Security is Top Concern In Moving to Public Cloud1
Security
IT will spend ~$2T on
deployment & operations thru 2015 unless smarter infrastructure radically simplifies management of virtualized environments.
Manageability
“We have seen lock-in return as a top concern….routinely seeking alternatives to proprietary virtualization and cloud computing technology “
August 2010
Lock-In
2005 2006 2007 2008 2009 2010 2011
Intel® Xeon® Processor Performance
Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or
software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on
performance tests and on the performance of Intel products, visit http://www.intel.com/performance/resources/limits.htm Copyright © 2010 Intel Corporation. * Other names and brands may be claimed as the property of others.
Xeon 5570 – Intel® Xeon® Processor X5570 (“Nehalem-EP 2.93GHz”, Quad-Core) Xeon 5680 – Intel® Xeon® Processor X5680 (“Westmere-EP 3.33 GHz”, Six-Core Magny Cours – AMD Opteron 6176 SE 2.3GHz
Xeon 3.80 – Intel® Xeon® Processor 3.80 2M L2 (“Irwindale 3.80GHz”, Single-Core) Xeon 5160 – Intel® Xeon® Processor 5160 (“Woodcrest 3.0GHz”, Dual-Core) Xeon 5470 – Intel® Xeon® Processor X5470 (“Harpertown 3.33GHz”, Quad-Core)
Source: Published 2S results on SPECint*_rate_base2006 benchmark at SPEC.org as of October 20,2010. Sandy Bridge results not yet tested or published.
Dual Core
65nm
Quad Core
65nm
Quad Core
45nm
Six Core
32nm
Single Core
90nm
17X Increase in Integer Throughput since 2005
Xeon 5100
Xeon 5500
Quad Core
45nm
Xeon 5400
Xeon 3.80
Xeon 5600
Xeon 5300
Future
Impact of Scale
7
Software Technologies & Management
Server, Storage, Switches
Data Center
Resource Cost in
Medium DC
Cost in
Very Large DC Ratio
Network $95 / Mbps / month $13 / Mbps / month 7.1x
Storage $2.20 / GB / month $0.40 / GB / month 5.7x
Administration ≈140 servers/admin >1000 servers/admin 7.1x
Source: Hamilton 2009.03.28: Cloud Computing Economies of Scale, Keynote, Self-Managing Database Systems, Shanghai.
* *
*
Tight coupling across software, hardware, data center
Shadowed Layout
AIR
FLO
W
Non-Shadowed Layout
Server Configurations
Feature Shadowed Un-Shadowed
Preheat High Low
Flow Impedance High Reduced
Fan Power Higher Reduced
TSA Support 35 >35
A little math
• Using the Facebook, Open Compute as a reference − 30 servers/rack (1), 24 racks/row (2) >> 720 servers/row
• With Xeon 5600 servers − 12 DIMM slots (2DPC), 4GB/DIMM >> 48GB/server
• Assuming 4GB/VM >> 8,640 VMs/row • Assuming 130W/server >> 93.6kw/row • For a moderate size enterprise:
− 4 rows >> 34,560 VMs and 374.4kw
− At $0.10/VM/hour >> ~$83k/day revenue
• Notes: − This is just the active VM’s; likely 1,000’s more offline
− # VM/s goes up with Moore’s Law and memory capacity
9
The implications for OpenStack
• VMs: ~30k now, maybe 60k (1) in 3 years in same space
• Power: ~370kw, roughly $1M/year (2) in utility spend
• 10% more efficient placement >> ~$8k/day more revenue
• 10% more efficient power >> saves ~$100k/year
• For OpenStack − Plan for large numbers of VMs (scale)
− Expect a focus on efficient use of the infrastructure (effective policy and constraint scheduling)
− Support for compliance and audit (trust)
10
Easing Cloud Deployments
via Proven, Interoperable Solutions for IT
Intel® Cloud Builders
www.intel.com/cloudbuilders
Usage Models and Reference Architectures
IaaS
Trusted Compute
Pools
Scale out Storage
Converged Networks
Policy based Power Mgmt
On-boarding
Secure Cloud Access
Secure Client Execution
Balanced Compute
Data center
Use a client device Use a cloud
Intel® Cloud Builders Program Reference Architectures
A Starting Point from Which to Build and Optimize Cloud Infrastructure
Software Reference
Architecture White Papers
Webinar/ Training
Intel and OEM HW Blueprints
ISV Cloud SW Stack
Integrated solution
Test Bed
http://www.intel.com/cloudbuilders
Intel® Cloud Builders: Proven Solutions
Build A Cloud:
Fujitsu Primergy with VMware vCloud
HP ProLiant SL* & Enomaly Elastic Computing Platform
Huawei SingleCLOUD*
IBM* CloudBurst
Joyent SmartDataCenter
Microsoft System Center VM Manager Self-Service Portal 2.0*
Nimbula* Cloud Operating System & Nimbula Director*
Novell* Cloud Manager
Parallels* Elastic IT Solution Developer Cloud
Powerleader Power Rack Server* with Microsoft*
Red Hat* Cloud Foundations
Ubuntu Enterprise Cloud
Univa UD*
VMware VCloud* Director
Proven, open, interoperable solutions optimized for IA capabilities
Solutions to make it easier to build & optimize cloud
infrastructure
Enhance A Cloud:
Balanced Compute Model with NetSuite & Gproxy
Design
Cisco* Virtualized Multi-Tenant Data Center
Cloud Gateway Security on Intel Platforms
Cloud On-Boarding with Citrix OpenCloud*
Dell & VMware* Policy Based Power Management
EMC* Atmos* Scale-out Storage Usage Models
Enhanced Cloud Security with HyTrust and
VMware
NetApp* Unified Storage and Networking
Parallels* Trusted Compute Pools for Cloud
Computing
VMware Enhanced Server Platform Security
OpenStack with Cloud Builders (Challenges with Bexar release)
• Need an external internet connection active to
download and install the OpenStack packages
• All steps not clearly documented, used multiple
blogs and sources to complete successful
installation
• Automated installation scripts fails to install all
the needed packages due to ports that were
not open on the switch
• Unable to SSH into the VM instance because
the configuration to IPtables that the install
scripts created are lost if the server is
rebooted
• VM Instances reported “Failed to spawn” when
starting, related to install scripts using
development packages instead of Stable
packages.
• Unable to get the nodes to add their presence
to the master database on the cloud controller.
• First Instance freezes at “scheduling” state,
services on the node did not start
automatically
Intel® Cloud Builders - Reference Architectures Usage Models
Partners
Maturity
HW
SW
Technology
Customer Test Bed
Production
Trusted Compute Pools • Challenge
− Little visibility or control of the level of security and trust provided by cloud infrastructure, so IT reluctant to use
• Solution
− Allow tenants of private and public clouds to place workloads into more secure and trusted resource pools by providing trusted/secure infrastructure and administrative tools that allow reporting and provisioning
• Usage Scenarios
− Launch of trusted VMM and VM
− Enforcement of trusted pool
− Provide tenant visibility into the infrastructure
Trusted Pool Untrusted
18
Enhance Security
Trusted Compute Pool Reference Architectures www.intel.com/cloudbuilders/library
Policy-Based Power Management • Challenge
− Datacenters require more efficient use of Node, Group and
Data Center server power consumption.
• Solution
− Active data center power management framework that
allows monitoring and control of power usage at the node,
group and data center level.
• Usage Scenarios
− Static Scenarios
− Real time server monitoring
− Static Power Guard Rail
− Static Power Capping
19
Policy
Improve Efficiency
Policy based Power Management Reference Architecture
www.intel.com/cloudbuilders/library
Unified Networking • Challenge
− Multiple data center networks for LAN, management, storage, virtualization, etc, add significant cost and complexity to data center environments
• Solution
− Deploy standard 10GBE data center network with IO Virtualization for performance and collapse data traffic of all types to that network.
• Usage Scenarios
− 10GBE and LAN Port Consolidation
− Storage (FCOE, iSCSI, NAS) and LAN Consolidation
20
Datacenter Simplification
Unified Networking Reference Architectures www.intel.com/cloudbuilders/library
Unified Fabric
Servers Storage Arrays
Management
Legal Disclaimer • Intel may make changes to specifications and product descriptions at any time, without notice.
• Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, visit Intel Performance Benchmark Limitations
• Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect performance of systems available for purchase.
• Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor family, not across different processor families. See www.intel.com/products/processor_number for details.
• Intel, processors, chipsets, and desktop boards may contain design defects or errors known as errata, which may cause the product to deviate from published specifications. Current characterized errata are available on request.
• Intel Virtualization Technology requires a computer system with a processor, chipset, BIOS, virtual machine monitor (VMM) and applications enabled for virtualization technology. Functionality, performance or other virtualization technology benefits will vary depending on hardware and software configurations. Virtualization technology-enabled BIOS and VMM applications are currently in development.
• Intel® Turbo Boost Technology requires a Platform with a processor with Intel Turbo Boost Technology capability. Intel Turbo Boost Technology performance varies depending on hardware, software and overall system configuration. Check with your platform manufacturer on whether your system delivers Intel Turbo Boost Technology. For more information, see http://www.intel.com/technology/turboboost
• No computer system can provide absolute security under all conditions. Intel® Trusted Execution Technology (Intel® TXT) is a security technology under development by Intel and requires for operation a computer system with Intel® Virtualization Technology, a Intel® Trusted Execution Technology-enabled Intel processor, chipset, BIOS, Authenticated Code Modules, and an Intel or other Intel® Trusted Execution Technology compatible measured virtual machine monitor. In addition, Intel® Trusted Execution Technology requires the system to contain a TPMv1.2 as defined by the Trusted Computing Group and specific software for some uses.
• 64-bit computing on Intel architecture requires a computer system with a processor, chipset, BIOS, operating system, device drivers and applications enabled for Intel® 64 architecture. Performance will vary depending on your hardware and software configurations. Consult with your system vendor for more information.
• Intel, Intel Xeon, Intel Core microarchitecture, and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
• * Other names and brands may be claimed as the property of others.
• © 2008 Standard Performance Evaluation Corporation (SPEC) logo is reprinted with permission
Legal Disclaimers: Performance
• Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, Go to: http://www.intel.com/performance/resources/benchmark_limitations.htm.
• Intel does not control or audit the design or implementation of third party benchmarks or Web sites referenced in this document. Intel encourages all of its customers to visit the referenced Web sites or others where similar performance benchmarks are reported and confirm whether the referenced benchmarks are accurate and reflect performance of systems available for purchase.
• Relative performance is calculated by assigning a baseline value of 1.0 to one benchmark result, and then dividing the actual benchmark result for the baseline platform into each of the specific benchmark results of each of the other platforms, and assigning them a relative performance number that correlates with the performance improvements reported.
• SPEC, SPECint, SPECfp, SPECrate. SPECpower, SPECjAppServer, SPECjEnterprise, SPECjbb, SPECompM, SPECompL, and SPEC MPI are trademarks of the Standard Performance Evaluation Corporation. See http://www.spec.org for more information.
• TPC Benchmark is a trademark of the Transaction Processing Council. See http://www.tpc.org for more information.
• SAP and SAP NetWeaver are the registered trademarks of SAP AG in Germany and in several other countries. See http://www.sap.com/benchmark for more information.
• INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
• Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance. Buyers should consult other sources of information to evaluate the performance of systems or components they are considering purchasing. For more information on performance tests and on the performance of Intel products, reference www.intel.com/software/products.
Optimization Notice
Intel® compilers, associated libraries and associated development tools may include or utilize options that optimize for instruction sets that are available in both Intel® and non-Intel microprocessors (for example SIMD instruction sets), but do not optimize equally for non-Intel microprocessors. In addition, certain compiler options for Intel compilers, including some that are not specific to Intel micro-architecture, are reserved for Intel microprocessors. For a detailed description of Intel compiler options, including the instruction sets and specific microprocessors they implicate, please refer to the “Intel® Compiler User and Reference Guides” under “Compiler Options." Many library routines that are part of Intel® compiler products are more highly optimized for Intel microprocessors than for other microprocessors. While the compilers and libraries in Intel® compiler products offer optimizations for both Intel and Intel-compatible microprocessors, depending on the options you select, your code and other factors, you likely will get extra performance on Intel microprocessors.
Intel® compilers, associated libraries and associated development tools may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include Intel® Streaming SIMD Extensions 2 (Intel® SSE2), Intel® Streaming SIMD Extensions 3 (Intel® SSE3), and Supplemental Streaming SIMD Extensions 3 (Intel® SSSE3) instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors.
While Intel believes our compilers and libraries are excellent choices to assist in obtaining the best performance on Intel® and non-Intel microprocessors, Intel recommends that you evaluate other compilers and libraries to determine which best meet your requirements. We hope to win your business by striving to offer the best performance of any compiler or library; please let us know if you find we do not.
Notice revision #20101101
23