introduce: ibm power linux with powerkvm
TRANSCRIPT
1 October 2015
IBM Power LinuxIntroduce PowerKVM an Open Virtualization choice for Linux Systems
Zainal Abidin <[email protected]>Pacet - October 22, 2015
2 October 2015
Today Agenda
• Intro
• Why Linux?
• Power System Technology
• Virtualizations on Power System
• PowerKVM Architecture & Strategy
• Live Demo
• Q & A
4 October 2015
2.880 Core Power 7 15 TB RAM
80 teraflops200 million pages
of content
Waitless Computing for Digital Era
Hardware of IBM Watson
6 October 2015
Key Facts About Linux
Linux is the world’s fastest growing OS (33.8% revenue share in 2009)
Over 90% of world’s fastest supercomputers, including top 10 in TOP500 list, run on Linux
8 of the world’s top 10 websites including Google, YouTube, Yahoo, Facebook, and Twitter run on Linux
80% of all Stock Exchanges in the world rely on Linux
95% of the servers used by Hollywood studios for animation films run on Linux
US Department of Defense is the "single biggest install base for Red Hat Linux" in the world
Linux has strong following in smartphones & other electronic devices.
Worldwide Linux and Open Source Software Ecosystem Revenue, 2007–2014
Source: http://www.redhat.com/f/pdf/IDC_Linux_Mainstream.pdf
7 October 2015
IBM’s commitment to Linux ecosystem growth
Learn about Power Systems Linux centers Beijing, ChinaAustin, TXNew York, NYMontpellier, France
Who Has Contributed to Linux?
8 October 2015
IBM continues its commitment to Linux growth
Power Systems intends to invest a billion dollars in solutions for Linux and open source workloads, adding to prior investments by IBM during the last decade on a wide range of open initiatives.
$1 Billion….again
IBM Press Release
Wall Street Journal Coverage
And, we recently opened a Power Systems Linux Center in Montpellier, France, joining our centers around the world dedicated to Linux developers.
Learn about Power Systems Linux centers Beijing, ChinaAustin, TXNew York, NYMontpellier, France
Request briefing or training sessionRequest porting assistance
OpenPOWER Consortium
10 October 2015
New IBM Power based on Power 8
Power S822L
1 or 2 sockets 10 or 12 cores/socket Up to 1 TB of Memory
Power S824 or Power S814
1 or 2 sockets 6, 8,10 or 12 cores/socket Up to 1 TB of Memory
Power S822Power S812L
Designed for Big Data
Superior Cloud Economics
Open Innovation Platform
11 October 2015
POWER8: The 1st Processor Designed for BigData
IBM 22nm Technology• Silicon-on-Insulator
• 15 metal layers
• Deep trench eDRAM
POWER8 ProcessorCompute
• 12 cores (thread strength optimized)
• SMT8, 16-wide execution
• 2X internal data flows
• Transactional Memory
Cache
• 64KB L1 + 512KB L2 / core
• 96MB L3 + up to 128MB L4 / socket
• 2X bandwidths
System Interfaces
• 230 GB/s memory bandwidth / socket
• Up to 48x Integrated PCI gen 3 / socket
• CAPI (over PCI gen 3)
• Robust, Large SMP Interconnect
• On chip Energy Mgmt, VRM / core
12 October 2015
POWER8: New Features and Benefits
Feature Benefits
Simultaneous Multi-Threading 8 Improve system performance by increasing the throughput of
workloads with large or frequently changing working sets, such as
database servers and Web servers by
Ability to invoke up to 8 concurrent threads per core
Ability to schedule threads across core
Ability to designate/change primary thread
Java Code Optimization w/HW
Assist
Taking already strong Java performance to the next level, included
as part of Java Runtime, hardware helpers for Java IT code
optimization
Transactional memory Reducing customer cost by Improving performance of legacy
software with large sequential components
Efficient power management Lower power usage at idle
Optimized workload power management
Improved performance per watt at moderate utilizations
PCI Gen3 Significant increase in bandwidth and reduction in latency
Required for Analytics, Big Data.
Coupled with memory bandwidth drives higher compute than x86
Coherent accelerator processor
interface*
Virtual Addressing & Data Caching
Easier, more natural programming model
Enables applications not possible on I/O
13 October 2015
Chip Family
Core
Frequency
(GHz)
L1 and L2
Cache per
Core
Approximate
Cache per
Core (MB)
Intel EN E5-v2 (8+ core) 1.7 – 2.464 KB
256 KB2.81
Intel EP E5-v3 (8+ core) 1.8 – 3.264 KB
256 KB2.81
Intel E7-v2 (8+ core) 2.0 – 3.264 KB
256 KB2.81
POWER8 (8+ core) 3.4 – 4.3596 KB
512 KB19.27
System z EC12 5.50160 KB
2 MB20.82
Cache and Core Speed
14 October 2015
Core
Cache
Memory
Memory is slow
relative to
cache1-100
clock cycles
400-800
clock cycles
1
clock cycle
Cache is Critical to Good Performance
15 October 2015
POWER8 Cache Design
L2 L2 L2 L2 L2 L2
L1 L1 L1 L1 L1 L1
C C C C C C
L2
L1
L2
L1
L2
L1
L2
L1
L2
L1
L2
L1
C C C C C C
Shared L3 Cache
Mem L4
Mem L4
Mem L4
Mem L4
MemL4
MemL4
MemL4
MemL4
16 October 2015
Core
Cache
Memory
What Benefits from Cache – Everything!
• Large working sets
• Multi-threaded or mixed workloads
• Transactions that lock data
• Batch
• Virtualized environments
• Shared data
• Write burst traffic
• Mixed reads and writes
17 October 2015
0
0.5
1
1.5
2
2.5
3
3.5
4
P7
SMT1
P8
SMT1
P8
SMT2
P8
SMT4
P8
SMT8
•SMT1: Largest unit of execution work
•SMT2: Smaller unit of work, but provides greater amount of execution work per cycle
•SMT4: Smaller unit of work, but provides greater amount of execution work per cycle
•SMT8: Smallest unit of work, but provides the maximum amount of execution work per cycle
•Can dynamical shift between modes as required: SMT1 / SMT2 / SMT4 / SMT8
•Mixed SMT modes supported within same LPAR
• Requires use of “Resource Groups”
POWER8 Multi-threading Options
18 October 2015
Superior Performance: POWER8 (.vs. Intel X86)
Sandy Bridge
EP E5-26xx
Ivy Bridge EX
E7-88xx v2
Haswell EX
E7-88xx v3POWER7+ POWER8
Clock rates 1.8–3.6GHz 1.9-3.4 GHz 2.0-3.0 GHz 3.1-4.4 GHz 3.0-4.15 GHz
SMT options 1,2 * 1, 2 * 1, 2 * 1, 2, 4 1, 2, 4, 8
Cores per socket 8 15 18 8 12
Max Threads /
socket16 30 36 32 96
Max L1 Cache 32KB 32KB * 32KB * 32KB 64KB
Max L2 Cache 256 KB 256 KB 256 KB 256 KB 512 KB
Max L3 Cache 20 MB 37.5 MB 45 MB 80 MB 96 MB
Max L4 Cache 0 0 0 0 128 MB
Memory
Bandwidth
31.4-51.2
GB/s68-85 GB/s ** 68-93 GB/s
100 – 180
GB/sec
190-230
GB/sec
* Intel calls this Hyper-Threading Technology (No HT and with HT)
* 32KB running in “Non-RAS mode” Only 16KB in RAS mode
** 85GB running in “Non-RAS mode” = dual-device error NOT supported
Intel need scarify RAS
for more Performance
19 October 2015
** Published Benchmarks – ALL data is PUBLISHED
Performance comparison – x86 .vs. POWER8-SIBM POWER8 core and system performance is leadership versus the x86 Xeon
x86
“Haswell”
IBM
POWER S824POWER8 vs. x86
Core Performance
RatioIntel Xeon E5-2699 v3
(except where noted)
POWER8
@ 3.5 GHz
# Cores 36 24
SAP 2-Tier 16,500 21,212 1.9
SPECint_rate2006 1,400 1,750 1.8
SPECfp_rate2006 942 1,370 2.1
SPECjbb2013 (max-jOPS) 195,119 361,293 2.7
SPECjEnterprise2010 19,282 22,543 1.7
Oracle eBS 12.1.3 Payroll1,017,639
(24-core E5-2697 v2)
1,090,909
(12-core)
2.1
Siebel CRM Release 8.1.1.4 10,000
(16-core E5-2690)
50,000
(6-core)
13.3
1) IBM Power System S824 on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 4 processors / 24 cores / 96 threads, POWER8; 3.52GHz, 512 GB memory, 21,212 SD benchmark users,
running AIX® 7.1 and DB2® 10.5, Certification # 2014016. Source: http://www.sap.com/benchmark All results valid as of October 3, 2014
2) Dell PowerEdge R730, on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application; 2 processors/36 cores/72 threads, Intel Xeon Processor 2699v3; 2.30 GHz, 256 GB memory; 16,500 SD
benchmark users, running RHEL 7 and SAP ASE 16; Certification # 2014033. Source: http://www.sap.com/benchmark.
3) SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/
4) SPECjbb2013 results are submitted as of 10/15//2014. For more information go to http://www.specbench.org/jbb2013/results
5) SPECjEnterprise2010 results are valid as of 3/2/2015. For more information go to http://www.specbench.org/jEnterprise2010/results/
6) Oracle eBS 12.1.3 Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.html
7) Siebel 8.1.1.4 PSPP Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/white-papers/siebel-167484.html
22 October 2015
Power Virtualiazation Options
PowerKVM
PowerVM
PowerVM is Power Virtualization that will continue to be enhanced to support AIX, IBM i Workloads as well as Linux Workloads
2004Initial Offering
Q2 2014Initial Offering
PowerKVM provides an open source choice for Power Virtualization for Linux workloads. Best for clients that aren’t familiar with Power and Linux centric admins.
23 October 2015
PowerKVM & PowerVM Comparison
Power 8 Linux only Hardware
Firmware
Host Software
Hardware
OPAL FirmwareHardware AbstractionBoot services
Standalone Diagnostics
P6, P7, P8 Hardware
Phyp Firmware - Hypervisor
Linux MCP/KVM Hypervisor
Guest VM Types
Managers
VIO ServerIO Virtualization
HMC, IVM, FSM, PowerVC, ISD VMControl
PowerVC, OpenStack, libvirt, Open Source Tools
24 October 2015
PowerVM PowerKVM
GA Availability Now since 2004 Q2 2014
Supported Hardware All P6, P7, P7+, P8 Systems S812L, S822L
Supported Guest OS AIX, IBM i & Redhat, SUSE Linux Redhat, SUSE & Ubuntu Linux
Workload Mobility Supports AIX, IBM i & Linux Linux
Basic Virtualization
ManagementIVM/HMC/FSM Virtman/libvirt/Kimchi
Advanced Virtualization
ManagementPowerVC/VMControl PowerVC, Vanilla OpenStack
Admin Type Power Centric Linux/x86 Centric
Established Security Track
Record on PowerYes No
Open Source Hypervisor No Yes
Complete Hardware
Awareness & Exploitation Yes Partial
26 October 2015
PowerKVM - Open Virtualization for Power Linux Servers
PowerKVM provides simple, robust, cost effective server virtualization built on open source for Linux workloads running on Power Systems
PowerKVM Solution
Simplifies configuration and operation of server virtualization
Provides an Open Source Virtualization Choice
Lower cost virtualization alternative for Linux Workloads
Flexibility and agility leveraging the Open Source Community
KVM is the original hypervisor focus for OpenStack
Client Pain Points
Complexity and time required implement server virtualization
Virtualization vendor lock-in
Total cost of ownership for server virtualization solutions
Closed inflexible solutions
Lack of seamless integration with new cloud technologies like OpenStack
PowerKVM
27 October 2015
KVM Architecture Overview
Power8 Platform
OPAL FW
Qemu
VM1RHEL
VM2SLES
LibvirtAPI & virsh CLI
Linux Kernel
Pow
erK
VM
Host
ConsoleShell CLI
Linux UserspaceOpenstackEnd-node
componentsKimchi
Openstackcontroller
XcatChef
PuppetCustom scripts
IBM CloudManager
Kimchi BrowserOr
Client
CLI / IPMIFSP
SUSE Manager
KVM
VM3Fedora
28 October 2015
Dashboard for Local Administration
Provides simple graphical
web interface to initially
configure the PowerKVM
Host and to manage basic
virtualization for a small
configuration.
Included in PowerKVM
distribution.
Function includes
Initial host setup
Firmware update
Backup of configuration
Simple VM setup
Start and stop of VMs
Host monitoring
Use of Templates
View VM guest console
29 October 2015
PowerKVM vs PowerVM
Planning and Sizing Infrastructure
Initial Server Configuration
Virtualization Setup Initial VM Creation Advanced Virtualization Management
Serviceability
Workload Estimator(WLE)
Score request for certified storage
ASM/HMC
Power Control Network Config
Connection to management consoles
HMC / IVM
Install VIOS & Configure
FC Storage, Internal Disk
Network definition
HMC / IVM
Firmware maintenance HMC
Phone Home
PowerVM
HMC / IVM
PowerVC
Planning and Sizing Infrastructure
Initial Server Configuration
Virtualization Setup Initial VM Creation Advanced Virtualization Management
Serviceability
Workload Estimator(WLE)
ASM: Setup FSP IP address, if no DHCP available
IPMI: Remote Power Control and remote console
Host OS: IP, timezone and root password (if defaults do not apply)
KVM pre-loaded with reasonable defaults for storage, network and logging
Point browser to Kimchi-ginger for further Host OS configuration
Linux cmd line available
Error logs exposed through KVM/Linux
Firmware Maintenance through Linux
ESA Agent
PowerKVM
Virshcommand line
Kimchi (Web)
PowerVC
Or IBM Cloud Manager
30 October 2015
•Provides Open Source Server Virtualization Offering for Power Targeted to Linux Workloads
• Provides simplicity and familiarity for VMware and KVM Intel Linux Admins
• Allows cloud providers to easily integrate Power Linux servers into their OpenStack environments
• Available on new POWER8 Scale out Linux only servers
• PowerKVM will not support IBM i or AIX workloads
30
PowerKVM Summary
31 October 2015
Platform
Management
Virtualization
Management
Cloud
Management
PowerVC
ICM
Infrastructure as a service with IBM Cloud Manager With
OpenStack(formerly Smart Cloud Entry)
Virtualization Management with PowerVC
Linux / x86 Style of Platform Management
• IPMI for Power Cycling and control
• Hardware logs in PowerKVM host
• Firmware updates through Linux host
• Simple Management solution for PowerKVM
• Virtual Image Management and Deployment
• Resource Pooling and Dynamic VM Placement
• On-going optimization and VM resilience
• End-user self-service provisioning and automation
• Service catalog with virtual systems and applications
• Subscriber and account management (multi-tenancy)
• Delivered as Entry, Provisioning and Orchestration
Just another KVM / Linux host. Normal open
source tools & OpenStack can be used for
management.
31
Host
Either ICM or PowerVC can
manage a single PowerKVM
host but not both.
PowerKVM Management Strategy
35 October 201535 © Copyright IBM Corporation 2014
Linux Myth
myth buster
Power provides platforms with comparable TCA to x86
Power is too expensive for running Linux
36 October 2015
IBM Power 822L pricing comparison ($US) – Scale-Out Cloud with KVM
Comparable TCA
Linux on Intel
Ivy Bridge + KVM
Vs.
Linux on
POWER8 + KVM
Dell PowerEdgeR720
HP ProLiant DL380 G8
IBM Power 822L
$21,300 $22,763 $22,382
Server list price*-3-year warranty, on-site
$12,605 $14,068 $14,895
Virtualization- OTC + 3yr. 9x5 SWMA
$2,998
KVM for Red Hat on x86 (RHEV)
$2,998
KVM for Red Hat on x86 (RHEV)
$2,998
KVM for Linux on Power (PowerKVM)
Linux OS list price
- RHEL, 2 sockets, unlimited guests, 9x5, 3 yr. sub./ supp.
$5,697Red Hat subscription and Red
Hat support
$5,697Red Hat subscription and Red
Hat support
$4,489Red Hat subscription and IBM
support
Total list price: (Total cost of acquisition) $21,300 $22,763 $22,382
Server model Dell R720 HP Proliant DL380p G8 IBM Power 822L
Processor / cores Two 2.7 GHz , E5-2697, Ivy Bridge, 12-core processors Two 3.4 GHz POWER8, 10-core
Configuration 64 GB memory, 2 x 300GB 15k HDD, 10 Gb two port Same memory, HDD, NIC
* Based on US pricing for Power S822L announcing on April 28, 2014 matching configuration table above. Source: hp.com, dell.com, vmware.com
36