Mainframes in the CloudBOV91780

Pete ChadwickDirector of Product ManagementSUSEpchadwick@suse.com

Kershaw MehtaSenior Technical Staff MemberIBMkershaw@us.ibm.com

Please Note:

• IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice and at IBM’s sole discretion.

• Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

• The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

• The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

• Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

2

3

Topics

• Learning about the Mainframe and LinuxONE

• What is OpenStack?

• What makes an OpenStack distribution?

• What is the z/VM Cloud Manager Appliance?

• z/VM CMA demo

• What is SUSE OpenStack Cloud?

• SUSE OpenStack Cloud 6 demo

• What's next?

3

Taking Linux to new heights

Linux

WITHOUTLIMITS

Linux

WITHOUTRISK

Linux

YOUR WAY

Unprecedented performanceUnmatched security and resiliencyNew solution offerings New open source technologiesExpanded ecosystem

Introducing IBM LinuxONE™

LinuxONE – Diagonal Scale

Extreme Virtualization and Scale Hypervisor partitioning built into firmware

Complete isolation – EAL5+

Supports as many as 85 hypervisor instances – z/VM or KVM1K Linux guests/hypervisor+1 million docker containers

Hypervisor communication is via fast, in-memory TCP/IP Hipersockets – 3x less latency than discrete servers

• Massive dedicated I/O – 640 power co-processors

• 960Meg L4 cache, 5Ghz core, dual-TLBs, crypto accelerators

Super Elastic System Combine horizontal and vertical scaling

Non-disruptively add/remove resources from Linux guests

Non-disruptively add/remove Linux guests

Compose high-performance scalable applications. Dynamically and seamlessly re-allocate resources between guests. Provide right-time analytics and powerful

engagement

HWHiperSocket LAN / Shared OSA

Linux guest

Docker Docker Docker Docker Docker Docker Docker Docker

…

LPAR1 LPAR2

LinuxONE is designed for high I/O bandwidth business workloads

Up to 141 cores for business logic

Up to 320 I/O channel processors – each with

2 POWER cores(160 PCIe slots)

Up to 24 cores dedicated to I/O processing

LinuxONE

HP BL460c Gen9

24 cores for both business and I/O

processing

ZERO I/O cores

4 I/O channel processors

(2 PCIe slots)

10-40% of typical business applications processing is estimated to be I/O processing*

Only LinuxONE has specialty cores dedicated to I/O processing

LinuxONE has about 80x more I/O channel processors than typical scale-out servers

Linux Your Way: Greater flexibility and choiceLinuxONE has enabled key technologies

Distributions Virtualization Languages Runtimes Management Database Analytics

LPAR

vRealize

Supported Versions

Community Versions

DB2

LLVM 

LXD (Ubuntu)

Docker)

Zend framework (PHP)

Apache Tomcat

2x Better Data-Serving with LinuxONE

MariaDB 10.1.5

1.8x to 2.1x throughput improvement on Sysbench Benchmark

PostgreSQL 9.4

1.6x to 2.2x throughput improvement on pgBench Benchmark

2.2x to 2.7x throughput improvement on YCSB Benchmark

Cloudant DBaaS

8

8

MongoDB 3.3 (WiredTiger, no sharding)

1.9x to 2.1x throughput improvement on YCSB Benchmark

LinuxONE is designed for minimal unplanned downtime

Source: ITIC 2015 - 2016 Global Server Hardware, Server OS Reliability Survey

Source: IDC 2015

Unplanned Downtime of >four (4) hours on each server hardware platform (2015)

ITIC s urve y s hows IBM LinuxONE ha d no – 0% – unpla nne d s ys te m downtim e due to inhe re nt fla ws in ha rdwa re

89%

Unplanned downtime instances per year

45% 94%

Time to resolve unplanned downtime

Productivity hours lost per year per

user

Recent IDC study concludes clients who leverage LinuxONE can virtually eliminate lost productivity caused by downtime

Run multiple copies of z/VM on a single server for enhanced scalability, failover, operations, and energy efficiency

Share CPUs and I/O adapters across all z/VM LPARs, and over-commit memory in each LPAR for added cost effectiveness

CPU CPU CPU Shared Physical CPUsCPU CPUCPU

z/VM Paging Subsystem

ExpandedStorage Paging Volumes

Virtual CPUs

z/VM Paging Subsystem

ExpandedStorage

Guest Memory

LPAR Running z/VM LPAR Running z/VM

Logical CPUs

z/VM-Managed Memory z/VM-Managed Memory

Paging Volumes

Single-System, Multi-LPAR, Linux-on-z/VM EnvironmentMaximizing Resource Utilization and System Availability

KVM for IBM z Systems A new hypervisor choice

The Kernel-based Virtual Machine (KVM) offering for IBM z Systems™ is software that can be installed on z Systems processors and can host Linux® on z Systems guest virtual machines.

The KVM offering can co-exist with z/VM virtualization environments, z/OS®, Linux on z Systems, z/VSE® and z/TPF.

Simplifies configuration and operation of server virtualization.

The KVM offering is optimized for z Systems architecture and provides standard Linux and KVM interfaces for operational control of the environment, as well as supporting OpenStack® interfaces for virtualization management.

Enterprises can easily integrate Linux servers into their existing infrastructure and cloud offerings.

Allows customers to leverage common Linux administration skills to administer virtualization.

Provides an Open Source virtualization choice.

KVM for IBM z Systems A new hypervisor choice

The Kernel-based Virtual Machine (KVM) offering for IBM z Systems™ is software that can be installed on z Systems processors and can host Linux® on z Systems guest virtual machines.

The KVM offering can co-exist with z/VM virtualization environments, z/OS®, Linux on z Systems, z/VSE® and z/TPF.

Simplifies configuration and operation of server virtualization.

The KVM offering is optimized for z Systems architecture and provides standard Linux and KVM interfaces for operational control of the environment, as well as supporting OpenStack® interfaces for virtualization management.

Enterprises can easily integrate Linux servers into their existing infrastructure and cloud offerings.

Allows customers to leverage common Linux administration skills to administer virtualization.

Provides an Open Source virtualization choice.

LPARs (PR/SM™)

KVM*z/VM

Memory

Processors

I / O

z/O

S

Linu

x o n

z

Lin

ux o

n z

Lin

ux o

n z

Linu

x o n

z

Linu

x o n

z

z/V

SE

S

z/T

PF

z/O

S

IBM z/VM and KVM for IBM z can co-exist on z Systems

KVM for IBM zStandardizes configuration and

operation of server virtualization

Leverage common Linux administration skills to administer virtualization

Flexibility and agility leveraging the Open Source community

Provides an Open Source virtualization choice

Integrates with OpenStack

Processors, Memory and IO

Support Element

z Systems Host

PR/SM™

Linu

x on

z

z/O

Sz/

OS

Linu

x on

z

Linu

x on

z

Linu

x o

n z

z/O

Sz/

OS

KVMz/VM

Linu

x on

z

Current State of OpenStack Drivers (cont.)

z/VMOpenStack drivers for z/VM are available out-of-tree in OpenStack github.

The z/VM OpenStack drivers can be found at:

• Nova (Compute): https://github.com/openstack/nova-zvm-virt-driver• Neutron (Network): https://github.com/openstack/networking-zvm

Working to get z/VM drivers accepted into OpenStack community (in-tree) in 2017.

Current State of OpenStack Drivers

KVM for IBM z Systems

OpenStack drivers for KVM for IBM z are available in-tree as of OpenStack Kilo release

KVM for IBM z is exposed through Libvirt API. As such, the OpenStack drivers for running KVM for IBM z can be found at:

• Nova (Compute) repository: https://github.com/openstack/nova- The KVM/libvirt driver is in ./virt/libvirt, it is used for x86, Power and z.

• Cinder (Storage) repository: https://github.com/openstack/cinder- We are supporting multiple Cinder volume drivers, they are all in ./volume/drivers, except

for the IBM XIV & DS8K drivers for which there are only a proxy to the real drivers (written in Java) which is not upstream

• Neutron (Network) repository: https://github.com/openstack/neutron- We are using OVS, it is in ./plugins/ml2/drivers/openvswitch

16

End UserSelf-service IT requests via mobile & Web clients

Cloud ManagerManage cloud workloadsManage Cloud UsersManage Cloud environment

Platform ManagerManage physical resources (servers, storage and networking)

Hypervisor AdminManage hypervisor resources (servers, storage and networking)

OpenStack targets these

Who is OpenStack for?

17

Open source software for creating private and public clouds.

OpenStack software controls large pools of compute, storage, and networking resources throughout a datacenter, managed through a dashboard or via the OpenStack API.

What is OpenStack?

18Source: https://www.openstack.org/software/

What is OpenStack?

19

What is OpenStack?

20

What is OpenStack?

21

Series Status GA Date

Newton Under development

Mitaka Current stable release Apr 7, 2016

Liberty Security supported Oct 15, 2015

Kilo Security supported Apr 30, 2015

Juno EOL Oct 16, 2014

Icehouse EOL Apr 17, 2014

Havana EOL Oct 17, 2013

Grizzly EOL Apr 4, 2013

Folsom EOL Sep 27, 2012

Essex EOL Apr 5, 2012

Diablo EOL Sep 22, 2011

Cactus Deprecated Apr 15, 2011

Source: http://releases.openstack.org/

What is OpenStack?

Check out the roadmap for future release content: https://www.openstack.org/software/roadmap/

22

Most community interaction takes place over IRC (internet relay chat).

Etherpads (a collaborative notepad) and wikis are used for short or long term documentation.

The twice-yearly summit includes sessions for sales/managers, operators and the design summit for technical direction. Summit sessions are decided upon via a combination of voting and core members.

Each OpenStack project has a Project Team Lead (elected position) and several core members. These are people who have done enough code reviews and contributions to be considered experts.

What is OpenStack?

What is an OpenStack Distribution?

• There are many ways to get OpenStack:• On-premises distribution: A customer downloads and installs an OpenStack

distribution within their internal network. You could create your own using our community plugins, or choose a distribution like SUSE OpenStack Cloud 6

• It uses open source OpenStack (community) Liberty drivers for z/VM and xCAT, which are available to anyone who wants to download them.

• Only the xCAT MN and zHCP need to run on z/VM with the rest of the code running in an x86 Linux guest. SUSE OpenStack Cloud 6 includes the z/VM installation and configuration, so there are no manual steps!

What is an OpenStack Distribution?

25

• There are many ways to get OpenStack:• On-premises distribution: A customer downloads and installs an OpenStack distribution

within their internal network. You could create your own using our community plugins, or choose a distribution like SUSE OpenStack Cloud 6

• Hosted OpenStack Private Cloud: A vendor hosts an OpenStack-based private cloud: including the underlying hardware and the OpenStack software.

• OpenStack-as-a-Service: A vendor hosts OpenStack management software (without any hardware) as a service. Customers sign up for the service and pair it with their internal servers, storage and networks to get a fully operational private cloud.

• Appliance based OpenStack: z/VM includes an OpenStack appliance

Sources: https://en.wikipedia.org/wiki/OpenStack

What is an OpenStack Distribution?

What is the z/VM Cloud Manager Appliance?

27

OpenStack Compute Node

LPAR

z/VM

Linux

Linux

SM

AP

I

LPAR

z/VM

Linux

SM

AP

I

xCA

T

SSH

OpenStack Compute Node

REST API

OpenStack Controller

Neutron

Glance Cinder

Scheduler

Horizon UI

If the controller is on z/VM, then this is manage-from z. If the controller is outside z/VM, then this is manage-to

z.

Horizon

Neutron

NeutronNova Nova

XCAT MN/zHCP XCAT zHCP

xCA

T

28

Different CMA modes• 5 Options

• Controller – OpenStack controller and compute node and xCAT MN and zHCP• Compute – OpenStack compute node and xCAT zHCP• Compute_mn – OpenStack compute node and xCAT MN and zHCP (if you have a

non-CMA controller)• MN – xCAT MN and zHCP • ZHCP – xCAT zHCP

• This means a single service stream for xCAT and OpenStack updates• The ZHCP userid is no longer needed, the whole appliance runs from XCAT

CMA Liberty - Modes

29

• Launch → Image_Definition_Create_DM• Reboot → Linux reboot, or re-IPL• Terminate• Resize → Complete rebuild of the guest• Pause →PA1• Un-pause• Live Migration

• Snapshot• Fibre Channel• Set Admin Pass• Get Guest Info• Get Host Info• Glance Integration• Config Drive• Discovery of existing guests (driven

via xCAT GUI)

Supported Features - Nova

30

• Right now the z/VM agent only supports Layer 2 • VLAN Networking• Flat Networking

• Attach Volume• Detach Volume• Right now support is only for storage in the IBM Storwize

family/SVC Fiber Channel Protocol

Supported Features – Neutron and Cinder

31

• OpenStack Liberty support, including • Ceilometer support • RHEL7 and SLES12 provisioning through OpenStack • Keystone v3

• Liberty is the first release of our Cloud Manager Appliance that is not part of the IBM Cloud Manager with OpenStack product.

• The ICM deployer is not included• Cannot manage from z to other platforms• Only the xCAT GUI and Horizon GUI are included, evaluate your self-service portal needs to

see if an additional OpenStack product is right for you• The Chef server is not included

• The Chef client is still included• Chef cookbooks are included

• For configuring the CMA to be managed by an external cross-platform OpenStack controller

• For configuring the CMA to use an external Keystone server

CMA Liberty – available as of March 2016

32

• Fix for Boot from Volume on SLES12• Enabling HTTPS support for the CMA

• Do not use with the Keystone cookbook for the case where the CMA is configured as a controller but the Keystone server is outside the CMA

Liberty CMA Fixpack – September 2016

What’s Next?

34

• When 6.4 comes out, it will have the CMA Liberty appliance with it• This will formalize the change to have the CMA all in one id

• Remove ZHCP userid• Change XCAT userid to OPNCLOUD

• We’ll also change the configuration files to a model using IMBED files instead of the LOCALMOD process (which can be painful in an SSI environment)

• We’ll officially release the documentation for Alternative Deploy Provisioning, a way to clone guests that looks like a regular OpenStack deploy

z/VM 6.4

35

• The next major release of our appliance will be OpenStack Newton, which will be after z/VM 6.4 (and only supported on z/VM 6.4).

• Items proposed• OpenStack Newton currency• CMA logging enhancements• Ubuntu Support – support deploying Ubuntu guests with the same functionality as

we offer for SLES/RHEL guests currently (this is dependent on working with Ubuntu)

• Community work for xCAT and OpenStack• Intend to keep our xCAT in step with the upstream xCAT and develop it more

openly (as we do our OpenStack drivers)• Continue to push our OpenStack drivers in the community, making them more

friendly to non-z reviewers, continue to develop our CI system

OpenStack Newton

z/VM in SUSE Openstack Cloud

37

SUSE and OpenStack Past to Present

• SUSE joins OpenStack community in 2011

• SUSE participates in creation of OpenStack Foundation • Joined as Platinum member in 2012• Alan Clark elected Board Chairman

• SUSE OpenStack Cloud releases• v1 (OpenStack Essex) in 2012• v2 (Grizzly) • v3 (Havana)• v4 (Icehouse)• v5 (Juno)• v6 (Liberty) in Spring 2016• v7 (Newton) to be released in late 2016

37

38

Mixed Hypervisor Support

38

39

OpenStack Then … 2012

Compute(Nova)

OpenStack components

Operating System

Physical Infrastructure: x86 Servers

Hypervisor(Xen, KVM)

Required Components

Required ServicesMessage Q / Database

Network

40

OpenStack Now

Compute(Nova)

OpenStack components

Operating System

Physical Infrastructure: x86 Servers, System z, Storage, Networking

Hypervisor(Xen, KVM, HyperV, VMware, z/VM, Docker)

Required Components

Backend AdaptersRequired ServicesMessage Q / Database

41

SUSE OpenStack Cloud 7 Highlights

41

New Feature Why It’s Important

Built on OpenStack Newton code release Enterprise-ready features from mature, production-ready OpenStack cloud software

Support for SLES 12 SP2 Built on latest enterprise grade Linux platform for business-critical workloads

Business oriented release cycle Fewer upgrades and longer support duration for less disruption to production environments

Non-disruptive upgrade capabilities Ease migration between OpenStack releases

Docker and Kubernetes support Allow customers to build and run new and innovative containerized apps

Enhanced high-availability for KVM and Xen compute nodes Easier to migrate more traditional or business-critical workloads into OpenStack cloud

IBM z Systems z/VM virtualization support Enables customers to incorporate mainframes into their OpenStack cloud. Investment protection

CephFS integration with shared file support Enable single storage for block, file, object and image

42

z/VM Integration Details with SUSE OpenStack Cloud 7

• z/VM Systems Programmer, Network Admin and OpenStack Admin a must!

• Run CMA in MN mode

• Supported network configurations as named in IBM documentation• Single VLAN Network• FLAT and VLAN Mixed Network

• OpenStack compute node with z/VM driver can be run on x86_64 or s390x

• OpenStack control node can be on either s390x or x86_64

• IBM documentation - http://www.vm.ibm.com/sysman/osmntlvl.html• Enabling z/VM for OpenStack (Support for OpenStack Liberty Release)

42

SUSE OpenStack Cloud 6 Demo

45

Summary

• The z/VM team supports OpenStack both via an integrated appliance and community drivers

• You can use the integrated z/VM CMA or purchase a distribution like SUSE OpenStack Cloud 7.

• Distributions are especially important for cross-platform solutions

• IBM and partners continue to work on improving OpenStack support• Currency• Stability• Serviceability• Enhancements

45