considerations for managing resourcepools-ibm...

© 2008 IBM Corporation

Considerations for Managing Resource Pools

Michael HooIBM BladeCenter Technology EvangelistFeb 2009


HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

Capacity Management Transformed

VIRTUALIZEDPHYSICAL POOLED

Logical Resource Pools (RP)

Distributed Resource Scheduler (DRS)


HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW


POOLED




HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW

POOLED


RP1

RP2




HW HW HW HW HW

HW HW HW HW HW

HW HW

HW HW

HW

HW

HWHW


POOLED

RP1

RP2




Defining a Compute Resource

Compute Resource is the aggregation of computing powers from a set of hosts.

– Special case: a Compute Resource with only one host is a standalone compute resource.

– Compute Resource with multiple hosts is a cluster.

– Currently, only cpu + memory are available as aggregations.

ClusterStand-alone host

orComputeResource:


ClustersThe Power of Many Hosts, the Simplicity of One

� Reduce management complexity by combining stand-alone hosts into clusters for higher availability and more flexible resource controls

Stand-alone hosts

CPU = aMem = x

CPU = bMem = y

CPU = cMem = z

Cluster

Pooled ResourcesCPU = a+b+cMem = x+y+z

AvailabilityTransparent failover


Clusters are..Collection of ESX Hosts and VMs

� Hosts resources become part of cluster resource

� Shared resources with a shared managed interface

� Enabled for DRS, HA or both

Cluster

Pooled ResourcesCPU = a+b+cMem = x+y+z

AvailabilityTransparent failover


Copyright

©

2006

VMware,

Inc.

All

rights

res

Distributed Resource Scheduling

�Global scheduler– Automates initial virtual machine placement

– Uses VMotion to continuously optimize based on current workload

– Reacts to adding or removing hosts from the cluster

�Achieve >80% utilization

VM VM VM

ESX Server

VM VM

ESX Server

VM VM VM

ESX Server

VirtualCenter

Cluster

Global Scheduler

Local Scheduler Local Scheduler Local Scheduler

VMVM VMVM


What does DRS do? 1

� Initial placement – When you first power on a virtual machine in the cluster

• Output is recommended host list (prioritized list)

• Manual Mode

> Recommends placement. Admin chooses.

• Partially Automated Mode and Fully Automated:

> Places VM on host. No recommendations.

�Runtime operations– Load Balancing

• Manual Mode and Partially Automated Mode

> Recommends placement. Admin chooses.

• Fully Automated:

> Migrates VMs as required. No recommendations.

Distributed Resource Scheduling


Resource Pools

Resource Pools subdivide computing resources in a cluster

� Virtual machines draw resources from their resource pools

� Resource allocations can be changed dynamically

� Resource pools can be nested

Cluster capacity:5 x (4.8 GHz, 4 GB)= (24 GHz, 20 GB)

Floating capacity:5 GHz, 5 GB

Resource Pool 1(CPU = 16 GHz, Mem = 12 GB)

VM VM VM VM

Resource Pool 2(3 GHz, 3 GB)

VM VM VM


Resource Pools

Virtual Machine Containers with Assigned Resources

� With resource pools you can…

– Let a user create and run as many virtual machines as desired while limiting the total resources used

– Instantly add extra resources to an enterprise application

– Delegate control over assigning resources to virtual machines while maintaining complete control over hardware

Resource Pool(CPU= 8 GHz, Mem = 6 GB)

VM VM VM VM


� Note: Virtual Machines resources cannot be run across two or more physical hosts

Virtual Machine Constraints

*http://www.vmware.com/pdf/vi3_35/esx_3/r35u2/vi3_35_25_u2_config_max.pdf

VM


� Virtual Machines can only run on ONE host at any given time

� Virtual Machines cannot aggregate resources across standalone hosts or hosts in a cluster

Virtual Machine Constraints

VM VM VMVM VM VMVM

X


ESX Host Constraints

*http://www.vmware.com/pdf/vi3_35/esx_3/r35u2/vi3_35_25_u2_config_max.pdf


2009

Storage

Networking

Virtual Machines

CPU

Memory

Highest Single ServerResource Efficiency

128 cores and 512 GB of physical RAM�Hardware Scale Out

Lowest CPU overhead � HW Assist� Purpose Built Scheduler

Maximum memory efficiency

� HW Assist� Page Sharing� Ballooning

Wirespeed (9Gb today) network access

�VMDirectPath�Offload

Greater than 200k iopsper second

Lower than 2ms latency

�VMDirectPath�Para-virtualized SCSI

ESX Server

App

OS

App

OS

App

OS

App

OS

App

OS

8-way vSMP and 256 GB of RAM per VM

�Virtual hardware scale out

vCompute


Perfect for:

XpandOnDemandXpandOnDemand™™ ScalabilityScalability

Modular Building-block Scalability eliminates the need for fork-life upgrades and provides an easier growth path to

larger, scale-up high-performance SMP configurations

Leadership Scaling Solution…

x3850M2, 2w-4w •Single Chassis•Up to 24 cpu cores •Up to 256GB Memory

x3850M2 + ScaleXpander+ x3950M2•Two Chassis 8-way•Up to 48 cpu cores•Up to 512GB Memory

x3850M2 + ScaleXpander+ 3*x3950M2•Four Chassis 16-way•Up to 96 cpu cores•Up to 1TB Memory

ScaleXpander

x3850M2 + ScaleXpander+ 2* x3950M2•Three Chassis 12-way•Up to 72 cpu cores•Up to 768GB Memory


18

IBM X-Architecture Building proven IBM enterprise capability into the industry standard space

A design blueprint for building proven IBM enterprise capability into the industry-standard product line

IBM System zIBM System pIBM System i

IBM System x

IBM BladeCenter

Ease of use Industry standard

technologies

Availability

Manageability

Clustering

Scalability

Solutions

Performance


Enhanced VMotion Compatibility (EVC)VM running on server esx01 to be moved to esx02

Provision VM on esx02, pre-copy memory & CPU state from esx01 to esx02, log changes to a bitmap

Delete virtual machine from esx01VMotion Successfully Completed…

1

2 5

Suspend the VM on esx01 and copy changed memory to esx023

Resume VM on esx024

Memory and CPU State copied to the target host!

Requirement: Source and destination hosts must have compatible CPU models


EVC Requirements - Summary

�All hosts in the cluster should have ESX3.5 U2

�Intel VT and Execute Disable (XD) flag needs to be enabled in BIOS for systems in EVC enabled clusters

�Hosts should have Intel® Xeon® 3200, Intel® Xeon®

5300, Intel® Xeon® 7300 or later processors

�No VMs should be active on a host when being added to the EVC cluster

�EVC can be enabled/disabled from Virtual Center.

�Need the latest version of Virtual Center (VC2.5 U2) to enable EVC


Planning Tips - Cluster


�Hosts must have sufficient resources:

– Aggregate unreserved capacity

– Per-core capacity

�Enable DRS Cluster Automation

– Let DRS autonomously manage most VMs:

• Use manual mode for critical VMs if conservative

• Use automated for non-critical VMs

• But base it on your comfort level –environment, experience etc.

� Larger servers will be able to provide CPU cycles and cater to spikes more effectively

Planning Tips - Cluster


� Tedious to manage resources on VM level.

� Leverage on resource pools to manage groups of VMs instead of individual VMs.

�Use Fixed Reservation for parent resource pool.

�Plan for Nested Resource Pools effectively.

�Set appropriate shares for Prod vs Dev RPs.

Planning Tips – Resource Pools


Dynamically Manage Resources- Not a Server, It’s a Pool of Resources

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

OS

App

Virtualized SAN and Network InfrastructureVirtualized SAN and Network Infrastructure

OS

App

X

OS

App

OS

App

OS

App

OS

App

© 2008 IBM Corporation25

IBM provides an integrated solution to help simplify IT Operations – IBM® Systems Director 6.1

Reducing complexity with integrated platform and enterprise service management

Deploying and managing virtual servers to control data center space

Managing energy usage helps meet “green”initiatives and cost objectives

IBM Systems Director – at the core of an

IT management strategy – can reduce

the costs of IT service delivery, improve

business resiliency and security, and

help meet energy usage requirements

IBM System x and BladeCenter

© 2008 IBM CorporationIBM Systems Director 6.126

IBM Offers End-to-

End Management

Hardware

Other Systems Management Software

Ac

tiv

e E

nerg

y M

an

ag

er

$$

Imag

e M

an

ag

em

en

t

$$

TP

MfO

SD

$$

Automation

Status

Configuration

Discovery

Update

Remote Access

Virtualization Core Director Services

Configuration

System x & Blade Center

System z

Power Systems

Storage Configuration

$$

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

Ad

dit

ion

al P

lug

-In

s

BO

FM

$$

Serv

ice a

nd

Su

pp

ort

M

an

ag

er

Ad

dit

ion

al P

lug

-In

s

$$

Managed virtual and physical environments

Resource Management

Base Systems Director Managers & HardwarePlatform Managers

Enterprise ServiceManagement

Advanced Managers&Priced Plug-Ins

IBM and non-IBM hardware


New in IBM® Systems Director 6.1� Simplified Getting Started

– Start, Manage, Learn

� Focus on Health, Automation

– Health Summary

– Monitors, Thresholds, Updates

– Automation Plans

� Easy to Navigate Web-based UI

– Intuitive drilldown and Views

– Topology map

� Integrated Management of Virtual Resources

– Create virtual server

– Edit virtual resources

– Relocate

– Deploy Images*

� Plug-Ins for advanced platform management*

27

* Staged Features


Virtualization Manager Portal

• View problems with virtual servers

• Install virtualization sub-agents for use with Director

• Create virtual servers

• Create virtual Farms

• Relocate virtual servers

• Quick navigation to virtual servers and hosts


Virtualization Resources – Resource View

VM Host

Guest VM’s

Power State Resource Utilization

Resource Allocation


Virtualization Interface Launch in Context – VI3 & MSVS


IBM and VMware enables the

“Virtual SMB DataCenter in a Box”


� Manually balance

compute workloads

� Zero Downtime

maintenance

The power of BladeCenter S with VMware VMotion technology

� Storage migration

and flexibility with

storage VMotion

No downtime for your OS and Applications

33


With an all-in-one approach, an entire VMware stack (servers, networking, storage), can all be

installed in one BladeCenter S chassis, all without having to cable up anything but the power!

The BladeCenter S full-featured SAN

Fully enables VMware and VMotion

Full report on RSSM on the VMware Hardware Compatibility List: click on VMware HCL*

*http://www.vmware.com/resources/compatibility/search.php?action=search&deviceCategory=san&

productId=1&keyBasic=RAID&maxDisplayRows=50&key=&release%5b%5d=-1&datePosted=-134


– Simplifies and automates disaster recovery workflows:

• Setup, testing, failover

– Turns manual recovery runbooks into automated recovery plans

– Provides central management of recovery plans from VirtualCenter

Introducing VMware Site Recovery Manager

Works with VMware Infrastructure to make disaster recovery rapid, reliable, manageable, affordable

Site Recovery Manager leverages VMware Infrastructure to deliver

advanced disaster recovery management and automation


Protected

Site

Recovery

Site

VirtualCenter Site Recovery Manager


Datastore Groups

Array Replication

Datastore Groups

Site Recovery Manager At A GlanceSite A Site B


Protected

Site

Recovery

Site



Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs

online in Protected Site

offline

Site A Site BSite Recovery Manager At A Glance


Protected

Site

Recovery

Site



Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs

become unavailable

Site A Site BSite Recovery Manager At A Glance


Protected

Site

Recovery

Site



Datastore Groups

Array Replication

Datastore Groups

Protected VMs

Protected VMs powered on

become unavailable

Site A Site B

Recovery

Site

Protected

Site

SRM Supports

bi-directional

Site protection

Site Recovery Manager At A Glance


IBM Certified Storage Replication Adapters: SVC, DS4000, DS5000, DS8000, N-Series

Servers

Storage Certification Update for SRM

VMware Infrastructure

Virtual Machines

VirtualCenterSite

Recovery Manager

Servers

VMware Infrastructure

VirtualCenterSite

Recovery Manager

Partner Replication

Site Recovery Manager

Protected virtual machines

Virtual Machines

Production Disaster Recovery

Servers

Storage

SVC

.

DS4000

DS8000DS5000

Storage

.

DS4000SVC

DS8000

DS5000

Partner Replication

New!


IBM Virtualized Systems Infrastructure

IBM Systems Director

IBM TotalStorageProductivity Center

IBM Tivoli Service Management Family

Applications

Service Management

Platform management tools

ServerVirtualization

StorageVirtualization

Disk, File & Tape

Hardware

Virtualization Software

Operating Systems

IBM Systems

Director Family

IBM

TotalStorage

Productivity

Center


Thank You

considerations for managing resourcepools-ibm...

Documents