virtual i/o server - gomitec.com presentations/james... · virtual i/o server topics ... vio server...

© 2011 IBM Corporation

James Nash

Advanced Technical Skills

[email protected]

MITEC 2011 W 210 C-4

Virtual I/O Server Beyond the Basics


MITEC 2011 W 210 C-4

Trademarks

22

The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.

The following are trademarks or registered trademarks of other companies.

* All other products may be trademarks or registered trademarks of their respective companies.

Notes:

Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.

IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.

All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.

This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area.

All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.

Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.

Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.

Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.

Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel

Corporation or its subsidiaries in the United States and other countries.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.

IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.

For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:

*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®

Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not

actively marketed or is not significant within its relevant market.

Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.


MITEC 2011 W 210 C-4

3


MITEC 2011 W 210 C-4

Agenda

4

Virtual I/O Server Topics

• Networking

─ Shared Ethernet Adapters

─ Integrated Virtual Ethernet

─ MAC Addresses

• Virtual Storage

─ N_Port Id Virtualization

• Live Partition Mobility

─ Boot from SAN?

• Infrequently used alternatives

─ Virtual Media Library

─ backupios vs viosbr

─ Dynamic VLAN

─ Quality of Service

─ WWN Management


MITEC 2011 W 210 C-4

5

Virtual Networking - Overview

─ Shared Ethernet Adapters Options

─ SEA Failover

─ Network Interface Backup

─ Link Aggregation

─ Integrated Virtual Ethernet Changes

─ Advanced Virtual Ethernet Adapters

─ Dynamic VLAN

─ User-defined MAC Address

─ Quality of Service


MITEC 2011 W 210 C-4

Virtual Networking – Shared Ethernet Adapters


MITEC 2011 W 210 C-4

Virtual Networking – Integrated Virtual Ethernet

7

FC 5636, 2 x 1Gb

FC 5637, 4 x 1Gb FC 5639, 2 x 10Gb

POWER6 Options

Up to 16 Logical Ports per

Port Group

Up to 2 Port Groups per HEA


MITEC 2011 W 210 C-4

IBM

Pow

IVE Options with POWER7

POWER7 770 (9117-MMB)– FC 1803 Integrated, 4-port- 1Gb Virtual Ethernet, I/O ports

– FC 1804 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Optical ports)

– FC 1813 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Copper twinax

ports)

• Each of these cards contains 4 port groups because it combines

two P5IOC2 chips

• 4 port groups allows for up to 64 logical ports per controller

(assuming the MCS value for each port group is set to 1)

POWER 750 (8233-E8B)– FC 5613 Integrated, Dual-port- 10Gb Virtual Ethernet Daughter Card

– FC 5624 4-port 1Gb Integrated Virtual Ethernet Daughter Card

• Same rules that apply to POWER6 systems

• 2 port groups with up to a total of 32 logical ports per controller

(also assuming the MCS value is set to 1)


MITEC 2011 W 210 C-4


9

– FC 1803 Integrated, 4-port – 1Gb Virtual Ethernet, I/O ports

– FC 1804 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Optical ports)

– FC 1813 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Copper ports)

– FC 1824 Integrated, 4-port – 1Gb Virtual Ethernet, I/O ports

– FC 1825 Integrated, 2-port – 2 x 10Gb (Fiber)

– FC 1826 Integrated, 4-port – 2 x 10Gb (Copper)

– FC 1832 Integrated, 4-port - 1Gb Virtual Ethernet, I/O ports

– FC 1833 Integrated, 2-port – 2 x 10Gb (Fiber)

– FC 1837 Integrated, 4-port – 2 x 10Gb (Copper)

– FC 5613 Integrated, 2-port – 10Gb (SR Fiber)

– FC 5623 Integrated, 2-port – 2 x 1Gb

– FC 1826 Integrated, 4-port – 2 x 1Gb


MITEC 2011 W 210 C-4


10

Machine FC FC FC Note

710 1832 1833 1837 2U

720 1824 1825 1826 4U

730 1832 1833 1837 2U

740 1824 1825 1826 4U

750 5613 5623 5624 2 Port Groups

755 5613 5624 2 Port Groups

770 1803 1804 1813 4 Port Groups

780 1803 1804 1813 4 Port Groups

795 N/A


MITEC 2011 W 210 C-4

Virtual Networking – Dynamic VLANs

11


MITEC 2011 W 210 C-4

Other Dynamic Options

12


MITEC 2011 W 210 C-4

Virtual Networking – Specify a MAC Address

13


MITEC 2011 W 210 C-4


14

1 2 3 4 5 6 7 8 9 0 A B

octet: 1st 2nd 3rd 4th 5th 6th

Most Least

Significant Significant

0 0 0 1 0 0 1 0bit 8 bit 7 bit 6 bit 5 bit 4 bit 3 bit 2 bit 1

0: globally unique (OUI enforced)

1: locally administered


MITEC 2011 W 210 C-4

15



MITEC 2011 W 210 C-4

Virtual Networking – Quality of Service

16


MITEC 2011 W 210 C-4

Double Check Yourself

You can select one of the following values

for the priority level:

0 - best effort; lowest priority

1 - background

2 - spare

3 - excellent effort

4 - controlled load

5 - video (less than 100 ms latency and jitter)

6 - voice (less than 10 ms latency and jitter)

7 - network control; highest priority

17


MITEC 2011 W 210 C-4

18

Virtual Storage - Overview

─ The vSCSI Conundrum

─ Virtual Storage with Live Partition Mobility

─ Hub-and-spoke

─ N_Port Id Virtualization

─ WWN Management


MITEC 2011 W 210 C-4

19

Client LPAR

vscsi0 vscsi1

VIO

Server 1

vhost0 vhost0 VIO

Server 2

fcs0 fcs1

SAN

Switch #1

SAN

Switch #2

SAN Storage

fcs0fcs1

VIO Server

POWER Hypervisor (PHYP)

Client

LPAR

Client

LPAR

Client

LPAR

Virtual Storage - vSCSI


MITEC 2011 W 210 C-4

20

Where did that disk go?

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

At one point the disks had to

be configured with a

reserve_policy = no_reserve

PR_shared supported at

VIO v2.1.2

Keep a spreadsheet

Check all the VIO servers

Consider NPIV


MITEC 2011 W 210 C-4

21

Consider a Hub and Spoke Design

VIO Server Client

LPARClient

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

VIO Server

VIO Server Client

LPAR

Client

LPAR

Client

LPAR


MITEC 2011 W 210 C-4

NPIV - Virtual FC Server/Client Overview

22

VIO Server


Client

LPAR

Client

LPAR

Client

LPAR

Physical 8Gb

NPIV Adapter

Virtual FC

Server Adapter

Virtual FC

Client Adapter


MITEC 2011 W 210 C-4

Virtual Storage – NPIV Configuration

23

hscroot@hmc:~> lssyscfg –r prof –m FieldSystem1 \

–F lpar_name,virtual_fc_adapters

fs5,"""20/client/1/fs6vio2/20/c050760061590000,c050760061590001/0"",

“"21/client/2/fs6vio3/21/c050760061590002,c050760061590003/0""“

fs6,"""22/client/1/fs6vio2/22/c050760061590004,c050760061590005/0"",

""23/client/2/fs6vio3/23/c050760061590006,c050760061590007/0""“

fsios71,none

fsios61,none

fs6vio3,"21/server/7/fs5/21//0,23/server/6/fs6/23//0“

fs6vio2,"20/server/7/fs5/20//0,22/server/6/fs6/22//0"


MITEC 2011 W 210 C-4

Virtual Storage – WWN Management

24

# lscfg -vpl fcs0

fcs0 U8203.E4A.06EB1C4-V8-C26-T1 Virtual Fibre Channel Client Adapter

Network Address.............C05076006159000CROS Level and ID............

Device Specific.(Z0)........








Device Specific.(Z8)........C05076006159000CDevice Specific.(Z9)........

Hardware Location Code......U8203.E4A.06EB1C4-V8-C26-T1

PLATFORM SPECIFIC

Name: vfc-client

Node: vfc-client@3000001a

Device Type: fcp

Physical Location: U8203.E4A.06EB1C4-V8-C26-T1

# fcstat fcs0FIBRE CHANNEL STATISTICS REPORT: fcs0

Device Type: FC Adapter (adapter/vdevice/IBM,vfc-client)

Serial Number: UNKNOWN

Option ROM Version: UNKNOWN

Firmware Version: UNKNOWN

World Wide Node Name: 0xC05076006159000D

World Wide Port Name: 0xC05076006159000D

FC-4 TYPES:

Supported: 0x0000010000000000000000000000000000000000000000000000000000000000

Active: 0x0000010000000000000000000000000000000000000000000000000000000000

Class of Service: 3

Port Speed (supported): UNKNOWN

Port Speed (running): 2 GBIT

Port FC ID: 0x6D071D

Port Type: Fabric


MITEC 2011 W 210 C-4

25

Virtual Storage – WWN Management


MITEC 2011 W 210 C-4

Activate the LPAR

Activate LPAR and select

Boot Mode to be Open

Firmware OK prompt


MITEC 2011 W 210 C-4

ioinfo Menus

Enter the

command

ioinfo at

the OK

prompt

Select

option 6

for

FCINFO


MITEC 2011 W 210 C-4

ioinfo Menus

Select your

vfcs adapter

This verifies

your WWPN

and logs the

adapter into

the switch


MITEC 2011 W 210 C-4

Manual Step?

29


MITEC 2011 W 210 C-4

30

Anywhere to Anywhere

VIO Server Client

LPARClient

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR

VIO Server Client

LPAR

Client

LPAR

Client

LPAR


MITEC 2011 W 210 C-4

Virtual Storage – NPIV simplify management?

31

VIO Admin

I. Fewer Devices on VIO Server

II. Minimize Risk for disk theft

III. Less setup needed for LPM

IV. Easier to replace failed FC

adapter

V. Could make DR easier

VI. Advanced Multi-Path

Options

SAN Admin

I. Many more WWNs to

manage

II. Creating Zoneset more

complicated

III. Once configured,

fewer changes needed

for LPM

IV. Nothing needed when

FC adapter is replaced

Single Admin?


MITEC 2011 W 210 C-4

Live Partition Mobility - Overview

32

─ Moving from POWER6 to POWER7

─ Requirements

─ In the Zone

─ Port ID Binding

─ Boot from SAN?

─ Port Security

─ Disaster Recovery


MITEC 2011 W 210 C-4

33


MITEC 2011 W 210 C-4

34

Moving to POWER7

Set processor

compatibility mode

P7 features are not

available while

running in P6 mode– Active Memory Expansion

– Virtual Ethernet QoS

“Default” sets the

current mode to the

most fully featured

mode supported by

the operating

environment.


MITEC 2011 W 210 C-4

Live Partition Mobility - Zoning

3535

VIO Server


Client

LPAR

Client

LPAR

Client

LPAR

Physical 8Gb

NPIV Adapter

Virtual FC

Server Adapter

Virtual FC

Client Adapter


MITEC 2011 W 210 C-4

Live Partition Mobility – Boot from SAN?

Do you want SDDPCM or PowerPath managing

rootvg?– What does your storage vendor recommend

– What are the requirements to update the MP software

– What are the required steps for partition recovery

Can you split MP software by drive?SDD # excludesddcfg –l hdisk0 (querysn older

versions)

HDLM # vi

/usr/DynamicLinkManager/drv/dlmfdrv.unconf

PowerPath # pprootdev on36


MITEC 2011 W 210 C-4

Live Partition Mobility – Security

37


MITEC 2011 W 210 C-4

Some advantages of Virtual Optical Media Library With read-only virtual media the same virtual optical device can be

presented to multiple client partitions simultaneously

You could easily boot from and install partitions remotely without having

the need to swap out physical CD/DVDs or setup Network Installation

Manager (NIM) server

Easier to boot a partition into maintenance mode to repair problems

Easier to maintain a complete library of all the software needed for the

managed system. Various software packages as well as all the

necessary software levels to support each partition

Client partitions could use blank file-backed virtual optical media for

backup purposes (read/write devices)

These file-backed optical devices could then be backed up from on the

VIO server to other types of media (tape, physical CD/DVD, TSM server,

etc.)


MITEC 2011 W 210 C-4

Add Media – within IVM


MITEC 2011 W 210 C-4

Virtual Optical Media on HMC Managed Systems

Managing the Virtual Media Repository

Managing Virtual Optical Media

VIO

Command

Description

$ mkrep Create a Virtual media repository

$ lsrep Display information on a Virtual Media Repository

$ chrep Change characteristics of a Virtual Media Repository

$ rmrep Remove a Virtual Media Repository

VIO

Command

Description

$ mkvopt Creates a new virtual optical disk in the Virtual Media

Repository

$ lsvopt Displays information about file backed virtual optical

devices

$ chvopt Change the characteristics of a virtual optical media disk

within the Virtual Media Repository

$ loadopt Load a virtual optical media disk from the Virtual Media

Repository into a virtual optical device


MITEC 2011 W 210 C-4

Virtual Optical Media

Create an ISO file from CDROM$ mkvopt -name dvd.AIX_6.1.iso -dev cd0

-ro

–You choose the name for this file, so make it meaningful

–Creates an ISO image from the media in /dev/cd0

After the .iso file is in your /var/vio/VMLibrary

directory, run: $ mkvdev -fbo -vadapter vhost4

vtopt0 Available

–Replace vhost4 with your Virtual SCSI server adapter

name.

–This mkvdev command creates your virtual optical target

device.

$ loadopt -vtd vtopt0 –disk

dvd.AIX_6.1.iso


MITEC 2011 W 210 C-4

New command – viosbr (with VIO 2.1.2)

42

$ viosbr

Too few parameters.

Usage: viosbr -backup -file FileName [-frequency

daily|weekly|monthly [-numfiles fileCount]]

viosbr -nobackup

viosbr -view -file FileName [-type devType] [-detail]

viosbr -view -file FileName -mapping

viosbr -view -list [UserDir]

viosbr -restore -file FileName [-validate] [-type devType]

[-inter]

viosbr -restore -file FileName [-type devType] [-force]

$ viosbr -backup -file nash-backup


MITEC 2011 W 210 C-4

New command - viosbr

43

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz

Controllers:

============

Name Phys Loc

---- --------

iscsi0

sissas0 U5802.001.00H1395-P1-C1-T1

sissas1 U5802.001.00H1395-P1-C2-T1

sissas2 U78C0.001.DBJ0426-P2-T3

sissas3 U78C0.001.DBJ0426-P2-C9-T1

pager0 U9117.MMB.100414P-V1-C32769-L0-L0

pager1 U9117.MMB.100414P-V1-C32773-L0-L0

vasi0 U9117.MMB.100414P-V1-C32769


MITEC 2011 W 210 C-4


44

Physical Volumes:

=================

Name Phys Loc

---- --------

hdisk20 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-

L12000000000000


L1B000000000000

hdisk22 U78C0.001.DBJ0426-P2-C9-D1

hdisk23 U78C0.001.DBJ0426-P2-C9-D4

hdisk0 U5802.001.00H1395-P3-D1

hdisk1 U5802.001.00H1395-P3-D2

hdisk2 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L0


L1000000000000


MITEC 2011 W 210 C-4


45

Ethernet Interfaces:

====================

en0

en1

en2

en3

en4

Shared Ethernet Adapters:

=========================

Name Physical Adapter Default Adapter Virtual Adapters

---- ---------------- --------------- ----------------

ent4 ent0 ent1 ent1


MITEC 2011 W 210 C-4


46

Virtual Server Adapters:

========================

SVSA Phys Loc VTD

---- -------- ---

vhost0 U9117.MMB.100414P-V1-C5 rg103_gambs




vhost4 U9117.MMB.100414P-V1-C2 mob29_target

vhost5 U9117.MMB.100414P-V1-C4 vtscsi1

vtscsi0


MITEC 2011 W 210 C-4


47

Virtual Server Adapters:

========================

SVSA Phys Loc VTD

---- -------- ---





vhost4 U9117.MMB.100414P-V1-C2 mob29_target

vhost5 U9117.MMB.100414P-V1-C4 vtscsi1

vtscsi0

This is NOT even the detailed view


MITEC 2011 W 210 C-4


48

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \

-detail

..............hdisk21 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L1B000000000000

Attribute Name Attribute Value

-------------- ---------------

device_mode 10

queue_depth 32

message_no 105

hcheck_interval 60

hcheck_cmd inquiry

unique_id 3E213600A0B80001132D00000F2F94B7E72800F1815 FAStT03IBMfcp

scsi_id 0x611400

lun_id 0x1b000000000000

ww_name 0x201800a0b81132d0

node_name 0x200800a0b81132d0

ses_attach yes

pvid 00c23c9f212cf8880000000000000000

reserve_policy no_reserve


MITEC 2011 W 210 C-4


49

$ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \

–mapping

..............

Name Physloc ClntID ClntName ClntOS

------------- -------------------------------- ------ ------------- -------

vfchost0 U9117.MMB.100414P-V1-C16 29 mob29_lpm AIX

ClntOS AIX

Status LOGGED_IN

FC name fcs0

Ports logged in 3

Flags a

VFC client name fcs0

FC loc code U78C0.001.DBJ0426-P2-C2-T1

VFC client DRC U9117.MMA.1023C9F-V29-C3-T1


MITEC 2011 W 210 C-4

viosbr or backupios


Questions?

James Nash

[email protected]

MITEC 2011 W 210 C-4

virtual i/o server - gomitec.com presentations/james... · virtual i/o server topics ... vio server...

Documents