experiences with vios ibm ios v6€¦ · experiences with vios support for ibm i pete stephen,...

Experiences with VIOS support for IBM i

Pete Stephen,

Power Systems / AIX Architect

Sirius Computer Solutions

[email protected]

© 2015 Sirius Computer Solutions© 2015 Sirius Computer Solutions

Agenda� VIO overview – Virtualization Trends.

� PowerVM and how do I use it with IBM i. Supported functions and IBM i versions

� VIOS Changes with 2.2.3.51

� HMC V8.R8.2 Changes

� Virtualized Network overview (SEA)

� Virtualized Storage and Fiber overview

– NPIV

� Considerations for Configuring VIO for IBM i

© 2015 Sirius Computer Solutions2

– Dynamic LPAR and RMC connections

– Setting up the Storage – vSCSI or/and NPIV

– LUNs vs. Disk Arms in the IBM i world

– 60 LUN per adapter limit. New PMR, but we still cover how to work around this.

– Identifying the Load Source Disk

– Storage Pools for Disk and DVD

– Tape Library Attachment Options

� Monitoring the VIO and the SEA and the storage

– Using VIO Adviosr to size the VIO (the part command)

– NMON to monitor and NMON Analyzer to view

– Using the HMCScanner to document the configuration

VIO Overview – Virtualization Trends

� CPU / Memory Technology support and accelerate virtualization

trends

� The problem is to minimizing complexity while maximizing

utilization through virtualization

� IBM has been and continues to be a virtualization technology


� IBM has been and continues to be a virtualization technology

leader

� IBM i has used virtualization. But now it is taking advantage of

Virtual I/O

� PowerVM is evolving to support these trends on multiple OS

platforms.

� As an AIX and VIO guy, I need to support PowerVM as it evolves

IBM i and PowerVM

� IBM i – The i stands for Integrated (not virtualized)

� IBM i has always treated its disk in a unique way.

� IBM i does benefit from virtualization – DPARs – LPM.


� So how does VIO best support IBM i ???

IBM i and PowerVM

Supported Versions

Feature Version/Release

Support for 8GB FC

adapter and NPIVIBM i level 6.1 with 6.1.1 machine code

Live Partition Mobility IBM i level 7.1 TR4 PTF group – SF99707 level 4

PowerVM Enterprise with VIOS 2.2.1.4

Various SAN Storage Check the IBM i Storage Support Matrix


Various SAN Storage

Systems supportCheck the IBM i Storage Support Matrix

IBM i POWER External Storage Support Matrix Summary


Definition of IBM i attach methodsDirect attach – switch or fabric device is not required between the adapter and the storage device

Fabric attach – switch or fabric device is required between the adapter and the storage device

VIOS VSCSI – A virtual I/O server (VIOS or IBM i) provides a virtual SCSI adapter and virtual SCSI storage devices to a client operating system (IBM i, AIX, or Linux for VIOS; IBM i, AIX, Linux, or Windows for IBM i)

VIOS NPIV – N_Port ID Virtualization (NPIV) – aka virtual fibre channel – A virtual I/O server (VIOS) provides a virtual fibre channel

adapter to the client operating system (IBM i, AIX, or Linux)

http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4563

VIOS Release Strategy

� VIOS Release Strategy Changes with 2.2.3.50In June 2015, VIOS introduces the minipack as a new service stream delivery vehicle as well as a

change to the VIOS fix level numbering scheme. The VIOS "fix level" (the 4th number) has changed

to a double digit. VIOS 2.2.3.5 is changed to VIOS 2.2.3.50. Please refer to the VIOS Maintenance

Strategy here for more details regarding the change to the VIOS release numbering scheme..

http://www-01.ibm.com/support/docview.wss?uid=hpc1vios_home


http://www-01.ibm.com/support/docview.wss?uid=hpc1vios_home

VIOS level is NIM Master level must be equal to or higher than

Update Release 2.2.3.50 AIX 6100-09-05 or AIX 7100-03-05

• To take full advantage of all the function available in the VIOS, it may be necessary to be atthe latest system firmware level. Upgrade the Firmware before you update the VIOS

• The latest level of HMC V8R8.2 SP1 (MH01521) will support VIO functionality

Considerations for Configuring VIO for IBM i

� Dynamic LPAR operations and RMC connections

� Shared Ethernet Adapter Configuration

� Setting up the Storage – vSCSI or/and NPIV - IASP or not

� LUNs vs. Disk Arms in the IBM i world

� The 60 LUN per adapter limit. New PMR, but we still cover how to work

around this.


around this.

� Identifying the Load Source Disk

� Storage Pools for Disk and DVD

� Tape Library Attachment Options

IBM i and Dynamic LPAR operations and RMC connections

� IBM i does not use the rsct demons to enable DLPAR operations.

� IBM i uses the HMC Service Processor connection to enablre DLPAR.

# lssrc -a | grep rsct


# lssrc -a | grep rsctctrmc rsct 5374166 activeIBM.HostRM rsct_rm 14156014 activeIBM.ServiceRM rsct_rm 5439716 activeIBM.MgmtDomainRM rsct_rm 9240692 activeIBM.DRM rsct_rm 17301604 active

VIO Implementation with SEA

SEA Configurationhttp://www-01.ibm.com/support/docview.wss?uid=isg3T7000527

• Common to AIX LPARs. Unusual and complex for IBM i LPARs• Do we need to support multiple VLANs or just one?• 10GB adapters or 1 GB?• EtherChannel the ports?

S824 Server

© 2015 Sirius Computer Solutions

S824 Server

Jumbo Frames has a large impact on network performance

I Recommend building out the SEA (physical and logical devices) with Jumbo Frames.Then use mtu_bypass=yes or mtu_bypass=no to enable on a per LPAR basis


VIO Implementation with SR-IOV

•Expected to be popular with IBM I LPARs


VIO Virtualized Storage vSCSI or NPIV for IBM i


VIO NPIV Implementation for IBM i

Each IBM i LPAR has 4 vFC adapters supporting up to 64 LUNs. (IBM i OS limit per FC)( Best to stay below 64 )

Each VIO Server is connected to both Fabrics

alp206

Can support up to 128 LUNs

Virtual

Adapters

virtual adapter device

Controller Slot number

Last 4 digits of WWPN

VIO

fsc0

C43

0030

fsc2

C45

0034

fsc1

C44

0032

fsc3

C46

0036

vfchost0

C43

vfchost1

C45

vfchost2

C47

vfchost3

C49

vfchost4

C51

vfchost5

C53

vfchost0

C44

vfchost1

C46

vfchost2

C48

vfchost3

C50

vfchost4

C52

vfchost5

C54

fsc4

C47

0038

fsc6

C49

0042

fsc5

C48

0040

fsc7

C50

0044

alp210

Can Support up to 64 LUNs

fsc0

C51

0A60

fsc2

C53

0A64

fsc1

C52

0A62

fsc3

C54

0A68

SAN Disk

80GBSAN Disk

80GB

SAN Disk

100GB

SAN Disks

100GBSAN Disk

100GB

SAN Disks

100GBSAN Disk

100GB

SAN Disks

100GB


connected to both FabricsFabric A -> T1 portsFabric B -> T2 ports

vfcmap –vadapter vfchostX –fcp fcsX

Command to map Virtual to Physical Fiber Channel

14

VIOS01

U2C4E.001.DBJF263-P2-C2

SWITCH 9506-00

Fabric A

Physical Dual Port

FC Adapters

09 11 1615

Physical adapter device

Last 4 digits of WWPN

T1

fcs0

99D4

T2

fcs1

99D5

U2C4E.001.DBJF263-P2-C5

T1

fcs2

A1FC

T2

fcs3

A1FD

10 141312

SWITCH 9506-00

Fabric B

09 11 161510 141312

VIOS02

U2C4E.001.DBJF262-P2-C2

T1

fcs0

A260

T2

fcs1

A261

U2C4E.001.DBJF262-P2-C5

T1

fcs2

A160

T2

fcs3

A161

Physical port number

Serversvfcmaps

SAN Disk

Load Source Disks Data Disks (size as needed)

SAN Disk

100GB

SAN Disk

100GB

SAN Disk

100GBSAN Disk

80GB

SAN Disk

80GB

SAN Disk

100GB

SAN Disk

100GB

V7000 LUNs and Disk Arms for iOS

LUN compared to Disk arm

� The V7000 LUN connected to IBM i reports in IBM i as a disk unit.

IBM i storage management employs the management and

performance functions as if the LUN was a disk arm.

� The number of LUNs drives the requirement for more FC

adapters on the IBM i due to the addressing restrictions of IBM i

if you are using native attachment. Remember that each path to


if you are using native attachment. Remember that each path to

a LUN will count towards the maximum addressable LUNs on

each IBM i IOA.

�

IBM i OS limits the number of “Disks” per “Fiber HBA” to 60

� Note the Limit of Disks per Adapter on iOS!!!.

– http://www-01.ibm.com/support/docview.wss?uid=tss1td106091

� All the Data LUNs should be

the same size.

� If the total storage / size of

alp206

Can support up to 128 LUNs

fsc0

C43

0030

fsc2

C45

0034

fsc1

C44

0032

fsc3

C46

0036

fsc4

C47

0038

fsc6

C49

0042

fsc5

C48

0040

fsc7

C50

0044

alp210

Can Support up to 64 LUNs

fsc0

C51

0A60

fsc2

C53

0A64

fsc1

C52

0A62

fsc3

C54

0A68

SAN Disk

80GBSAN Disk

80GB

SAN Disk

100GB

SAN Disks

100GBSAN Disk

100GB

SAN Disks

100GBSAN Disk

100GB

SAN Disks

100GB

Match the

Client and

Server Slot


� If the total storage / size of

the LUNs exceeds 60 you

MUST map to multiple

“virtual hosts”.

VIOS01

U2C4E.001.DBJF263-P2-C2

SWITCH 9506-00

Fabric A

Physical Dual Port

FC Adapters

09 11 1615

“Virtual Host

Mapping #1

T1

fcs0

99D4

T2

fcs1

99D5

U2C4E.001.DBJF263-P2-C5

T1

fcs2

A1FC

T2

fcs3

A1FD

10 141312

SWITCH 9506-00

Fabric B

09 11 161510 141312

VIOS02

U2C4E.001.DBJF262-P2-C2

T1

fcs0

A260

T2

fcs1

A261

U2C4E.001.DBJF262-P2-C5

T1

fcs2

A160

T2

fcs3

A161

VIO

Servers

SAN Disk

Load Source Disks Data Disks (size as needed)

SAN Disk

100GB

SAN Disk

100GB

SAN Disk

100GBSAN Disk

80GB

SAN Disk

80GB

SAN Disk

100GB

SAN Disk

100GB

vfchost0

C43

vfchost1

C45

vfchost2

C47

vfchost3

C49

vfchost4

C51

vfchost5

C53

vfchost0

C44

vfchost1

C46

vfchost2

C48

vfchost3

C50

vfchost4

C52

vfchost5

C54

“Virtual Host

Mapping #2

Server Slot

Numbers

Identify which LUN is which disk unit in IBM i to find the Load Source

� All connection options: Native, VIOS_NPIV, and VIOS Virtual SCSI support Boot from

SAN. LoadSource resides on a V7000 LUN which is connected the same way as the

other LUNs; there aren't any special requirements for LoadSource connection.

� In IBM i Dedicated Service Tools (DST) or System Service Tools (SST) look for the

Serial number of a disk unit. In the picture Disk units in native or NPIV connection we

see Serial numbers Y11C490001DC, Y11C490001DA, etc.

� The last 6 characters of the Serial number are the last 6 characters of the LUN IDs in

V7000. Example: Y11C490001DA.


Virtual Storage Management of the DVD Drive

� DVDs are important to IBM i

maintenance.

� If the DVD is not on its own

adapter (traditional IBM i

configuration) then create a

Virtual Storage Pool for the DVD

device.


device.

18

Virtual Storage Management of the Tape Library

� One Drive or a Library?

� BMRS or Native backup

� NPIV attached or dedicated adapter?


Cool Tools – VIOS Advisor and HMC Scanner� Analyze and document your IBM i virtualized environment

� HMC Scanner

https://www.ibm.com/developerworks/community/wikis/home/wiki/Power Systems/page/HMC Scanner

� VIOS Advisor (the part command)

http://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7hcg/part.htm?lang=en


References and Links

� The VIO cheat sheethttp://www.ibm.com/developerworks/aix/library/au-viocheatsheet/index.html

� IBM PowerVM Virtualization Introduction and Configurationhttp://www.redbooks.ibm.com/abstracts/sg247940.html

� IBM PowerVM Best Practiceshttp://www.redbooks.ibm.com/abstracts/sg248062.html?Open

� Virtual I/O Server and Integrated Virtualization Manager commandshttp://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7hcg/iphcgkickoff_alphabetical.htm?lang=en

� Get to know the VIOS CLIhttps://www.ibm.com/developerworks/aix/library/au-vioscli/


� Virtualization best practices - Wikihttps://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Power%20Systems/page/Virtualization%20best%20practices

� HMC Commands Syntaxhttp://www-01.ibm.com/support/knowledgecenter/8231-E1C/p7edm/p7edm_kickoff.htm?lang=en

� Hints and Tips for implementing Storwize V7000 in an IBM i environmenthttp://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP102305

� What are the maximum storage devices IBM i LPAR?http://www-01.ibm.com/support/docview.wss?uid=tss1td106091

� IBM i Virtualization and Open Storagehttp://www-03.ibm.com/systems/resources/systems_i_Virtualization_Open_Storage.pdf

Thank You

© 2015 Sirius Computer SolutionsThis document is for IBM and IBM Business Partner use only. It is not intended for client distribution or use with clients

22

experiences with vios ibm ios v6€¦ · experiences with vios support for ibm i pete stephen,...

Documents