better application managment: run business applications in an iasp environment
TRANSCRIPT
Running Business Applications in an iASP Environment
Nick HarrisConsulting IT Specialist
IBM Competitive Project Office
Alistair ScottChief Technology Officer
S4i Systems, Inc.
Independent Auxiliary Storage Pool
An IASP is: A set of disk units which contain a collection of user objects and the necessary system data (e.g.
storage management directories, object ownership, and authorization information) Independent of ASP1 (SYSBASE) – This enables the IASP to be taken offline or brought online
independent of system activity or other ASPs Provides an independent ‘Name Space’ for job and DB isolation
Can reside on internal or external disk – or a combination of both
Also known as – Independent Disk Pool
Availability of the IASP is controlled through varying on / off the associated device description and “attaching” jobs / threads to the IASP
Included in the base operating system
IASPs can contain: User defined file systems User libraries – some object types not supported
IASPs: Foundation for Long Term, Scalable HA/DR
IASP1 – Application -1
IASP2 – Application -2
IASP2 - secondary JournalingIASP with reduced cost
archive storage
ASP1 (SYSBAS)
User ASP(SYSBAS)
Independent ASPs (IASPs) offer:– Uptime
• Shorter IPLs – leave non-critical IASPs on-line • Reclaim Storage (RCLSTG) by IASP
– Security• Data and path encryption by ASP
– Archive• Storage performance and cost by IASP
– Consolidation• Meet compliance needs for isolation• SaaS (Software as a Service)• Reduce software licensing fees (single OS)• Reduce number of OS upgrades
Foundational requirement for PowerHA • Switched IASPs• External Storage LUN Level Switching• IBM i Power HA Geographic Mirror• Power HA external storage copy services
LibA
LibA
LibB
LibB
LibX
LibX
LibA LibB
Same lib not allowed in both Sysbase and IASP
Same lib is allowed in different IASPs
Creating an IASP
IASP Enablement Considerations
Most changes to support IASPs are typically work-management oriented. IASP migration can generally be transparent to most end-users.
Location of application objects• data, journals, journal receivers
• programs and environment definition objects
• considerations for object types not supported in IASPs
Setup considerations• Loading of IASPs
Work management considerations• Name space, library list, job initiation, etc.
Application run time considerations• Database connectivity – DDM, JDBC, ODBC
• Commitment control scope, join logical files
IBM i Objects Are Supported In An IASP
The following objects are supported for use in independent disk pools:*ALRTBL *FILE *MODULE *SBSD*BLKSF *FNTRSC *MSGF *SCHIDX*BNDDIR *FNTTBL *MSGQ *SPADCT*CHRSF *FORMDF *NODGRP *SPLF*CHTFMT *FTR *NODL *SQLPKG*CLD *GSS *OUTQ *SQLUDT*CLS *IGCDCT *OVL *SRVPGM*CMD *JOBD *PAGDFN *STMF*CRQD *JOBQ *PAGSEG *SVRSTG*CSI *JRN *PDG *SYMLNK*DIR *JRNRCV *PGM *TBL*DTAARA *LIB *PNLGRP *USRIDX*DTADCT *LOCALE *PSFCFG *USRQ*DTAQ *MEDDFN *QMFORM *USRSPC*FCT *MENU *QMQRY *VLDL*FIFO *MGTCOL *QRYDFN *WSCST
IBM i Objects Not Supported In IASP
The following objects are not supported for use in independent disk pools:*AUTHLR *DEVD *JOBSCD *PRDLOD*AUTL *DOC *LIND *RCT*CFGL *DSTMF1 *MODD *SOCKET*CNNL *EDTD *M36 *SSND*COSD *EXITRG *M36CFG *S36*CRG *FLR *NTBD *USRPRF*CSPMAP *IGCSRT *NWID *CSPTBL *IGCTBL *NWSD *CTLD *IMGCLG *PRDAVL *DDIR *IPXD *PRDDFN
1 *DSTMF is the object type returned for stream files that are being accessed through the QNTC file system from a remote system. So you should not see *DSTMF ever when accessing the IASP directories from the local system.
IASP Work Management Considerations
Determine how application will access specific IASP (name space):
• Job descriptions INLASPGRP – mostly transparent to users• SETASPGRP• SQL Connect, etc.
Modify JOBDs for USRPRFs
• Set initial ASP Group for user profiles associated with the application
Library list processing
Evaluate SBSDs for changes or attachment to IASP
• AJEs, PJEs, JOBQs, Routing programs
IASP Database Considerations
Views, tables cannot span IASP boundary• No join logical files over physicals in different ASPs or ASP and SYSBAS
Commit block cannot span IASP boundary (pre-7.1)• If connected to IASP RDB, cannot commit changes against both IASP and *SYSBAS (except QTEMP)
Decide on RDB name for IASP• Single IASP on system, may want to give the old *LOCAL RDB name to the IASP instead.
DDM files• Configure to use *RDB for connectivity
New permanent libraries or collections for application:• CRTLIB LIB(library-name) ASP(*ASPDEV) ASPDEV(asp-device-name)
• Create collection – default for INASP is the current library name space
JDBC, ODBC, FTP connectivity• Use JOBD of USRPRF to set INLASPGRP where possible
IBM i Disk Attachment Methods
Storage presented through VIOS
Storage presented through a native disk adapter
SVC
Storwize Family
Raid Adapter
Fibre ChannelAdapter
DS8000
XIV
DS3000*
DS5000*
DS5000*DS8870
Expansion Drawers
* Not all models are supported
SVC
Storwize Family
Native attachVIOS attach
IBM i Data Resiliency Technologies
IBM iStorage
Mgt
IBM iStorage
MgtIBM i IASP and Geographical Mirroring
IBM iVendor
IBM iVendor
ISV Software and IBM i Remote Journaling and Save File APIs
Primary Backup
IBM iStorage
Mgt
IBM iStorage
MgtIBM i IASPs or Boot From
SAN
DS8000Copy
Services
DS8000Copy
Services
Operating system based– Cluster managed environment– IBM i Switched IASP – IBM i IASP Geographical Mirroring
Storage based– Cluster managed environment– IBM System Storage SAN-based disk
• FlashCopy snapshots• Metro Mirror Replication• Global Mirror Replication• Global Copy Replication• HyperSwap (DS8000)
For DS8000 choose between:• Basic (Full System copy)• Clusters (IASP copy)
HyperSwap
Object based– Logical replication vendors– Electronic vaulting vendors
Power Systems High Availability Solution For mission critical application availability through planned and unplanned outage events
Shared Storage Clustering Technology designed for automation and minimal IT operations.
Multi-Site Clustering for enterprise class availability
Embedded for integrated simplicity and reliability
PowerHA SystemMirror
In addition to single-system benefits….
Facilitates hardware or OS-based replication solutions for HA, DR and off-line backups.
The only level of granularity available for IBM i geographic mirroring or switched disk solutions
The only level of granularity available besides full-system replication on hardware-based external storage replication solutions for i Remove risk of damaged system objects
associated with replicating entire system Faster switchover/failover times Eliminate manual reconfiguration
necessary for switchover/failover
Replication
Or
Switched
Disk
IASPs in a High Availability Environment
Comparing Infrastructure of IBM i Full System Replication with IBM i Independent ASP Replication
All Data and all LUNs are replicated to backupBackup partition is not varied onReplicated LUNs are active but not accessiblePlanned switch requires primary partition power downFailover requires an abnormal IPL
Only the Data on independent ASP LUNs is replicatedBackup partition is activeReplicated Independent ASP are active but not accessiblePlanned/Unplanned switch is a simple cluster managed process to vary on IASP
Primary Partition Backup PartitionPowered Off
System ASP ReplicatedSystem ASP
Primary Partition Backup PartitionPowered On
Independent ASP ReplicatedIndependent ASP
System ASP System ASP
IBM i 7.2 PowerHA SystemMirror for i
Geographic Mirroring
• Synch• Any storage• Direct, VIOS,
IBM i Hosted storage
MetroMirror
• Sync • DS8000
Storwize Family• NPIV• HyperSwap
FlashCopy
• Snapshot• DS8000
Storwize Family
• Space Efficient
• NPIV
SwitchedIASPs
• Internal or external storage
• IOA or Tower **
End
-to-E
nd
Solu
tion
GlobalMirror
• Async
DS8000
Storwize Family
• NPIV
Geographic Mirroring
• Async.• Any storage• Direct, VIOS, IBM
i Hosted storage
LUN Level Switching
• IASP is located inside DS
• DS8000• Storwize
Family
An end-to-end solution for management of IBM i 6.1, 7.1, 7.2 and DS8000® resiliency and replication technologies for HA, DR and backups
IBM i Cluster Resource Services
DSCLI DS Command Line Interface
HA Switchable Resources - IBM i option 41
PowerHA SystemMirror for i(5770-HAS) – 7.2
Note: Storwize Family does not include DSCLI Support
Client Need: Data Center
Requirements• Near continuous application service • Recovery Time Objective (RTO) measured in minutes• Recovery Point Objective (RPO) is Zero (no data loss)• Eliminate affects of planned outages• Eliminate tape back-up window
Solution Strategy: • PowerHA SystemMirror Standard Edition
Client Need Today: Multi-Site
Requirements• HA/DR clustering for data center & multi-site operations• Automated role-swap operations • Readily demonstrate remote recoverability compliance
Solution Strategy: • Unified clustering solution for data center & multi-site
resiliency• PowerHA SystemMirror Enterprise Edition
Data Center
Remote Site
IBM PowerHA SystemMirror for i – Product Stack
Cluster ManagementUser Interfaces
DS8K SAN SolutionsHA Switchable Resources
Clustering Technology
DSCLI
LP 5770-SS1 Opt 41
LP 5770-HAS
IBM i
1 per system
1 per processor core
Standard / Enterprise
PowerHA Basic Concepts
PowerHA SystemMirror creates and manages a shared storage cluster topology
• IASP volume group hosts the DB, IFS data
• Admin Domain manages the sysbas data
• Note that the foundational topology does not involve replication
Admin domain
Application data
(IASP)aka (volume group)
Admin domain
PowerHA Basic Concepts – Geographic Mirroring
Internal disk is not switchable (LUNs required), you use geomirror with internal disk configurations (or for that matter any disk configurations)
Use Geomirror for configs with IASPs under 5 Tbytes (a suggested guideline … key point is proper sizing for bandwidth when considering a complete re-sync after an outage)
• Sync mode included with Standard Edition (~ 40 KM or less)
• Async mode requires Enterprise Edition• Storage agnostic (typically internal disk)
Geomirror
IBM i GUI for PowerHA Simplifies Cluster Management
PowerHA GUI provides automatically refreshed health state overview for diverse cluster entities
Use PowerHA SystemMirror GUI with IBM i to Manage Cluster Elements and Switchover
IBM PowerHA SystemMirror for i – Product Stack
STG Lab Services Offering
Cluster ManagementUser Interfaces
DS8K SAN SolutionsHA Switchable Resources
Clustering Technology
PowerHA Tools for IBM i
DSCLI
LP 5770-SS1 Opt 41
LP 5770-HAS
IBM i
1 per system
1 per processor core
Standard / Enterprise
SmartAssist for PowerHA on IBM i
Highlights
Complements and extends PowerHA on i Provides CL commands for PowerHA functions where only API’s are available Provides automation around repetitive tasks
Adding entries in Admin domain Starting all cluster nodes Etc.
Helps automate the installation and operation of a PowerHA environment
Provides commands, utilities, and program examples Many clustering functions contain lists of items. Examples are provided for CL
programmers not used to dealing with lists
Useful toolset for geographic mirroring and storage-based solutions
SmartAssist for PowerHA on IBM i
Sample PowerHA Assist Commands
• ADDCADUSR - adds all user profiles in the Admin Domain• Create user profile exit point to auto add user profiles on creation• DLTPRFCLU - delete profiles around a cluster• CHKDUPLIBS - check for duplicate libraries in SYSBAS and IASP across the cluster• CHKENVRCY – Analysis tool for files, journals etc. to ensure an unscheduled switch
can come online as fast a possible• Global Mirror statistics programs to monitor performance and recovery points• SET/RTVFACT – control the PowerHA failover actions to be able to turn on/off
automatic failover for specific cluster events• STRALLNOD - start all cluster nodes• Sample programs for automatically starting PowerHA and Geographic mirroring on
IPL• RTVCPYSSN - used multiple API’s to retrieve PowerHA session status and primary
node information into a CL program
PowerHA Supported Technology
6.1 • Switched Disk• Synchronous Geographic Mirroring• DS8000 Metro Mirror, Global Mirror, FlashCopy
7.1• Asynchronous Geographic Mirroring• DS8000 LUN-level Switching• Space-Efficient FlashCopy• SVC / Storwize Metro Mirror, Global Mirror, LUN-level switching,
FlashCopy
7.2• DS8000 full system HyperSwap
PowerHA SystemMirror And IBM System Storage – DS8000, Storwize Family
Out of Region
Site C
Metro / Global MirrorThree site synchronous and
asynchronous mirroring
FlashCopy
Point in time copy
Within the same Storage System
Out of Region
Site B
Global Mirror
Asynchronous mirroring
Primary
Site A
Primary
Site A
Metro distance
Site B
Metro Mirror
Synchronous mirroring
Primary
Site A
Metro
Site B
DS8000 Copy Services fully integrated with TPC-R to provide simplified CA and DR operations
IBM i PowerHA MetroMirror Two-Node Cluster
Metro Mirror does all the storage replicationDistance limited to around 50km
IASP IASP
Local site
MetroMirror
PowerHA Metro Mirror Cluster
Remote site
SYSBAS SYSBAS
IBM i PowerHA Global Mirror Two-Node Cluster with DS8870
Global Mirror does all the storage replication Distance is not limited
IASPFlash-Copyin GM
IASP
IASP
Local site Remote site
GlobalMirror
PowerHA Global Mirror Cluster
SYSBAS SYSBAS
ConsistencyGroup
Metro Mirror Global Mirror (MGM) Three Site Cluster
30
IASP
Site A
Flash-Copyin GM
IASP
IASP
Remote site
PowerHA Metro-Global Mirror Cluster
IASP
Site B
MetroMirror
GlobalMirror
PowerHA Technology for Every Storage TypeInternal
SAS/SSDDS6000DS8000
SVCV7000 V3700 XIV DS5000
Other Storage
Geographic Mirroring
Metro Mirror
Global Mirror
Metro Global Mirror
LUN switching
Switched Disk (1) (1) (1) (1)
FlashCopy
Note 1: Native attach only
A PowerHA Technology for Every Outage Type
Planned /Unplanned
Partition Outages
Planned /Unplanned
Server Outages
Planned /Unplanned
Storage Outages
Site Outage
Offline Backups
>2 copies of real-time
data
Synch Geo Mirroring
Asynch Geo Mirroring
Metro Mirror
Global Mirror
Metro Global Mirror
LUN switching
Switched Disk
FlashCopy
PowerHA SystemMirror for IBM i 7.2
PowerHA SystemMirror V7Express Edition
Standard Edition
Enterprise Edition
IBM Director Navigator graphical interface
IBM i cluster enabled storage management
SLIC level event management
IASP encryption
Integrated copy services management *
Host based replication (geo-mirroring)
IBM storage based replication *
Cluster wide Sysbas synchronization
Automated failover/failback
Three site MGM (Metro Global Mirror)
Config wizards
Advanced Copy Services (Lab Services)
Cluster Enabled Admin Domain
Cluster Enabled FlashCopy & Copy Services
Storwize Family LUN Level Switching
Single command D side FlashCopy
New PowerHA GUI (replaces previous GUIs)
PowerHA is embedded OS technology and provides a unified solution for High Availability and Disaster recovery
PowerHA Express Edition for Full Site replication with HyperSwap
PowerHA Standard Edition provides HA solutions for the data center
PowerHA Enterprise Edition provides multi-site solutions based on storage replication services
* Via Lab Services tools33
USE CASEECM Application living in IASP
Business Application
S4i Express – Enterprise Content Management• Built on the IBM i• Document Repository &
Web Portal◦ Centralized storage,
Distribution, & Retrieval◦ Now IASP compatible
Business Problem
CustomerService provider offering S4i Express application hosting with infrastructure as a service.
StruggleBack Up & Disaster Recovery• Finding time window to back up client
instances• Complications with replication
Existing Method
Application back up & disaster recoveryManaged with Software Replication• Complexity of data caused problems with HA solution
Customer Goals
Better serve subscribers with:Quicker Disaster RecoveryHigh Application AvailabilityFaster Application Performance
Resources
TechnologyTwo IBM i Server LocationsPower HA platformS4i Express, 150+ instances of Enterprise Content Management ApplicationDS 8870 external storage
Solution
Pair PowerHA with DS 8870 IASPHardware ReplicationEnable S4i Express ECM software to live in IASP• Install & update software in IASP• Run autonomously in IASP
This solved 3 major concerns…
Driving Customer Satisfaction
Reduced cutover time◦ They could easily vary the System on = High availability
Fast Disaster Recovery◦ From hours to minutes
More reliable access for end users◦ S4i Application service restored in 30 minutes
@S4iSystems949-366-5234
Learn MoreVisit the “Ask the Expert” blog post
Read the article by IT Jungle
Or get the S4i Express brochure
Watch the recorded webinar