Achieving High Availability and Disaster Recovery of Oracle 10g and Solaris ZonesJoe D’Angelo, Sr. Systems Engineer Serverware Corp.Sam Brunacini, Sr. Systems Engineer Serverware Corp.Minakshi Sehgal, Symantec Corporation. June 13th, 2007

Symantec Vision 2007 2

Agenda

Overview of Storage Foundation HA 11

Project Scope (Serverware and NYISO)22

Implementing Solaris Zones with VCS 33

Oracle and SAN Components44

Disaster Recovery vs. Alternate Data Center 55

Symantec Vision 2007 3

SIMPLIFIED MANAGEMENTSIMPLIFIED MANAGEMENT

One console for all clusters

All major operating systems

All major applications

Larger clusters

Roaming spares

Veritas Cluster Server: Intelligent Clustering

Integrated with replication

Non-disruptive testing

Uptime reports

IMPROVED UTILIZATIONIMPROVED UTILIZATION RELIABLE DRRELIABLE DR

Symantec Vision 2007 4

Vendor Overview

• Rochester-based with both sales and technical resources deployed across New York State

• Specializing in Data Center Solutions, Data Management and Managed Services

• Go-to partner for top technology providers like Sun, Symantec, Oracle and Hitachi

Serverware CorporationServerware Corporation

Symantec Vision 2007 5

Customer Overview

New York State Independent System Operator (NYISO)New York State Independent System Operator (NYISO)

• Management Entity Responsible for the New York State Electrical Transmission Grid (~20 Million NY Residents)

• Currently oversees NYS wholesale Electricity Market as a Not-for-Profit Organization

• $50 Billion worth of Transactions since its inception in 1999

• The most sophisticated and comprehensive energy management system in the United States.

Symantec Vision 2007 6

Customer Concerns and Needs

• Manageability of Infrastructure

– Heterogeneous and Complex

– Operations Monitoring

• Deployment Time

– Reducing Go-To-Market for systems and new applications

• Reliability

– Bullet-Proof Infrastructure and DR

• Capital Expenditures and ROI

– Maximize physical system usage to maximize return

– “Cost vs. Value”

• Implication

– Loss of Revenue

• Solution Architecture

– Joint design between vendor and customer

– Insure compatibility with current environment

Symantec Vision 2007 7Symantec Vision 2007 7

Customer Technical Requirements

• Highly Available Infrastructure

• Disaster Recovery (4 Hours Downtime Max)

• Leverage Solaris Zones

• Portable Data

• No Idle Boxes

• Oracle 10g Support

• Integration with Current HDS SAN Infrastructure

– Shadow Image and TrueCopy (VCS, VxVM)

• Integration with Pre-Existing NBU Infrastructure on AIX

• Minimal Impact to their Operations Support Model

Symantec Vision 2007 8

Infrastructure Considerations

• Solaris 10 on the Sunfire V890 Platform

• Boot from SAN (No internal Disk)

• Zone Root on Shared Storage

• Loop-Back File Systems

• Oracle 10g R2 Installed in each Non-Global Zone

• HDS TagmaStore USP Storage/SAN

• HW Based Replication (TrueCopy)

• NetBackup on Different Platform

Symantec Vision 2007 9

Solution Design and Software Components

• Veritas Storage Foundation™ for Oracle 5.0 by Symantec

– Veritas Volume Manager (CDS)

– Veritas Cluster Server with GCO

– Veritas File System

– TrueCopy™ Replication Agent

– Oracle Application Agent

– ODM

– FireDrill™

• Veritas Storage Foundation™ for AIX

• Hitachi Data Systems TrueCopy™ and Shadow Image™

– CCI Version 01-19-03/04

• Oracle 10g R2 Enterprise Edition

• Solaris 10

• NetBackup 6.0 for AIX

Symantec Vision 2007 10

Local Clustering and Zone Failover

Primary Site VCS Cluster

• Each Non-Global Zone contains an Oracle environment which can be switched between physical servers in the cluster.

• All data is on the SAN, so the Oracle Zone is live on the server where the storage is active.

• Each Zone is independent of all others.

• To the DBA, Oracle looks like it exists on its own server.

• Oracle benefits from Storage Foundation’s version of ODM.

Symantec Vision 2007 11

Dev ZoneDev Zone

Prod ZoneProd Zone

Symantec Vision 2007 11

Zone Failover Example

Solaris 10 Global Zone

Storage Foundation HA for Oracle

Enterprise Agents

Prod ZoneProd Zone

Dev ZoneDev Zone

Solaris 10 Global Zone

Storage Foundation HA for Oracle

Enterprise Agents

STG ZoneSTG ZoneSTG ZoneSTG Zone Prod ZoneProd ZoneProd ZoneProd Zone

Dev ZoneDev Zone

Prod ZoneProd Zone

Dev ZoneDev Zone

STG ZoneSTG Zone

Dev ZoneDev Zone

STG ZoneSTG Zone

Symantec Vision 2007 12

Remote Cluster Failover and Replication

• A Global Cluster and Replicated Data

Primary Site

PROD_DB01 Zone

STAG_DB01 Zone

VCSCLUSTER

OracleZone Root

OracleZone Root

SUNFIRE V890 SUNFIRE V890

HDS Command Control Interface

HDS Command Control Interface

PROD_DB02 Zone

OracleZone Root

STAG_DB02 Zone

OracleZone Root

NODE 1 NODE 2

Secondary Site

PROD_DB01 Zone

STAG_DB01 Zone

VCSCLUSTER

OracleZone Root

OracleZone Root

SUNFIRE V890 SUNFIRE V890

HDS Command Control Interface

HDS Command Control Interface

PROD_DB02 Zone

OracleZone Root

STAG_DB02 Zone

OracleZone Root

NODE 1 NODE 2

HDS TagmaStore USP HDS TagmaStore USP

VERITAS Global Cluster

Option

HDS TrueCopy

Symantec Vision 2007 13

Oracle Service Group

Symantec Vision 2007 14

Service Group Dependencies

Symantec Vision 2007 15

Remote Cluster View

10.10.10.1

10.10.10.2

Symantec Vision 2007 16

Backup and Recovery

• Off-Host Backup Using Storage Foundation (VxVM)

– Cross Platform Data Share (CDS Disk Group)

– Shadow Image/CCI vs. Disk Group Split and Join

– Netbackup

• Disaster Recovery v.s. Alternate Data Center

– Leverage All Capital Investments

– Distribute Resource Load (Thresholds)

– ROI Achieved Much Sooner

Symantec Vision 2007 17Symantec Vision 2007 17

FireDrill Site Failover Verification

• Currently being Implemented

• Allows for Non-Disruptive Site Failover Testing

• Integrates with TrueCopy® Agents and Shadow Image®

• Compliance and Audits

FireDrill Service Group

Symantec Vision 2007 18Symantec Vision 2007 18

Realized Benefits and Results

• Reduction in Server Count

• Configuration Complexity Reduced

• Cross Platform/Off-Host Processing

• Reduced Admin Time and Cost

• Tangible ROI (Maximize HW Investments)

• Portable Operational Environments (Dev/Test/Prod)

– “Have Disk Will Replicate”

– Physical Server Moves are Less Complex

– Application Hosting Options

Symantec Vision 2007 19

Deployments Considerations

• Oracle– Binaries Local vs. Shared Storage

– ODM library

• SAN– Bi-Directional Replication

– IP Resources for HORCM Always Active

• Zone Configuration– Ensure Container Name is Defined (VCS Resources)

– Default Routes @ Global Zone Defined

• Dev/Test/Staging– Create a Sandbox

• Reduce Complexity– Cross Platform Tools (VCS, VEA, SF Management Server)

• Documentation– Log all Changes and Updates

Symantec Vision 2007 20

&ANSWERS

QUESTIONS

jdangelo@serverewarecorp.comsbrunacini@serverwarecorp.com

Thank You