configuring oracle enterprise manager cloud control 12c for high availability
DESCRIPTION
Oracle Enterprise Manager Cloud Control 12c provides a complete infrastructure management solution for databases, applications and hardware. Being such a key component in the enterprise naturally leads to concerns about redundancy and high availability. If something does go wrong within the configuration, it should be able to be recovered in the shortest possible time, thus minimizing disruptions to manageability and monitoring of the enterprise infrastructure. It is with these points in mind that Oracle Enterprise Manager has been designed to be able to meet high service and operating levels using different high availability mechanisms.TRANSCRIPT
![Page 1: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/1.jpg)
Configuring Oracle Enterprise Manager Cloud Control 12c for
High AvailabilitySession ID# 326
Leighton L. Nelson
Mercy
![Page 2: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/2.jpg)
About Me
•Oracle Certified DBA with 10+ years experience•Oracle RAC SIG US Events Chair/IOUG Liaison•Co-Author (Expert Oracle Enterprise Manager 12c- Apress)
![Page 3: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/3.jpg)
Agenda•Architecture•HA Overview
•Level 1 HA – Single OMS & Repository•Level 2 HA – Active/Passive OMS with Local Data Guard•Level 3 HA – Multiple OMS behind SLB with RAC Data Guard
•General Recommendations for HA•Configuration Steps•Backup & Recovery
![Page 4: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/4.jpg)
What is High Availability?
99.9999999999999999999999
“Seven Nines” = 3.15 seconds downtime per
year
![Page 5: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/5.jpg)
What is High Availability?
![Page 6: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/6.jpg)
Architecture
![Page 7: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/7.jpg)
High Availability Levels
![Page 8: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/8.jpg)
Level 1- Single OMS & Repository
![Page 9: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/9.jpg)
Level 1- Single OMS & Repository
•Separate servers for OMS & Repository
•Keeps resource usage separate
•memory_target or sga_size on database repository
•Java VM Heap Size - Xmx
![Page 10: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/10.jpg)
Level 1- Single OMS & Repository
Pros Cons
Simple Setup No redundancy
Low cost
Scalable
![Page 11: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/11.jpg)
Level 2 – Active/Passive OMS w/ local Data Guard
![Page 12: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/12.jpg)
Level 2 – Active/Passive OMS with local Data Guard
OMS binaries installed on shared filesystemNFS/OCFS2
Uses virtual hostnameManaged by Oracle Clusterware or 3rd party solution
Virtual hostname should resolve to unique IP addressConfigure repository database using local physical standby w/ Data Guard
![Page 13: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/13.jpg)
Level 2 – Active/Passive OMS with local Data Guard
Pros Cons
Protects against repository and OMS host failure
More complex
Switchover time minimal No storage redundancy for OMS
Requires additional hardware
![Page 14: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/14.jpg)
Level 3 – Active/Active OMS w/ SLB and RAC Data Guard Repository
![Page 15: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/15.jpg)
Level 3 – Active/Active OMS w/ SLB and RAC Data Guard Repository
•Primary OMS with RAC Repository•SLB for multiple OMSs•All access to OMS done via SLB
•EM Console•EMCLI•Agents
•Standby Database (RAC or Single-Instance)
![Page 16: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/16.jpg)
Level 3 – Active/Active OMS w/ SLB and RAC Data Guard Repository
Pros Cons
Protects against repository and OMS host failure
Very complex
Switchover time minimal More hardware
Protects against storage failure
![Page 17: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/17.jpg)
Recommendations for Repository HA
•Use dedicated database•Use ASM for database storage•Configure RAC Repository•Configure Standby Database•Configure Fast Start Failover•Review MAA Advisor after OEM installation
![Page 18: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/18.jpg)
Configure DB service for Repository
11gR2 methodsrvctl add service -d emrep -s emrepsrvc -l PRIMARY -q FALSE -e NONE -m NONE -w 0 -z 0
Pre-11gR2 method•Add service using DBMS_SERVICE.CREATE_SERVICE•Start Service using DBMS_SERVICE.START SERVICE•Create trigger to start service when in primary role
![Page 19: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/19.jpg)
Recommendations for OMS HA
•Configure Multiple OMSs•Configure SLB in Active/Active configuration•Install OMS on separate hosts from repository•Use “Add Management Service” Deployment Procedure to Add Primary OMS•Use Modified “Add Management Service” Procedure to Add Standby OMSs
![Page 20: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/20.jpg)
Configure OMS HA•Active/Passive configuration uses virtual hostname•Create Application VIP using Clusterware
•11gR2 uses appvipcfg command•Pre-11gR2 uses crs_profile command
•Clusterware manages failover of virtual hostname•OEM can also be configured as Clusterware resource
![Page 21: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/21.jpg)
Configure OMS HA•Active/Active configuration requires SLB•SLB requirements
•Virtual Servers•Persistence (Stickiness)• Health Monitoring
•Register virtual hostname and IP in DNS
![Page 22: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/22.jpg)
Configure OMS HA
![Page 23: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/23.jpg)
Configure OMS HA1 Create Pools
• Group of servers receiving on same port
• One pool per service 2 Create Virtual Servers
• Redirects requests to servers in pool
• Clients access virtual hostname and IP
3 Create Health Monitors• Checks health of services at an
interval
![Page 24: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/24.jpg)
Configure OMS HA•Secure OMS with SLB
$OMS_HOME/bin/emctl secure oms -sysman_pass \-reg_pwd regpass \-host slb.example.com \-secure_port 4904 \-slb_port 4904 \-slb_console_port 443 \-reset \-console \-lock_console
![Page 25: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/25.jpg)
Configure OMS HA
•Re-secure Agents with SLB•emctl secure agent –emdWalletSrcUrl https://slb.example.com:4899/em
•Re-configure EMCLI•emcli setup –url=https://slb.example.com/em –username=sysman
![Page 26: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/26.jpg)
Configure OMS HA
•Configure OMS to use SCAN name in 11gR2 or VIPs in pre-11gR2 for RAC
emctl config oms -store_repos_details -repos_conndesc " (DESCRIPTION= (ADDRESS=(PROTOCOL=TCP) (HOST=emrep-scan.example.com)(PORT=1521) ) (CONNECT_DATA=(SERVER=DEDICATED) (SERVICE_NAME = emrep)))" -repos_user sysman
![Page 27: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/27.jpg)
Configure OMS HA
•Configure OMS to use service name when database role changes in 11gR2
emctl config oms -store_repos_details -repos_conndesc '(DESCRIPTION=(FAILOVER=ON)(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=oemhost1)(PORT=1521))(ADDRESS=(PROTOCOL=TCP)(HOST=oemhost2)(PORT=1521)))(CONNECT_DATA=(SERVICE_NAME=emrepsrvc.smrcy.com))(FAILOVER_MODE=(TYPE=select)(METHOD=basic)))' -repos_user sysman
![Page 28: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/28.jpg)
Configure OMS HAAdd Management Service
![Page 29: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/29.jpg)
Configure OMS HA
![Page 30: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/30.jpg)
Recommendations for Agent HA
•Configure to start automatically on boot•Install on redundant storage•Configure restart environment variables for watchdog daemon
•EM_MAX_RETRIES•EM_RETRY_WINDOW
![Page 31: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/31.jpg)
Recommendations for Software Library
•Replicate to secondary system•Storage based replication•rsync
![Page 32: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/32.jpg)
Backup & Recovery•Repository•OMS•Agent•Software Library
![Page 33: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/33.jpg)
Backup & Recovery•Enable Archivelog mode•Backup database using RMAN•Enable Flashback database•Enable Flash/Fast Recovery Area
![Page 34: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/34.jpg)
Backup & RecoveryRepository Recovery•Stop OMS•Restore and Recover database using RMAN•Reconfigure OMS if DB restored to diff host•Complete Repos Resync if Incomplete Recovery•Restart Admin Server and OMS
![Page 35: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/35.jpg)
Backup & Recovery•Backup OMS filesystem and instance home:•Export static configuration
$OMS_HOME/bin/emctl exportconfig oms -sysman_pwd oracle12c -dir /mnt/backup
![Page 36: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/36.jpg)
Backup & RecoveryOMS Recovery•Restore OMS HOME from backup•Software-Only install•Re-install plug-ins using PluginInstall.sh•$OMS_HOME/bin/omsca recover –as –ms -nostart –backup_file <exportconfig file>•Restart OMS
![Page 37: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/37.jpg)
Backup & RecoveryAgent Backup
•No special considerations•Maintain reference image
![Page 38: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/38.jpg)
Backup & RecoveryAgent Recovery
Reinstall Agent Software from Reference Image
![Page 39: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/39.jpg)
SummaryHA Level should match business needs
Complexity increases costHA for Enterprise Manager consists of HA
for all components
![Page 40: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/40.jpg)
Who are we?•Sixth largest Catholic health care system in the U.S.
•Serves more than 3 million people annually.
•Highly integrated organization that includes 32 hospitals, 300 outpatient locations, 39,000 co-workers and 1,700 integrated physicians in Arkansas, Kansas, Missouri and Oklahoma.
•Among 10 percent of health care organizations nationwide to have a comprehensive, integrated electric health record that provides real-time, paperless access to patient information
•MyMercy, a free service, allows patients to connect online with their doctors, plus see medical information, view test results, renew prescriptions an schedule appointments using a personal computer or smart phone
•Health Information and Management Systems Society, a global leader in health care technology, designated Mercy a stage six of a seven-stage process, joining the ranks of health care leaders such as Johns Hopkins and Mayo Clinic
•$60 million data center provides fail-safe protection and power. When an EF5 tornado struck Mercy's Joplin facility in 2011, patient records electronically backed up at offsite data center were immediately available
•Mercy SafeWatch, the largest electronic ICU in the nation, provides 24-hour vigilance to critically ill patients. Alongside on-site medical teams, high-definition cameras and sophisticated technology allow specialized ICU physicians and nurses in a central command center to expand each patient's care team
![Page 41: Configuring Oracle Enterprise Manager Cloud Control 12c for High Availability](https://reader033.vdocuments.us/reader033/viewer/2022061611/55524fb8b4c905954f8b5025/html5/thumbnails/41.jpg)
Questions? Comments?