![Page 1: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/1.jpg)
Materials may not be reproduced in whole or in part without the prior written permission of IBM. 5.3
© Copyright IBM Corporation 2011
IBM Systems and Technology Group Asia Pacific Technical Enablement Conference
Deploying Oracle RAC 11g R2 on AIX6 using raw devices with PowerHA
SeongLul Son – [email protected]
![Page 2: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/2.jpg)
2© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
2
Note: This presentation is based on one of the real reference cases. This scenario can be applied if a customer understands the limitation of using raw devices for ocr, vote in OUI and datafiles in DBCA from Oracle 11g RAC R2, and still wants to utilize raw devices without using migration method . You need to acquire customers’ understanding and consent before applying this method.
![Page 3: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/3.jpg)
3© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
3
Architecture changes
Raw devices are not supported for OCR and vote devices with OUI
Raw devices are not supported for database files when creating a database with DBCA
SCAN(Singgle Client Access Name) IP is required when setting up Oracle Grid Infrastructure
![Page 4: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/4.jpg)
4© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
4
Architecture changes - shared storage option
Storage option OCR and vote disk Oracle Software Oracle database files
ASM Yes No Yes
GPFS Yes Yes Yes
Raw device (w/ PowerHA)
Yes: Upgrade from previous versions
No: New install with OUI
No Yes: Upgrade from previous versions
No: New creation with DBCA
Local file system No Yes No
Storage option OCR and vote disk Oracle Software Oracle database files
ASM No No Yes
GPFS Yes Yes Yes
Raw device (w/ PowerHA)
Yes No yes
Local file system No Yes No
Oracle RAC10g ~ 11g R1
Oracle RAC 11gR2
![Page 5: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/5.jpg)
5© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
5
![Page 6: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/6.jpg)
6© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
6
Memory and Paging space Requirements
Memory1.5GB for Oracle Grid Infrastructure
2.5GB for Oracle Grid Infrastructure and Oracle RAC
Swap spaceMinimum: 1.5GB
System with 2GB of RAM or less: 1.5 times the amount of RAM
System with 2GB to 16GB of RAM: equal to RAM
System with more than16GB of RAM: 16GB
![Page 7: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/7.jpg)
7© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
7
Consideration on OCR and vote devices
With normal redundancy3 OCR and 3 vote devices are needed
each device needs at least 280 MB in size
OCR and vote on raw devicesOCR and vote on raw devices are not supported from 11gR2
ASM or cluster file system are supported
![Page 8: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/8.jpg)
8© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
8
Operating System Requirements
Operating system- AIX 7.1 Base - AIX 6.1 TL02 SP1- AIX 5.3 TL09 SP1
Operating system filesets (for AIX6.1)opensshbos.adt.basebos.adt.libbos.adt.libmbos.perf.libperfstatbos.perf.perfstatbos.perf.proctoolsrsct.basic.rtersct.compat.clients.rtexlC.aix61.rte 10.1.0.0
![Page 9: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/9.jpg)
9© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
9
Name Resolution
# cat /etc/hosts
127.0.0.1 loopback localhost # loopback (lo0) name/address
130.130.10.115 node15
130.130.10.116 node16
192.168.10.115 node15rac
192.168.10.116 node16rac
130.130.10.215 node15vip
130.130.10.216 node16vip
130.130.10.15 node15scan
Scan IP (Single client access name)-Host name to provide for all clients connecting to the cluster
-The SCAN is a domain name registered to at least one and up to three IP addresses, either in the domain name service (DNS) or the Grid Naming Service (GNS).
-The SCAN eliminates the need to change clients when nodes are added to or removed from the cluster.
![Page 10: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/10.jpg)
10© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
10
Configure OS kernel parameters
Tuning Virtual Memory Manager# vmo -p -o minperm%=3# vmo -p -o maxperm%=90# vmo -p -o maxclient%=90# vmo -p -o lru_file_repage=0# vmo -p -o strict_maxclient=1# vmo -p -o strict_maxperm=0
Parameter Value
minperm% 3
maxperm% 90
maxclient% = 90 90
lru_file_repage 0
strict_maxclient 1
strict_maxperm 0
Note : From AIX6.1, these are all default values
![Page 11: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/11.jpg)
11© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
11
Configure AIX System Environment
Configuring Shell Limits
- /etc/security/limitsdefault:
fsize = -1data = -1core = -1fsize_hard = -1cpu_hard = -1data_hard = -1stack_hard = 65536core_hard = -1
Shell Limit Item in limits.conf Hard Limit
Maximum number of open file descriptors
nofile -1
Maximum number of processes available to a single user
maxuproc 16384
![Page 12: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/12.jpg)
12© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
12
Tuning AIX System Environment
Configuring Network Tuning Parameters Parameter Value
udp_sendspace 65536
udp_recvspace 655360(udp_sendspace * 10)
tcp_sendspace 65536
tcp_recvspace 65536
rfc1323 1
sb_max 4194304
ipqmaxlen 512
![Page 13: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/13.jpg)
13© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
13
Users and Groups
Configuring usersoragrid: create a user for installing the Oracle Grid Infrastructure softwareoracle: user for installing the Oracle RAC software and creating database
From 11g, run the following command as root# chuser capabilities=CAP_NUMA_ATTACH,CAP_BYPASS_RAC_VMM,CAP_PROPAGATE oragrid# chuser capabilities=CAP_NUMA_ATTACH,CAP_BYPASS_RAC_VMM,CAP_PROPAGATE oracle
# lsuser -a capabilities oragrid (checking capabilities for oragrid )
Configuring groupsdba: primary group for the oragrid and oracle userhagsuser: Required in PowerHA environment
![Page 14: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/14.jpg)
14© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
14
Network Time Protocol
Time synchronization is required from Oracle Clusterware 11g Release 2. Choose one of two time synchronization services; Network time protocol (NTP) in AIX or Cluster Time Synchronization Service (CTSS) in oracle.
NTP in AIX-edit /etc/ntp.conf -stop ntpd and restart it with the –x option
# startsrc -s xntpd -a "-x“- edit /etc/rc.tcpip to add the –x option to xntpd on all nodes
start /usr/sbin/xntpd "$src_running" "-x“Note: -x option prevents time from being adjusted backward
Oracle CTSS -Installed in active mode if NTP daemon in AIX is not active-Started in observer mode if NTP is active-In order to confirm that ctssd is active, run the following command$ crsctl stat resource ora.ctssd -t -init
![Page 15: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/15.jpg)
15© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
15
Asynchronous I/O
AIX 6.1 or later-AIO device drivers are enabled by default-Increase the number of aioserver processes to 65536 #ioo –p –o aio_maxreqs=65536
AIX 5.x-rootpre.sh enables AIO device driver-use smit aio to change the maxreqs parameter
![Page 16: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/16.jpg)
16© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
16
ssh configuration
Required from Oracle Clusterware 11g Release 2.
Manual configuration -configure ssh manually for the grid(oragrid) and oracle user-Need to login to other nodes without prompt for password
Automatic configuration by oracle-OUI creates passwordless ssh connectivity if there is no pre-configured ssh configuration
![Page 17: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/17.jpg)
17© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
17
Prepare a disk for ASM
Prepare a disk and change ownership and permission for ASM
![Page 18: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/18.jpg)
18© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
18
Create raw devices for OCR, vote and database files
Create a volume group and configure raw devices that PowerHA will varyonconcurrently
![Page 19: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/19.jpg)
19© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
19
Change ownership and permission (OCR and vote)
Change ownership and permission of raw devices for OCR and vote
![Page 20: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/20.jpg)
20© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
20
Change ownership and permission (Database files)
Change ownership and permission of raw devices for database files
![Page 21: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/21.jpg)
21© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
21
More steps before running runInstaller.sh
Configure PowerHA with a concurrent volume group and start PowerHAConfigure graphic environment on AIX (VNC in our test environment)Run cluster verification utility (runclvfy.sh)Execute rootpre.sh as root on both nodes
![Page 22: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/22.jpg)
22© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
22
![Page 23: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/23.jpg)
23© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
23
Install Oracle grid infrastructure software
Run ./runInstaller.sh as an oragrid user and type ‘y’ if you have already run rootpre.sh on both nodes
![Page 24: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/24.jpg)
24© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
24
Select installation option
Select ‘Install and Configure Grid Infrastructure for a Cluster’
![Page 25: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/25.jpg)
25© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
25
Select installation type
Select ‘Advanced installation’
![Page 26: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/26.jpg)
26© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
26
Select product language
Select languages in which your product will run
![Page 27: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/27.jpg)
27© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
27
Grid plug and play information
Scan Name must be resolved by DNS or /etc/hosts file
We changed the default SCAN port.
![Page 28: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/28.jpg)
28© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
28
Cluster node information
Provide cluster node information
![Page 29: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/29.jpg)
29© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
29
Specify network interface usage
Verify interface type and make changes if necessary
![Page 30: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/30.jpg)
30© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
30
Storage option information
There is no option to choose raw devices for OCR and vote in OUI. Select ‘ASM’ and we will convert them to raw devices later.
![Page 31: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/31.jpg)
31© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
31
Create ASM disk group
Select disk group characteristics and select disks.
![Page 32: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/32.jpg)
32© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
32
Specify ASM password
We type ‘oracle’ for ASM password.
![Page 33: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/33.jpg)
33© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
33
Specify ASM password
It is prompted due to short password length. Just continue.
![Page 34: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/34.jpg)
34© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
34
Privileged operating system groups
Select operating system groups for ASM
![Page 35: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/35.jpg)
35© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
35
Privileged operating system group
Click ‘Yes’
![Page 36: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/36.jpg)
36© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
36
Specify installation location
Select directories for oracle base and grid infrastructure
![Page 37: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/37.jpg)
37© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
37
Create inventory
Select a directory for oracle inventory
![Page 38: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/38.jpg)
38© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
38
Perform prerequisite checks
Verity if system requirements are configured correctly
![Page 39: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/39.jpg)
39© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
39
Summary
Browse the Summary
![Page 40: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/40.jpg)
40© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
40
Run orainstRoot.sh and root.sh
Run the following files in order. orainstRoot.sh on node15 orainstRoot.sh on node16 root.sh on node15 root.sh on node16
![Page 41: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/41.jpg)
41© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
41
Finish
End of installation for oracle grid infrastructure
![Page 42: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/42.jpg)
42© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
42
Checking status of oracle cluster
Verity that the following services are up and running
![Page 43: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/43.jpg)
43© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
43
Install database
We skip detail steps to install database binaries in this presentation because it is basically the same with previous versions.
![Page 44: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/44.jpg)
44© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
44
![Page 45: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/45.jpg)
45© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
45
Create database with DBCA
Run dbca as an oracle user
![Page 46: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/46.jpg)
46© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
46
Create database with DBCA
Select ‘Create a Database’
![Page 47: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/47.jpg)
47© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
47
Create database with DBCA
Select ‘Custom Database’
![Page 48: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/48.jpg)
48© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
48
Create database with DBCA
Provide Database Name and SID
![Page 49: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/49.jpg)
49© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
49
Create database with DBCA
Click Next
![Page 50: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/50.jpg)
50© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
50
Create database with DBCA
Configure
![Page 51: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/51.jpg)
51© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
51
Create database with DBCA
Provide password for DB administration groups
![Page 52: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/52.jpg)
52© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
52
Create database with DBCA
It is prompted due to short password length. Just continue.
![Page 53: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/53.jpg)
53© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
53
Create database with DBCA
There is no raw devices in the selection list. We choose ASM in this screen and will change to raw devices later.
![Page 54: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/54.jpg)
54© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
54
Create database with DBCA
Specify ASMSNMP password
![Page 55: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/55.jpg)
55© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
55
Create database with DBCA
Choose recovery options
![Page 56: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/56.jpg)
56© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
56
Create database with DBCA
Select components you want to configure
![Page 57: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/57.jpg)
57© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
57
Create database with DBCA
Click Next
![Page 58: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/58.jpg)
58© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
58
Create database with DBCA
Click Next
![Page 59: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/59.jpg)
59© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
59
Create database with DBCA
Click the ‘Generate Database Creation Scripts’ check box
![Page 60: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/60.jpg)
60© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
60
Create database with DBCA
Browse summary
![Page 61: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/61.jpg)
61© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
61
Create database with DBCA
Remember the name of the directory that scripts were resided in and modify those script files to change ASM to raw devices.
![Page 62: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/62.jpg)
62© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
62
![Page 63: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/63.jpg)
63© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
63
Edit script files to create DB files on raw devices
Edit the following files to create DB files on raw devices, not on ASM disks. (scripts files are placed in the ORACLE_HOME/admin/db_name/scripts/ directory. -init.ora-CreateDB.sql-CreateDBFiles.sql-postDBCreation.sql
Run RAW1.sh (RAW is the name of database) after modifying the scripts mentioned above.
![Page 64: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/64.jpg)
64© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
64
Edit script files – init.ora
[oracle@node15:/oracle/db/admin/RAW/scripts]$ vi init.ora
###########################################
# File Configuration
###########################################
#db_create_file_dest=+DATA
control_files=('/dev/rrac_control01','/dev/rrac_control02')
Comment out the following line;
db_create_file_dest=+DATA
![Page 65: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/65.jpg)
65© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
65
Edit script files – CreateDB.sql
oracle@node15:/oracle/db/admin/RAW/scripts]$ vi CreateDB.sql
DATAFILE '/dev/rrac_system01' SIZE 500M
EXTENT MANAGEMENT LOCAL
SYSAUX DATAFILE '/dev/rrac_sysaux01' SIZE 500M
SMALLFILE DEFAULT TEMPORARY TABLESPACE TEMP TEMPFILE '/dev/rrac_temp01' SIZE 300M
SMALLFILE UNDO TABLESPACE "UNDOTBS1" DATAFILE '/dev/rrac_undo01' SIZE 500M
CHARACTER SET WE8MSWIN1252
NATIONAL CHARACTER SET AL16UTF16
LOGFILE GROUP 1 ('/dev/rrac_redo01') SIZE 250M,
GROUP 2 ('/dev/rrac_redo02') SIZE 250M
Note: Intentionally omitted some parts of the file that do not need be changed
![Page 66: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/66.jpg)
66© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
66
Edit script files – CreateDBFiles.sql
[oracle@node15:/oracle/db/admin/RAW/scripts]$ vi CreateDBFiles.sql
SET VERIFY OFF
connect "SYS"/"&&sysPassword" as SYSDBA
set echo on
spool /oracle/db/admin/RAW/scripts/CreateDBFiles.log append
CREATE SMALLFILE UNDO TABLESPACE "UNDOTBS2" DATAFILE '/dev/rrac_undo02' SIZE 500M ;
CREATE SMALLFILE TABLESPACE "USERS" LOGGING DATAFILE '/dev/rrac_user01' SIZE 120M EXTENT MANAGEMENT LOCAL SEGMENT SPACE MANAGEMENT AUTO;
ALTER DATABASE DEFAULT TABLESPACE "USERS";
spool off
![Page 67: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/67.jpg)
67© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
67
Edit script files – postDBCreation.sql
[oracle@node15:/oracle/db/admin/RAW/scripts]$ vi postDBCreation.sql
ALTER DATABASE ADD LOGFILE THREAD 2 GROUP 3 ('/dev/rrac_redo03') SIZE 250M,GROUP 4 ('/dev/rrac_redo04') SIZE 250M;
ALTER DATABASE ENABLE PUBLIC THREAD 2;
set echo on
create spfile='/dev/rrac_spfile01' FROM pfile='/oracle/db/admin/RAW/scripts/init
.ora';
shutdown immediate;
host /oracle/db/11g/bin/srvctl enable database -d RAW;
host /oracle/db/11g/bin/srvctl start database -d RAW;
connect "SYS"/"&&sysPassword" as SYSDBA
Note: Intentionally omitted some parts of the file that do not need be changed
![Page 68: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/68.jpg)
68© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
68
![Page 69: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/69.jpg)
69© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
69
Checking current location - OCR
node15:/#cd /oracle/grid/binnode15:/oracle/grid/bin#ocrcheckStatus of Oracle Cluster Registry is as follows :
Version : 3Total space (kbytes) : 262120Used space (kbytes) : 2252Available space (kbytes) : 259868ID : 416468433Device/File Name : +DATA
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
![Page 70: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/70.jpg)
70© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
70
Moving OCR into raw devices
node15:/oracle/grid/bin# ocrconfig -add /dev/rcrs_ocr01node15:/oracle/grid/bin# ocrconfig -add /dev/rcrs_ocr02node15:/oracle/grid/bin# ocrconfig -delete +DATAnode15:/oracle/grid/bin# ocrcheckStatus of Oracle Cluster Registry is as follows :
Version : 3Total space (kbytes) : 262120Used space (kbytes) : 2252Available space (kbytes) : 259868ID : 416468433Device/File Name : /dev/rcrs_ocr01
Device/File integrity check succeededDevice/File Name : /dev/rcrs_ocr02
Device/File integrity check succeeded
![Page 71: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/71.jpg)
71© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
71
Checking current location - Vote
node15:/oracle/grid/bin#crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 153b3f88253f4f8fbfe762a74a19d52f (/dev/rhdisk3) [DATA]
Located 1 voting disk(s).
![Page 72: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/72.jpg)
72© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
72
Moving Vote into raw devices
node15:/oracle/grid/bin# crsctl replace votedisk /dev/rcrs_vote01
Now formatting voting disk: /dev/rcrs_vote01.
CRS-4256: Updating the profile
Successful addition of voting disk 64fa6289057c4fc5bf0f2939027c08ff.
Successful deletion of voting disk 153b3f88253f4f8fbfe762a74a19d52f.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
node15:/oracle/grid/bin# crsctl add css votedisk /dev/rcrs_vote02
Now formatting voting disk: /dev/rcrs_vote02.
CRS-4603: Successful addition of voting disk /dev/rcrs_vote02.
node15:/oracle/grid/bin# crsctl add css votedisk /dev/rcrs_vote03
Now formatting voting disk: /dev/rcrs_vote03.
CRS-4603: Successful addition of voting disk /dev/rcrs_vote03.
![Page 73: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/73.jpg)
73© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
73
Checking new location - Vote
node15:/oracle/grid/bin#crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 64fa6289057c4fc5bf0f2939027c08ff (/dev/rcrs_vote01) [ ]
2. ONLINE 6b03d0b906f14f9abf129d4e9f54480d (/dev/rcrs_vote02) [ ]
3. ONLINE 6dea9266eb294f2abfe4b28b419cafc7 (/dev/rcrs_vote03) [ ]
Located 3 voting disk(s).
![Page 74: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/74.jpg)
74© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
Agenda
• Architecture changes from Oracle RAC 11g R2• Configure pre-requisites of OS• Install Oracle grid infrastructure with ASM using OUI • Generate scripts with DBCA to create a database• Edit scripts and create a database on raw devices(with
PowerHA) • Convert ocr and vote to raw devices(with PowerHA)• Disabling ASM and scan IP
74
![Page 75: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/75.jpg)
75© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
75
Disabling ASM
[oracle@node15:/home/oracle]$ srvctl status asm
ASM is running on node15,node16
[oracle@node15:/home/oracle]$ srvctl status diskgroup -g data
Disk Group data is running on node15,node16
[oracle@node15:/home/oracle]$ srvctl stop diskgroup -g data
[oracle@node15:/home/oracle]$ srvctl stop asm -n node15
[oracle@node15:/home/oracle]$ srvctl stop asm -n node16
[oracle@node15:/home/oracle]$ srvctl disable diskgroup -g data
[oracle@node15:/home/oracle]$ srvctl disable asm
[oracle@node15:/home/oracle]$ srvctl status diskgroup -g data
Disk Group data is not running
[oracle@node15:/home/oracle]$ srvctl status asm
ASM is not running.
![Page 76: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/76.jpg)
76© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
76
Checking SCAN
[oragrid@node15:/home/oragrid]$ netstat -i
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
en0 1500 link#2 0.2.55.4f.af.f0 31059683 0 4287605 0 0
en0 1500 130.130.10 node15 31059683 0 4287605 0 0
en0 1500 130.130.10 node15vip 31059683 0 4287605 0 0
en0 1500 130.130.10 node15scan 31059683 0 4287605 0 0
en1 1500 link#3 0.2.55.af.8d.ba 13023820 0 7324113 0 0
en1 1500 192.168.10 node15rac 13023820 0 7324113 0 0
[oragrid@node15:/home/oragrid]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is enabled
SCAN listener LISTENER_SCAN1 is running on node node15
[oragrid@node15:/home/oragrid]$ srvctl status scan
SCAN VIP scan1 is enabled
SCAN VIP scan1 is running on node node15
![Page 77: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/77.jpg)
77© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
77
Disabling SCAN
[oragrid@node15:/home/oragrid]$ srvctl stop scan_listener
[oragrid@node15:/home/oragrid]$ srvctl stop scan
[oragrid@node15:/home/oragrid]$ srvctl disable scan_listener
[oragrid@node15:/home/oragrid]$ su
root's Password:
# cd /oracle/grid/bin
# srvctl disable scan
![Page 78: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/78.jpg)
78© Copyright IBM Corporation 2011
IBM STG Technical Enablement Conference 2011
78
Disabling SCAN
# su - oragrid
[oragrid@node15:/home/oragrid]$ srvctl status scan_listener
SCAN Listener LISTENER_SCAN1 is disabled
SCAN listener LISTENER_SCAN1 is not running
[oragrid@node15:/home/oragrid]$ srvctl status scan
SCAN VIP scan1 is disabled
SCAN VIP scan1 is not running
[oragrid@node15:/home/oragrid]$ netstat -i
Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll
en0 1500 link#2 0.2.55.4f.af.f0 31061585 0 4287992 0 0
en0 1500 130.130.10 node15 31061585 0 4287992 0 0
en0 1500 130.130.10 node15vip 31061585 0 4287992 0 0
en1 1500 link#3 0.2.55.af.8d.ba 13027815 0 7326374 0 0
en1 1500 192.168.10 node15rac 13027815 0 7326374 0 0
![Page 79: Deploying Oracle 11g RAC R2 on AIX6 Using Raw Devices With PowerHA](https://reader034.vdocuments.us/reader034/viewer/2022051121/577c77521a28abe0548ba096/html5/thumbnails/79.jpg)
Materials may not be reproduced in whole or in part without the prior written permission of IBM. 5.3
© Copyright IBM Corporation 2011
IBM Systems and Technology Group Asia Pacific Technical Enablement Conference
End of Presentation