Author – Anand Mandilwar https://anandmandilwar.com

Multinode Installation of Oracle E-Business suite R12.0.4 and upgrade it to 12.0.6 Configuration Details

Oracle E-business suite version – 12.0.4 (Upgraded to 12.0.6) OS – RHEL 5 update 11 (32 bit Architecture) 2 Node Installation

o tapljs389.tapestry.local – 10.19.11.134 o tapljs383.tapestry.local – 10.19.11.133

Database Name – xxxxx 2 user configuration np

o ‘oraerp’ Oracle filesystem user o ‘applerp’ Application filesystem user

Hosts information for installation – RHEL 5 update 11

HOSTNAME IP Address Services

xxx389.xxx.local 1.9.1.4 Database + Concurrent

xxx388.xxx.local 1.9.1.3 Web + Form

Steps

1. Prepare all OS pre-requisites 2. Prepare stage area 3. Install R12.0.4 Software

Perform all OS pre-requisites on all the nodes. Configure kernel parameters (vi /etc/sysctl.conf file). After making the changes, run “sysctl –p” to restart the system with the new settings. These kernel parameters should be configured on all the hosts. Kernel Settings Edit the /etc/sysctl.conf file to configure your kernel settings. After editing the file, use the "sysctl -p" command or restart the system to invoke the new settings.

Note: If the current value for any parameter is higher than the value listed in the following table, then do not change the value of that parameter.

Parameter Value

kernel.semmsl 256*

kernel.semmns 32000*

kernel.semopm 100*

kernel.semmni 142*

kernel.shmall 2097152

kernel.shmmax Half the size of the physical memory (in bytes), and at least 2147483648

kernel.shmmni 4096

kernel.msgmax 8192

kernel.msgmnb 65535

kernel.msgmni 2878

fs.file-max 65536

net.ipv4.ip_local_port_range 10000 65000**

net.core.rmem_default 262144

net.core.rmem_max 262144

net.core.wmem_default 262144

net.core.wmem_max 262144

Note : *: set using the following entry in the /etc/sysctl.conf file: kernel.sem = 256 32000 100 142 **: values recommended for the local port range may need to be adjusted according to the specific needs of the user's environment in order to avoid port conflicts. Verify kernel parameters on all HOSTS

$ sysctp -p

vi /etc/security/limits.conf * hard nofile 65536 * soft nofile 4096 * hard nproc 16384

* soft nproc 2047 :wq The following i386 packages are not part of the OS distribution media and must be downloaded separately (from http://oss.oracle.com/projects/compat-oracle/files/Enterprise_Linux for both Oracle Linux 5 and RHEL 5) and installed manually: openmotif21-2.1.30-11.EL5.i3861 xorg-x11-libs-compat-6.8.2-1.EL.33.0.1.i386 For Update 1 or 2: binutils-2.17.50.0.6-6.0.1.i3862 For Update 3: binutils-2.17.50.0.6-9.0.1.i3862 For Update 4 (5.4) or higher, see workaround listed belowin the 'After Installing or Upgrading' section. The following i386 packages must be installed from the Oracle Linux 5 or RHEL 5 distribution media: compat-glibc-2.3.4-2.26 compat-glibc-headers-2.3.4-2.26 gcc-4.1.2-14.el5 gcc-c++-4.1.2-14.el5 glibc-2.5-12 glibc-common-2.5-12 glibc-devel-2.5-12 glibc-headers-2.5-12 kernel-headers-2.6.18-128.el5 libgcc-4.1.2-14.el5 libstdc++-devel-4.1.2-14.el5 libstdc++-4.1.2-14.el5 make-3.81-1.1 gdbm-1.8.0-26.2.1 libXp-1.0.0-8.1.el5 libaio-0.3.106-3.2 libgomp-4.1.2-14.el5 sysstat-7.0.0-3.el5 compat-libstdc++-296-2.96-138 compat-libstdc++-33-3.2.3-61 openmotif21-2.1.30-11.EL6.i686.rpm –> for OEL 6 customers Note: 1: The openmotif package version must be 2.1.30 (for example, openmotif-2.2.3-10.RHEL4.5 is not supported). 2: This GNU linker (ld) version 2.17 provided by Oracle is required for relinking the modules in Advanced Planning & Scheduling (MSC, MSO, MSR) and Profitability Manager (FEMCCE) After installing these patches, run ldconfig –v

Following rpms were configured (some were installed and some came with the installation media)

compat-glibc-2.3.4.2.26 (i386) compat-glibc-headers-2.3.4.2.26 gcc-4.1.2.55.el5 (i386) gcc-c++-4.1.2.55.el5 (i386) glibc-2.5.123 (i686) glibc-common-2.5.123 glibc-devel-2.5.123 glibc-headers-2.5.123 kernel-headers-2.6.18.128.el5 libgcc-4.1.2.55.el5 libstdc++-devel-4.1.2.55.el5 (i386) libstdc++-4.1.2.55.el5 (i386) make-3.81.3.el5 (i386) gdbm-1.8.0.28.el5 (i386) libXpm-3.5.5.3 (i386) libaio-0.3.106.5 (i386) libgomp-4.4.7.1.el5 (i386) sysstat-7.0.0.3.el5 (i386) compat-libstdc++-296-2.96.138 (i386) compat-libstdc++-33-3.2.3.61 (i386) libXp-1.0.0.8.1.el5 (i386) libXp-devel-1.0.0-8.1.el5.i386.rpm openmotif21-2.1.30.11.EL5 (i386) libaio-devel-0.3.106.5 (i386)

Connectivity between hosts Ping from 388 to 389

Ping from 389 to 388

Update /etc/hosts file on each of the servers On 388

On 389

Download and Install patch # 6078836 – this is to be done on both the servers 389 & 388

Configure filesystem and OS user account

Create Group and User o Create one group called ‘dbaerp’

$ groupadd dbaerp o Create one application user “applerp” and one oracle FS user “oraerp”

$ useradd –g dbaerp applerp

$ passwd applerp to assign the password $ useradd –g dbaerp oraerp

$ passwd oraerp

Create a base directory - /u01/ebs/R1204/ o $ mkdir –m 775 –p /u01/ebs/R1204 o $ chmod –R /u01/ebs/R1204

Create directory for Oracle FS o $ mkdir –p /u01/ebs/R1204/orR12 o $ chmod –R 775 /u01/ebs/R1204/oraR12 o $ chown –R oraerp:dbaerp /u01/ebs/R1204/oraR12 permission granted to oracle FS

use

Create directory for application FS o $ mkdir –p /u01/ebs/R1204/applR12 o $ chmod –R 775 /u01/ebs/R1204/applR12 o $ chown –R applerp:dbaerp /u01/ebs/R1204/applR12/

Create Staging directory

Create Staging directory (using root user)

$ mkdir –p /u01/StageR12

$ chmod –R 755 /u01/StageR12 Download all the zip file from Oracle e-Delivery site against the appropriate OS. For my case it was as below.

Unzip all the zip files to this staging directory

$ unzip <zip_file.zip> -d /u01/StageR12 (this needs to be done on all the nodes/servers using ‘root’ user)

After unzipping, it will be like below

VNC port was not opened on server 388 and hence XDISPLAY was not happening despite the “vnc” process running successfully on the server. To overcome the error, VNC port was opened in the ‘iptables’.

Running Rapidwiz on 389 - Login as ‘root’ and cd to ‘StartCD/Disk1/rapidwiz

This was wrong and correct to is

-/u01/ebs/R1204/oraR12

This was wrong and correct to is

-/u01/ebs/R1204/applR12/inst

Correction Base dir -/u01/ebs/R1204/applR12 Instance Dir - /u01/ebs/R1204/applR12/inst

Correction Base dir -/u01/ebs/R1204/applR12 Instance Dir - /u01/ebs/R1204/applR12/inst

Correction Base dir -/u01/ebs/R1204/applR12 Instance Dir - /u01/ebs/R1204/applR12/inst

Node 389

Got Error here – bcos

Oracle base directory and application base directory were wrongly defined in the

Correct Oracle base directory - /u01/ebs/R1204/oraR12

Correct Application base directory - /u01/ebs/R1204/applR12 Hence Instance directory for application will be /u01/ebs/R1204/applR12/inst “inst” directory was created with proper permission and ownership.

mkdir –p /u01/ebs/R1204/applR12/inst

chmod –R 775 /u01/ebs/R1204/applR12/inst

chown –R applerp:dbaerp /u01/ebs/R1204/applR12/inst once above correction is done and clicked on “Re-try”, it went successfully.

Rapidwiz completed successfully on 389

VNC port was not opened on server 388 and hence XDISPLAY was not happening despite the “vnc” process running successfully on the server. To overcome the error, VNC port was opened in the ‘iptables’. This was done for server 389 as well.

Running Rapidwiz on 388

This is dummy

To overcome above error, configuration file needs to be copied from Server 389 and put to some location on 388

Database connection was not happening and hence all errors. Reason

1) Listener was running with the default name LISTENER while listed in listener.ora file is “xxxxx” 2) Hence started the listener “xxxxx” and stopped the default listener

a. $ lsnrctl start xxxxx b. $ lsnrctl stop

3) Also renamed sqlnet.ora to sqlnet_bkp.ora – this is to let tnsnames.ora be the direct file to be read

4) Even after doing all the above steps, now SQL connection started working from application HOME on 389 but still not from 388. Reason was – database port “1523” was not open on database server 389 (tnsping <SID> was through ‘TNS protocol’ error/ when I did telnet <db_server> <database

port> on server 388, connection did not go through successfully. a. All the above test led me to believe that DB port is not opened on 389

i. Again to update the database port, I had to modify the iptables and allow for the port 1523.

b. Once the port is opened, database connection got established successfully. i. Stopped all the services on 389 so as to run ‘autoconfig’ on 388

ii. Since ‘autoconfig’ threw error “could not connect to database” before, I ran it manually on 388 and it completed successfully this time.

After performing above troubleshooting steps, “Retry” is clicked and it completed w/o any issue.

Successfully launched the “Login Page”

Now in order for the environment to be correctly set every time you login using ‘applerp’ or ‘oraerp’, update the .profile (bash_profile for linux).

For ‘applerp’

For ‘oraerp’

Now the task is to upgrade Oracle E-Business 12.0.4 to 12.0.6

There is release update pack to upgrade 12.0.4 to 12.0.6 – Patchset 672800

(https://blogs.oracle.com/stevenChan/entry/apps_release_1206_release_update_pack_now_avail)

o

o Prereq. patch for 12.0.6 (6728000) is R12.AD.A.delta.6 (7305220) & optional online help

patch (7109200) As with other ad patches, You CAN’T merge 12.0.6 (6728000) with

R12.AD.A.delta.6 (7305220) You can apply 12.0.6 only on R12 instance i.e. 12.0.0, 12.0.1, 12.0.2, 12.0.3,

12.0.4 or FIN & HRMS RUP5 o Unzip patch 7305220

$ cd /tmp/patch

$ unzip p7305220_R12.AD.A_R12_LINUX.zip Now before applying the pre-requisite patch – 7305220

o Pre-install step Login to DB tier as oraerp user $ source the environment to point to RDBMS ORACLE HOME cd $ORACLE_HOME/appsutil $ mkdir –p admin $ cd admin $ cp /tmp/patch/7305220/adgrants.sql . $ sqlplus “/ as sysdba “ $ @adgrants APPLSYS

o Pls make sure to source the environment – In my case, I added this into the .profile of the ‘applerp’ user account

o Apply the patch in each of the APPL_TOP (388 & 389 – as ‘applerp’ user) o Log file did not record any error and patch got applied successfully

Now apply patch # 672800 – this will take time may be 7-8 hrs

o Patch is applied on all the APPL_TOP. While applying on 389, got an error due to relinking. Reviewed the log file and it was only for one executable. Hence ignored the error and proceeded with the patch application

o

o Patch got successfully applied on both 388 & 389 Post patch installation steps (672800)

o Create appsutil.zip from middle tier (in my case it is 389) using admkappsutil.pl and unzip appsutil.zip in database ORACLE_HOME

o Run admkappsutil.pl to create the file appsutil.zip in $INST_TOP/admin/out directory. Copy this appsutil.zip to database server in RDBMS ORACLE_HOME

Login to oracle database server as oracle user “oraerp”

$ cd $ORACLE_HOME (pls make sure to point to ORACLE_HOME to RDBMS ORACLE HOME)

$ scp applerp@388:/$INST_TOP/admin/out/appsutil.zip . $ unzip –o appsutil.zip (this will overwrite some of the existing files from Middle

tier) o Run autoconfig on database tier

After the autoconfig is run successfully, you can grep “config_option” in context file and it will show the entry of 12.0.6

o Re-run adpreclone.pl on the database tier and the applications tier. Since updates included in RUP6 were applied to the system, adpreclone must be run again in order to apply the updates to the clone directory structures used during cloning

o Disable the maintenance mode

Start the application services

Error while opening the form

Launch IE and followed the navigation shown below Added “xxxs388.xxx.local” . This resolved the FRM-92050 error and

Reference Documents

Oracle Applications Installation and Upgrade Notes Release 12 (12.0.4) for Linux (32-bit) (Doc ID 402310.1)

http://blogs.oracle.com/stevenChan/entry/apps_release_1206_release_update_pack_now_avail