Install Grid Infrastructure 11.2.0.3.3 on GRIDCTRL

Overview

While upgrading the REPOS database to 11.2.0.3.3 , I thought it would be a good opportunity to install Grid Infrastructure 11.2.0.3.3 on GRIDCTRL. This might solve the problem I had encountered in Problem in Starting Oracle Cloud Control 12c

Pre-Installation Checks

Using the same software I had downloaded for the database in the 11.2.0.3.3 upgrade , I used the following commands:

cd /opt/oracle/software/p10404530/grid
./runcluvfy.sh stage -pre crsinst -verbose -n gridctrl >/tmp/pre_crsinst_cluvfy.lst

The only failure was with NTP:

Starting Clock synchronization checks using Network Time Protocol(NTP)...

NTP Configuration file check started...
The NTP configuration file "/etc/ntp.conf" is available on all nodes
NTP Configuration file check passed
No NTP Daemons or Services were found to be running
PRVF-5507 : NTP daemon or service is not running on any node but NTP configuration file exists on the following node(s):
gridctrl
Result: Clock synchronization check using Network Time Protocol(NTP) failed

The full listing is attached as pre_crsinst_cluvfy.lst

I decided to ignore this error as I will be running GRIDCTRL as a single node cluster.

Installation

To install Grid Infrastructure, I used the following commands:

cd /opt/oracle/software/p10404530/grid
./runInstaller

Step 1: Download Software Updates

After the splash screen, the following appearred:

Step 1 Download Software Updates

I entered my details, and tested the connection. All was okay. I clicked Next , and got the following error message:

No download privileges

This is strange because I have been downloading patches all of the time.

Clicked OK . Changed my selection to Skip software updates , and clicked Next .

Step 2: Installation Option

Choose to install only the software at this time as I need to add several patches:

Step 2 Installation Option

Clicked Next .

Step 3: Product Languages

Left the defaults:

Step 3 Product Languages

Clicked Next .

Step 4: Operating System Groups

Changed all groups to DBA .

Step 5 Operating System Groups

Clicked Next .

Got the following error messages:

Error message - all groups are the same

Clicked Yes .

Step 5: Installation Location

Changed the GRID home to /opt/oracle/11.2.0.3/grid. This is incompatible with the existing Oracle homes on GRIDCTRL.


Step 7 Installation Location

Clicked Next .

Got an error message about the software location not being under the Oracle base. I ignored this message and continued.

Step 6 Prerequisite Checks

Step 6 Prerequisite Checks

I selected Ignore all , then clicked Next .

I got the following message:

INS-13016 ignoring prerequisites

I clicked Yes .

Step 7: Summary

Step 7 Summary

Clicked Install .

Step 8: Install Product

Got the following scripts to run:

Root script

sudo su -
/opt/oracle/11.2.0.3/grid/root.sh


The output is:

Performing root user operation for Oracle 11g

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /opt/oracle/11.2.0.3/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.

To configure Grid Infrastructure for a Stand-Alone Server run the following command as the root user:
/opt/oracle/11.2.0.3/grid/perl/bin/perl -I/opt/oracle/11.2.0.3/grid/perl/lib -I/opt/oracle/11.2.0.3/grid/crs/install /opt/oracle/11.2.0.3/grid/crs/install/roothas.pl


To configure Grid Infrastructure for a Cluster execute the following command:
/opt/oracle/11.2.0.3/grid/crs/config/config.sh
This command launches the Grid Infrastructure Configuration Wizard. The wizard also supports silent operation, and the parameters can be passed through the response file that is available in the installation media.

Clicked OK .

Step 9: Finish

Step 9 Finish

Clicked Close .

Post Installation Verification

Ran the following command to verify the installation:

/opt/oracle/11.2.0.3/grid/bin/cluvfy stage -post crsinst -verbose -n gridctrl

The following error message appears:

 
ERROR: 
Oracle Grid Infrastructure not configured. 
You cannot run '/opt/oracle/11.2.0.3/grid/bin/cluvfy' without the Oracle Grid Infrastructure.
 

I leave this until I have applied all of the patches, and configured the Grid Infrastructure.

Apply Patch 13919095

Before configuring Grid Infrastructure, I want to apply patch 13919095 11.2.0.3.3 GI Patch Set Update (Includes Database PSU 11.2.0.3.3) .

Patch Home

The patch has been unzipped into /opt/oracle/software/p13919095

Check OPatch Version

To check the version of OPatch in the new Grid Infrastructure home, I ran the following command:

/opt/oracle/11.2.0.3/grid/OPatch/opatch version

The output is:

Invoking OPatch 11.2.0.1.7

OPatch Version: 11.2.0.1.7

OPatch succeeded.

Install Patch 6880880

So, I will have to apply patch 6880880 here as patch 13919095 requires OPatch 11.2.0.3.0 or later. Used the following commands:

mv /opt/oracle/11.2.0.3/grid/OPatch \
/opt/oracle/11.2.0.3/grid/OPatch_11.2.0.1.7
unzip60_lnx -d /opt/oracle/11.2.0.3/grid/ \
/opt/oracle/software/p6880880_112000_LINUX.zip

Verified the installation as follows:

$ /opt/oracle/11.2.0.3/grid/OPatch/opatch version
OPatch Version: 11.2.0.3.0

OPatch succeeded.

One-off Patch Conflict Detection and Resolution

I decided against using My Oracle Support Patch Plans, and used the following commands instead:

export GRID_HOME=/opt/oracle/11.2.0.3/grid
export DB_HOME=/opt/oracle/app/OracleHomes/db11.2.0.3
cd /opt/oracle/11.2.0.3/grid/OPatch
./opatch prereq CheckConflictAgainstOHWithDetail -ph /opt/oracle/software/p13919095/13923374 -oh $GRID_HOME
./opatch prereq CheckConflictAgainstOHWithDetail -ph /opt/oracle/software/p13919095/13923374 -oh $DB_HOME
./opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /opt/oracle/software/p13919095/13919095 -oh $GRID_HOME
./opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /opt/oracle/software/p13919095/13919095/custom/server/13919095 -oh $DB_HOME

All four (4) checks passed with the following messages:

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.

Patch Installation in Grid Home

I am following the procedure in Case 5: Patching a Software Only GI Home Installation or Before the GI Home Is Configured :

/opt/oracle/11.2.0.3/grid/OPatch/opatch napply -oh /opt/oracle/11.2.0.3/grid -local /opt/oracle/software/p13919095/13919095

The result is:

Patch 13919095 successfully applied.
OPatch Session completed with warnings.
Log file location: /opt/oracle/11.2.0.3/grid/cfgtoollogs/opatch/opatch2012-10-01_15-52-02PM_1.log

OPatch completed with warnings.

The log file is uploaded as opatch2012-10-01_15-52-02PM_1.log.

/opt/oracle/11.2.0.3/grid/OPatch/opatch apply -oh /opt/oracle/11.2.0.3/grid -local /opt/oracle/software/p13919095/13923374

The result is:

Verifying the update...
Composite patch 13923374 successfully applied.
Log file location: /opt/oracle/11.2.0.3/grid/cfgtoollogs/opatch/opatch2012-10-01_16-12-23PM_1.log

OPatch succeeded.

The log file is uploaded as opatch2012-10-01_16-12-23PM_1.log.

Patch Installation in Oracle Home

The README for patch 13919095 does not mentioned the Oracle Home in Case 5: Patching a Software Only GI Home Installation or Before the GI Home Is Configured , but the README for patch 13923374 says that the patch 13919095 should also be applied to the Oracle Home.

/opt/oracle/app/OracleHomes/db11.2.0.3/OPatch/opatch napply -oh /opt/oracle/app/OracleHomes/db11.2.0.3 -local /opt/oracle/software/p13919095/13919095

The result is:

Verifying environment and performing prerequisite checks...
UtilSession failed: Patch 13919095 requires component(s) that are not installed in OracleHome. These not-installed components are oracle.crs:11.2.0.3.0, oracle.usm:11.2.0.3.0,
Log file location: /opt/oracle/app/OracleHomes/db11.2.0.3/cfgtoollogs/opatch/opatch2012-10-01_16-42-39PM_1.log

OPatch failed with error code 73

Configure Grid Infrastructure for a Stand-Alone Server

The root script from the Grid Infrastructure Software Installation says to run the following commands:

sudo su -
/opt/oracle/11.2.0.3/grid/perl/bin/perl -I/opt/oracle/11.2.0.3/grid/perl/lib -I/opt/oracle/11.2.0.3/grid/crs/install /opt/oracle/11.2.0.3/grid/crs/install/roothas.pl

The output is:

Using configuration parameter file: /opt/oracle/11.2.0.3/grid/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
/opt/oracle/app/OracleHomes/db10g/bin/crsctl query crs activeversion ... failed rc=4 with message:
 Unexpected parameter: crs

/opt/oracle/app/OracleHomes/db10g/bin/crsctl query crs activeversion ... failed rc=4 with message:
 Unexpected parameter: crs

LOCAL ADD MODE
Creating OCR keys for user 'oracle', privgrp 'oinstall'..
Operation successful.
Failure 1 contacting CSS daemon.
CRS-4664: Node gridctrl successfully pinned.
Adding Clusterware entries to inittab

gridctrl     2012/10/01 19:17:02     /opt/oracle/11.2.0.3/grid/cdata/gridctrl/backup_20121001_191702.olr
Successfully configured Oracle Grid Infrastructure for a Standalone Server

Check CRS Status

Updated /etc/oratab as follows:

cat >>/etc/oratab <<DONE
grid:/opt/oracle/11.2.0.3/grid:N
DONE

The following commands were run:

export ORAENV_ASK=NO
export ORACLE_SID=grid
. oraenv
crs_stat -t

The following result was obtained:

Name           Type           Target    State     Host
------------------------------------------------------------
ora.cssd       ora.cssd.type  OFFLINE   OFFLINE
ora.diskmon    ora....on.type OFFLINE   OFFLINE
ora.evmd       ora.evm.type   ONLINE    ONLINE    gridctrl
ora.ons        ora.ons.type   OFFLINE   OFFLINE

Ran the following command to check the OCR:

sudo $(which ocrcheck)

The result is:

Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :         76
         Available space (kbytes) :     262044
         ID                       : 1098189611
         Device/File Name         : /opt/oracle/11.2.0.3/grid/cdata/localhost/local.ocr
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check succeeded

Post CRS Installation Cluster Verification Check

Ran the following command to check the CRS installation:

/opt/oracle/11.2.0.3/grid/bin/cluvfy stage -post crsinst -verbose -n gridctrl

I got the following error messages:

Performing post-checks for cluster services setup

ERROR:
PRVG-5745 : CRS Configuration detected, Restart configuration check not valid in this environment
Verification cannot proceed


Post-check for cluster services setup was unsuccessful on all the nodes.