06 Installing Oracle Clusterware

References

Oracle® Clusterware Installation Guide 11g Release 1 (11.1) for Linux

Installing Oracle Clusterware

Followed the procedure in Installing Oracle Clusterware .

Verifying Oracle Clusterware Requirements with CVU

The procedure in Verifying Oracle Clusterware Requirements with CVU was already done in 04 Oracle Clusterware Preinstallation Tasks .

Preparing to Install Oracle Clusterware with OUI

There was nothing to do according to Preparing to Install Oracle Clusterware with OUI as this was a complete new installation of OS and HW as well.

Installing Oracle Clusterware with OUI

Followed the procedure in Installing Oracle Clusterware with OUI .

The installation software location has been moved from a VMware Shared folder ( /mnt/hgfs/OCM/Software ) to a NFS filesystem ( /u00 mounted on freenas:/mnt/SOFTWARE ). This was done because I had started experimenting with the remote operations feature of VMware Workstation 8 which requires all files to be in a shared folder under Windows.

su - crs
cd /u00/product/11.1.0.6/clusterware
./runInstaller
Running Oracle Inventory Root Scripts

On PENRITH1 ,

[root@penrith1 ~]# cd /u01/app/oraInventory/
[root@penrith1 oraInventory]# ./orainstRoot.sh 
Changing permissions of /u01/app/oraInventory to 770.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete

On PENRITH2 ,

[root@penrith2 ~]# cd /u01/app/oraInventory/
[root@penrith2 oraInventory]# ./orainstRoot.sh 
Changing permissions of /u01/app/oraInventory to 770.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete
Running CRS Root Scripts

On PENRITH1 ,

[root@penrith1 oraInventory]# cd /u01/app/crs/product/11.1.0/crs/
[root@penrith1 crs]# ./root.sh
WARNING: directory '/u01/app/crs/product/11.1.0' is not owned by root
WARNING: directory '/u01/app/crs/product' is not owned by root
WARNING: directory '/u01/app/crs' is not owned by root
WARNING: directory '/u01/app' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.

Setting the permissions on OCR backup directory
Setting up Network socket directories
Oracle Cluster Registry configuration upgraded successfully
The directory '/u01/app/crs/product/11.1.0' is not owned by root. Changing owner to root
The directory '/u01/app/crs/product' is not owned by root. Changing owner to root
The directory '/u01/app/crs' is not owned by root. Changing owner to root
The directory '/u01/app' is not owned by root. Changing owner to root
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :   
node 1: penrith1 penrith1-priv penrith1
node 2: penrith2 penrith2-priv penrith2
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Now formatting voting device: /u04/voting
Now formatting voting device: /u05/voting
Now formatting voting device: /u06/voting
Format of 3 voting devices complete.
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
Cluster Synchronization Services is active on these nodes. 
        penrith1
Cluster Synchronization Services is inactive on these nodes. 
        penrith2
Local node checking complete. Run root.sh on remaining nodes to start CRS daemons.

On PENRITH2 ,

[root@penrith2 oraInventory]# cd /u01/app/crs/product/11.1.0/crs/
[root@penrith2 crs]# ./root.sh
WARNING: directory '/u01/app/crs/product/11.1.0' is not owned by root
WARNING: directory '/u01/app/crs/product' is not owned by root
WARNING: directory '/u01/app/crs' is not owned by root
WARNING: directory '/u01/app' is not owned by root
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.

Setting the permissions on OCR backup directory
Setting up Network socket directories
Oracle Cluster Registry configuration upgraded successfully
The directory '/u01/app/crs/product/11.1.0' is not owned by root. Changing owner to root
The directory '/u01/app/crs/product' is not owned by root. Changing owner to root
The directory '/u01/app/crs' is not owned by root. Changing owner to root
The directory '/u01/app' is not owned by root. Changing owner to root
clscfg: EXISTING configuration version 4 detected.
clscfg: version 4 is 11 Release 1.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node :   
node 1: penrith1 penrith1-priv penrith1
node 2: penrith2 penrith2-priv penrith2
clscfg: Arguments check out successfully.

NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
Cluster Synchronization Services is active on these nodes. 
        penrith1
        penrith2
Cluster Synchronization Services is active on all the nodes. 
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
Running vipca(silent) for configuring nodeapps

Creating VIP application resource on (2) nodes...
Creating GSD application resource on (2) nodes...
Creating ONS application resource on (2) nodes...
Starting VIP application resource on (2) nodes...
Starting GSD application resource on (2) nodes...
Starting ONS application resource on (2) nodes...


Done.

Confirming Oracle Clusterware Function

Followed th procedure in Confirming Oracle Clusterware Function .

[root@penrith1 ~]# su - crs
[crs@penrith1 ~]$ cd /u01/app/crs/product/11.1.0/crs/bin/
[crs@penrith1 bin]$ ./crs_stat -t -v
Name           Type           R/RA   F/FT   Target    State     Host        
----------------------------------------------------------------------
ora....th1.gsd application    0/5    0/0    ONLINE    ONLINE    penrith1    
ora....th1.ons application    0/3    0/0    ONLINE    ONLINE    penrith1    
ora....th1.vip application    0/0    0/0    ONLINE    ONLINE    penrith1    
ora....th2.gsd application    0/5    0/0    ONLINE    ONLINE    penrith2    
ora....th2.ons application    0/3    0/0    ONLINE    ONLINE    penrith2    
ora....th2.vip application    0/0    0/0    ONLINE    ONLINE    penrith2