Clusterware version consistency failed

Recently we rollbacked (qtree snapshots were restored) 11.2.0.3 2-node RAC back to 10.2.0.5 version after testing successful upgrade.Again it was time for mock upgrade to 11.2.0.3, before performing it on production.We started the runInstaller for CRS upgrade and after the “Prerequisite Checks” it showed ” clusterware version consistency failed for both the nodes”.

The to be new 11gR2 Grid_HOME –> /u01/app/grid/11.2.0
The 10gR2 CRS_HOME –> /u01/app/oracle/product/crs

xy4000: (mode1)crsctl query crs softwareversion
CRS software version on node [xy4000] is [10.2.0.5.0]
xy4000: (node1)crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.5.0]

xy4001: (node2) /u01/app/grid> crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.5.0]
xy4001: (node2) /u01/app/grid> crsctl query crs softwareversion
CRS software version on node [xy4001] is [10.2.0.5.0]

So the active and software version looks correct on both the nodes.Started the runInstaller in debug mode and saw

[pool-1-thread-1] [ 2012-03-13 02:18:32.093 CDT ] [UnixSystem.getCRSHome:2762]  remote copy file result=1| :successful
[pool-1-thread-1] [ 2012-03-13 02:18:32.094 CDT ] [UnixSystem.getCRSHome:2786]  configFile=/tmp/olr.loc13316231114317895692168542383724.tmp
[pool-1-thread-1] [ 2012-03-13 02:18:32.097 CDT ] [Utils.getPropertyValue:241]  keyName=olrconfig_loc props.val=/u01/app/grid/11.2.0/cdata/xy4001.olr propValue=/u01/app/grid/11.
2.0/cdata/xy4001.olr
[pool-1-thread-1] [ 2012-03-13 02:18:32.100 CDT ] [Utils.getPropertyValue:241]  keyName=crs_home props.val=/u01/app/grid/11.2.0 propValue=/u01/app/grid/11.2.0
[pool-1-thread-1] [ 2012-03-13 02:18:32.103 CDT ] [Utils.getPropertyValue:301]  propName=crs_home propValue=/u01/app/grid/11.2.0
[pool-1-thread-1] [ 2012-03-13 02:18:32.106 CDT ] [UnixSystem.getCRSHome:2794]  crs_home=/u01/app/grid/11.2.0

It gave us the clue that things are being read for olr (Oracle Local Registry – new in 11gR2).Checked the /etc/oracle and olr.loc existed.

xy4000: (node1) /etc/oracle> ls -lrt
total 2244
drwxr-xr-x  3 root dba    4096 Apr 19  2009 scls_scr
-rw-r--r--  1 root dba     131 Apr 19  2009 ocr.loc
-rw-r--r--  1 root dba      82 Feb 29 01:06 olr.loc

Renamed it on both the nodes, and started the runInstaller, all went fine after it 🙂

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s