数据库rac11.2.0.1升级到11.2.0.2遇到的问题（三）

升级grid的时候在第二个节点执行root脚本的时候发生错误，日志如下：

 

OS Kernel Parameter: tcp_ephemeral_low -This is a prerequisite condition to test whether the OS kernel parameter"tcp_ephemeral_low" is properly set.

 Check Failed on Nodes: [ha2,  ha1] 

Verification result of failed node: ha2

Expected Value

 : 9000

Actual Value

 : 32768

 List of errors:

 - 

PRVF-7543 : OS Kernel parameter"tcp_ephemeral_low" does not have proper value on node"ha2" [Expected = "9000" ; Found = "32768"]. - Cause:  Kernel parameter value does not meet the requirement. - Action:  Modify the kernel parameter value to meet therequirement.

Back to Top 

Verification result of failed node: ha1

Expected Value

 : 9000

Actual Value

 : 32768

 List of errors:

 - 

PRVF-7543 : OS Kernel parameter"tcp_ephemeral_low" does not have proper value on node"ha1" [Expected = "9000" ; Found = "32768"]. - Cause:  Kernel parameter value does not meet the requirement. - Action:  Modify the kernel parameter value to meet therequirement.

Back to Top 

 

 

# ls

crsconfig_addparams.sbs  crsdelete.pm             install.incl             roothas.pl

crsconfig_lib.pm         crspatch.pm              installRemove.excl       rootofs.sh

crsconfig_lib.pm.bak     hasdconfig.pl            oracss.pm                s_crsconfig_defs

crsconfig_params         inittab                  paramfile.crs            s_crsconfig_lib.pm

crsconfig_params.sbs     install.excl             rootcrs.pl

# /u01/11.2.0.2/grid/rootupgrade.sh

Running Oracle 11g root script...

 

The following environment variables are setas:

   ORACLE_OWNER= grid

   ORACLE_HOME=  /u01/11.2.0.2/grid

 

Enter the full pathname of the local bindirectory: [/usr/local/bin]:

The contents of "dbhome" have notchanged. No need to overwrite.

The file"oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y

  Copying oraenv to /usr/local/bin ...

The file"coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y

  Copying coraenv to /usr/local/bin ...

 

Entries will beadded to the /etc/oratab file as needed by

Database Configuration Assistant when adatabase is created

Finished running generic part of rootscript.

Now product-specific root actions will beperformed.

Using configuration parameter file: /u01/11.2.0.2/grid/crs/install/crsconfig_params

Creating tracedirectory

Failed to add(property/value):('OLD_OCR_ID/'-1') for checkpoint:ROOTCRS_OLDHOMEINFO.Errorcode is 256

CRS-2791: Starting shutdown of Oracle HighAvailability Services-managed resources on 'ha2'

CRS-2673:Attempting to stop 'ora.crsd' on 'ha2'

CRS-2790: Starting shutdown of ClusterReady Services-managed resources on 'ha2'

CRS-2673: Attempting to stop'ora.ASMDATA.dg' on 'ha2'

CRS-2673: Attempting to stop 'ora.tefis.db'on 'ha2'

CRS-2673: Attempting to stop'ora.LISTENER.lsnr' on 'ha2'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr'on 'ha2'

CRS-2677: Stop of 'ora.LISTENER.lsnr' on'ha2' succeeded

CRS-2673: Attempting to stop 'ora.ha2.vip'on 'ha2'

CRS-2677: Stop of 'ora.ha2.vip' on 'ha2'succeeded

CRS-2672: Attempting to start 'ora.ha2.vip'on 'ha1'

CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr'on 'ha2' succeeded

CRS-2673: Attempting to stop'ora.scan1.vip' on 'ha2'

CRS-2677: Stop of 'ora.scan1.vip' on 'ha2'succeeded

CRS-2672: Attempting to start'ora.scan1.vip' on 'ha1'

CRS-2676: Start of 'ora.ha2.vip' on 'ha1'succeeded

CRS-2676: Start of 'ora.scan1.vip' on 'ha1'succeeded

CRS-2672: Attempting to start'ora.LISTENER_SCAN1.lsnr' on 'ha1'

CRS-2676: Start of'ora.LISTENER_SCAN1.lsnr' on 'ha1' succeeded

CRS-2677: Stop of 'ora.ASMDATA.dg' on 'ha2'succeeded

CRS-2677: Stop of 'ora.tefis.db' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.DATA.dg'on 'ha2'

CRS-2677: Stop of 'ora.DATA.dg' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.asm' on'ha2'

CRS-2677: Stop of 'ora.asm' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.eons' on'ha2'

CRS-2673: Attempting to stop 'ora.ons' on'ha2'

CRS-2677: Stop of 'ora.ons' on 'ha2'succeeded

CRS-2673: Attempting to stop'ora.net1.network' on 'ha2'

CRS-2677: Stop of 'ora.net1.network' on'ha2' succeeded

CRS-2677: Stop of 'ora.eons' on 'ha2'succeeded

CRS-2792: Shutdown of Cluster ReadyServices-managed resources on 'ha2' has completed

CRS-2677: Stop of 'ora.crsd' on 'ha2'succeeded

CRS-2673: Attempting to stop'ora.cssdmonitor' on 'ha2'

CRS-2673: Attempting to stop 'ora.ctssd' on'ha2'

CRS-2673: Attempting to stop 'ora.evmd' on'ha2'

CRS-2673: Attempting to stop 'ora.asm' on'ha2'

CRS-2673: Attempting to stop 'ora.mdnsd' on'ha2'

CRS-2677: Stop of 'ora.cssdmonitor' on'ha2' succeeded

CRS-2677: Stop of 'ora.evmd' on 'ha2'succeeded

CRS-2677: Stop of 'ora.mdnsd' on 'ha2'succeeded

CRS-2677: Stop of 'ora.ctssd' on 'ha2'succeeded

CRS-2677: Stop of 'ora.asm' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.cssd' on'ha2'

CRS-2677: Stop of 'ora.cssd' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.gpnpd' on'ha2'

CRS-2673: Attempting to stop 'ora.diskmon'on 'ha2'

CRS-2677: Stop of 'ora.gpnpd' on 'ha2'succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on'ha2'

CRS-2677: Stop of 'ora.gipcd' on 'ha2'succeeded

CRS-2677: Stop of 'ora.diskmon' on 'ha2'succeeded

CRS-2793: Shutdown of Oracle HighAvailability Services-managed resources on 'ha2' has completed

CRS-4133: Oracle High Availability Serviceshas been stopped.

User grid has the required capabilities torun CSSD in realtime mode

Successfully deleted 1 keys from OCR.

Creating OCR keys for user 'root', privgrp'system'..

Operation successful.

OLR initialization - successful

Adding daemon to inittab

ACFS-9200: Supported

ACFS-9300: ADVM/ACFS distribution filesfound.

ACFS-9307: Installing requested ADVM/ACFSsoftware.

ACFS-9359: The AIX ODM entry for 'acfsctl'was successfully added.

ACFS-9359: The AIX ODM entry for 'advmctl'was successfully added.

ACFS-9359: The AIX ODM entry for 'advmvol'was successfully added.

ACFS-9308: Loading installed ADVM/ACFSdrivers.

ACFS-9327: Verifying ADVM/ACFS devices.

ACFS-9309: ADVM/ACFS installationcorrectness verified.

 Timed out waiting for the CRS stack to start.

/u01/11.2.0.2/grid/perl/bin/perl-I/u01/11.2.0.2/grid/perl/lib -I/u01/11.2.0.2/grid/crs/install/u01/11.2.0.2/grid/crs/install/rootcrs.pl execution failed

# /u01/11.2.0.2/grid/rootupgrade.sh

Running Oracle 11g root script...

 

The following environment variables are setas:

   ORACLE_OWNER= grid

   ORACLE_HOME=  /u01/11.2.0.2/grid

 

Enter the full pathname of the local bindirectory: [/usr/local/bin]: /u01/11.2.0.2/grid/bin

The contents of "dbhome" have notchanged. No need to overwrite.

The contents of "oraenv" have notchanged. No need to overwrite.

The contents of "coraenv" havenot changed. No need to overwrite.

 

Entries will beadded to the /etc/oratab file as needed by

Database Configuration Assistant when adatabase is created

Finished running generic part of rootscript.

Now product-specific root actions will beperformed.

Using configuration parameter file: /u01/11.2.0.2/grid/crs/install/crsconfig_params

Start of resource"ora.crsd" failed

CRS-5702: Resource'ora.crsd' is already running on 'ha2'

CRS-4000: CommandStart failed, or completed with errors.

Failed to startOracle Clusterware stack

Failed to start Cluster Ready Services at/u01/11.2.0.2/grid/crs/install/crsconfig_lib.pmline 1069.

/u01/11.2.0.2/grid/perl/bin/perl-I/u01/11.2.0.2/grid/perl/lib -I/u01/11.2.0.2/grid/crs/install/u01/11.2.0.2/grid/crs/install/rootcrs.pl execution failed

 

 

 

#

# /u01/11.2.0.2/grid/rootupgrade.sh

Running Oracle 11g root script...

 

The following environment variables are setas:

   ORACLE_OWNER= grid

   ORACLE_HOME=  /u01/11.2.0.2/grid

 

Enter the full pathname of the local bindirectory: [/usr/local/bin]: /u01/11.2.0.2/grid/bin

The contents of "dbhome" have notchanged. No need to overwrite.

The contents of "oraenv" have notchanged. No need to overwrite.

The contents of "coraenv" havenot changed. No need to overwrite.

 

Entries will be added to the /etc/oratabfile as needed by

Database Configuration Assistant when adatabase is created

Finished running generic part of rootscript.

Now product-specific root actions will beperformed.

Using configuration parameter file: /u01/11.2.0.2/grid/crs/install/crsconfig_params

Start of resource "ora.crsd"failed

CRS-5702: Resource 'ora.crsd' is alreadyrunning on 'ha2'

CRS-4000: Command Start failed, orcompleted with errors.

Failed to start Oracle Clusterware stack

Failed to start Cluster Ready Services at/u01/11.2.0.2/grid/crs/install/crsconfig_lib.pm line 1069.

/u01/11.2.0.2/grid/perl/bin/perl-I/u01/11.2.0.2/grid/perl/lib -I/u01/11.2.0.2/grid/crs/install/u01/11.2.0.2/grid/crs/install/rootcrs.pl execution failed

 

 

 

决定下次卸载后重新升级：

Things to Consider Before Upgrading to 11.2.0.2 Grid Infrastructure [ID1312225.1]

 

查了一些资料，可以通过deinstall 命令卸载，到grid用户的 ORACLE_HOME下：  

[grid@rac01 ~]$ cd /u01/grid/
[grid@rac01 grid]$ cd deinstall/
[grid@rac01 deinstall]$ ./deinstall 
Checking for required files and bootstrapping ...
Please wait ...
Location of logs /tmp/deinstall2010-12-28_05-55-36-PM/logs/  

执行命令很长， 有一些交互的界面， 希望能够彻底删干净。
5月8日
接着上次的事情写，卸载的时候执行命令不成功，我就手工把新安装grid的路径下得东西都删除了。
重新再去以升级方式安装的时候不断报错，一点一点改，例如inventory中内容等。
间隔一段时间后决定以重新安装的方式安装grid，以为之前的数据库已经不可用了，（上次执行到第二个节点的时候有报错后）
中间等等不再叙述，
只是后面在第一个节点执行root.sh脚本有如下报错：
在安装rac的时候报错如下：


ohasd failed to start
Failed to start the Clusterware. Last 20 lines of the alert log follow: 
2011-07-08 10:24:53.458
[client(6029368)]CRS-2101:The OLR was formatted using version 3.
2011-07-08 10:24:59.585
[client(6029370)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running). 
2011-07-08 10:25:08.104
[client(6029370)]CRS-1013:The OCR location in an ASM disk group is inaccessible




CRS-2317:Fatal error: cannot get local GPnP security keys (wallet). 
CRS-2316:Fatal error: cannot initialize GPnP, CLSGPNP_ERR (Generic GPnP error).

     日志里面错误信息也并不多，折腾一下午同事一直觉得是ASM磁盘的问题，晚饭后不知道细看一遍想分析下root脚本内容。我觉得不像，因为如果是那么最初的升级前的安装也该装不上得。最后profile中的原来的oracle home 变量修改成新的，安装前并没友执行unset，居然过了，想了下，root脚本中应该此时调用了oracle home这个变量，而此时取得是系统的home值而不是前面安装时候输入的新home值。所以导致下面的问题，但是表面报错却看不出任何这样的信息。
     总结下，操作准备文档很重要，之前如果unset了之前的home等变量后面也不会出现这个问题。
后面的安装还因为一个系统变量值为默认值小于oracle安装要求而产生了一些报错，修改后都已经没问题。
      综上所述，准备很重要，应准备细致的操作文档。