客户Rac环境由第三方公司安装，安装完了后一直也没注意，今天才发现，节点1压根就没在集群内
[grid@db2 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE db2
ora....ER.lsnr ora....er.type ONLINE ONLINE db2
ora....N1.lsnr ora....er.type ONLINE OFFLINE
ora...._CRS.dg ora....up.type ONLINE ONLINE db2
ora.asm ora.asm.type ONLINE ONLINE db2
ora.crjdb.db ora....se.type ONLINE ONLINE db2
ora.cvu ora.cvu.type ONLINE ONLINE db2
ora.db.db ora....se.type ONLINE ONLINE db2
ora.db1.vip ora....t1.type ONLINE OFFLINE
ora....SM2.asm application ONLINE ONLINE db2
ora....B2.lsnr application ONLINE ONLINE db2
ora.db2.gsd application OFFLINE OFFLINE
ora.db2.ons application ONLINE ONLINE db2
ora.db2.vip ora....t1.type ONLINE ONLINE db2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE db2
ora.oc4j ora.oc4j.type ONLINE ONLINE db2
ora.ons ora.ons.type ONLINE ONLINE db2
ora.scan1.vip ora....ip.type ONLINE OFFLINE
由此看来db1根本就没在集群内
因此去db1查看状态，发现crs确实未启动
[grid@db2 ~]$ crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
启动crs，发现启动失败
[grid@db2 ~]$ crsctl start crs
CRS-4563: Insufficient user privileges.
CRS-4000: Command Start failed, or completed with errors.
[grid@db2 ~]$ crsctl check css
CRS-4639: Could not contact Oracle High Availability Services
CRS-4000: Command Check failed, or completed with errors.
后来查看日志发现对log下面db2没有权限，此时才发现了问题，节点1的hostname竟然和节点二一样
[grid@db2 ~]$ hostname
db2
更改hostname后，crs一样启动不来
后来网上查询尝试重新配置crs,使用root权限
[root@db1 ~]# cd /home/u01/grid/11.2.0/crs/install/
[root@db1 install]# ./roothas.pl -deconfig -force -verbose
Using configuration parameter file: ./crsconfig_params
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Stop failed, or completed with errors.
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Delete failed, or completed with errors.
CRS-4133: Oracle High Availability Services has been stopped.
Successfully deconfigured Oracle Restart stack
执行root.sh
[root@db1 ~]# cd /home/u01/grid/11.2.0/
[root@db1 11.2.0]# ./root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /home/u01/grid/11.2.0
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /home/u01/grid/11.2.0/crs/install/crsconfig_params
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
Adding Clusterware entries to upstart
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node db2, number 2, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
PRKO-2190 : VIP exists for node db1, VIP name db1-vip
Configure Oracle Grid Infrastructure for a Cluster ... succeeded
此时查看crs状态
[root@db1 11.2.0]# su - grid
[grid@db1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE db1
ora....ER.lsnr ora....er.type ONLINE ONLINE db1
ora....N1.lsnr ora....er.type ONLINE ONLINE db1
ora...._CRS.dg ora....up.type ONLINE ONLINE db1
ora.asm ora.asm.type ONLINE ONLINE db1
ora.crjdb.db ora....se.type ONLINE ONLINE db1
ora.cvu ora.cvu.type ONLINE ONLINE db2
ora.db.db ora....se.type ONLINE ONLINE db1
ora....SM1.asm application ONLINE ONLINE db1
ora....B1.lsnr application ONLINE ONLINE db1
ora.db1.gsd application OFFLINE OFFLINE
ora.db1.ons application ONLINE ONLINE db1
ora.db1.vip ora....t1.type ONLINE ONLINE db1
ora....SM2.asm application ONLINE ONLINE db2
ora....B2.lsnr application ONLINE ONLINE db2
ora.db2.gsd application OFFLINE OFFLINE
ora.db2.ons application ONLINE ONLINE db2
ora.db2.vip ora....t1.type ONLINE ONLINE db2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE db1
ora.oc4j ora.oc4j.type ONLINE ONLINE db2
ora.ons ora.ons.type ONLINE ONLINE db1
ora.scan1.vip ora....ip.type ONLINE ONLINE db1
搞定