11g ASM 重启 HAC 报错 CRS-4124: Oracle High Availability Services startup failed.CRS-4000

1、故障描述

[grid@szcssjk01 ~]$ crsctl stop has  
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'szcssjk01'
CRS-2673: Attempting to stop 'ora.PMS_CS.lsnr' on 'szcssjk01'
CRS-2673: Attempting to stop 'ora.DG_DATA01.dg' on 'szcssjk01'
CRS-2677: Stop of 'ora.PMS_CS.lsnr' on 'szcssjk01' succeeded
CRS-2677: Stop of 'ora.DG_DATA01.dg' on 'szcssjk01' succeeded
CRS-2679: Attempting to clean 'ora.DG_DATA01.dg' on 'szcssjk01'
CRS-2681: Clean of 'ora.DG_DATA01.dg' on 'szcssjk01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'szcssjk01'
CRS-2677: Stop of 'ora.asm' on 'szcssjk01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'szcssjk01'
CRS-2677: Stop of 'ora.cssd' on 'szcssjk01' succeeded
CRS-2673: Attempting to stop 'ora.evmd' on 'szcssjk01'
CRS-2677: Stop of 'ora.evmd' on 'szcssjk01' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'szcssjk01' has completed
CRS-4133: Oracle High Availability Services has been stopped.

[grid@szcssjk01 ~]$ crsctl start has 
CRS-4124: Oracle High Availability Services startup failed.
CRS-4000: Command Start failed, or completed with errors.

2、故障分析

11.2.0.1的建GI跑脚本的时也遇到了，应该说是11.2.0.1的一个典型的bug

再运行一次

[grid@szcssjk01 ~]$ crsctl start has 

同时另开一个窗口，执行语句，直到窗口卡住

[grid@szcssjk01 ~]$ /bin/dd if=/var/tmp/.oracle/npohasd of=/dev/null bs=1024 count=1

3、故障解决

[grid@szcssjk01 ~]$ crsctl start has
CRS-4123: Oracle High Availability Services has been started.