ORA-00600 [kfioTranslateIO03] ORA-00600 [17090]

今天在启一个rac one node的数据库时，一个节点可以正常，另外一个节点都mount不了，报错信息如下：

alter database mount
Tue Nov 04 18:55:24 2014
Errors in file /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/trace/r0tdw_rbal_6963.trc:
ORA-15183: ASMLIB initialization error [driver/agent not installed]
WARNING: FAILED to load library: /opt/oracle/extapi/64/asm/orcl/1/libasm.so 
Errors in file /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/trace/r0tdw_rbal_6963.trc:
ORA-15183: ASMLIB initialization error [driver/agent not installed]
Tue Nov 04 18:55:24 2014
SUCCESS: diskgroup DATA_R0TDW_MDG was mounted
Tue Nov 04 18:55:24 2014
ERROR: failed to establish dependency between database r0tdw and diskgroup resource ora.DATA_R0TDW_MDG.dg
Errors in file /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/trace/r0tdw_ckpt_6954.trc  (incident=9769):
ORA-00600: internal error code, arguments: [kfioTranslateIO03], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/incident/incdir_9769/r0tdw_ckpt_6954_i9769.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
Tue Nov 04 18:55:26 2014
Dumping diagnostic data in directory=[cdmp_20141104185526], requested by (instance=1, osid=6954 (CKPT)), summary=[incident=9769].
Errors in file /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/trace/r0tdw_ckpt_6954.trc  (incident=9770):
ORA-00600: internal error code, arguments: [17090], [], [], [], [], [], [], [], [], [], [], []
Incident details in: /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/incident/incdir_9770/r0tdw_ckpt_6954_i9770.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
ERROR: unrecoverable error ORA-600 raised in ASM I/O path; terminating process 6954 
Dumping diagnostic data in directory=[cdmp_20141104185528], requested by (instance=1, osid=6954 (CKPT)), summary=[incident=9770].
System state dump requested by (instance=1, osid=5897 (PMON)), summary=[abnormal instance termination].
System State dumped to trace file /paic/stg/oracle/11g/app/oracle/diag/rdbms/r0tdw/r0tdw/trace/r0tdw_diag_6851.trc
Tue Nov 04 18:55:32 2014
PMON (ospid: 5897): terminating the instance due to error 469
Dumping diagnostic data in directory=[cdmp_20141104185532], requested by (instance=1, osid=5897 (PMON)), summary=[abnormal instance termination].
Instance terminated by PMON, pid = 5897

看错误是在ckpt的时候报错，这个是写磁盘的操作，在这一步报错，要么是磁盘问题，要么是权限问题。但是在另外一个结掉可以起库，说明不是节点问题。那应该就权限的问题了。

metlink上找了下，发现是个bug，文档号ID 1336846.1

cnsh281059:r0tdw >ls -l $ORACLE_HOME/bin/oracle

-rwsr-s--x 1 otzj11g asmadmin232748523 Oct 30 18:05/paic/stg/oracle/11g/app/oracle/product/11.2.0.3.9/bin/oracle

 

cnsh281060:r0tdw >ls -l $ORACLE_HOME/bin/oracle

-rwsr-s--x 1 otzj11g oinstall232748523 Oct 30 17:59/paic/stg/oracle/11g/app/oracle/product/11.2.0.3.9/bin/oracle

修改一下权限即可，但是用root修改了没有起作用，所以只能用oracle给的方法。修改后即可！

[grid@cnsh281060 bin]$ cd $ORACLE_HOME/bin

[grid@cnsh281060 bin]$ ./setasmgidwrap o=/paic/stg/oracle/11g/app/oracle/product/11.2.0.3.9/bin/oracle

[grid@cnsh281060 bin]$ ls -l /paic/stg/oracle/11g/app/oracle/product/11.2.0.3.9/bin/oracle
-rwxr-s--x 1 otzj11g asmadmin 232748523 Oct 30 17:59 /paic/stg/oracle/11g/app/oracle/product/11.2.0.3.9/bin/oracle