一次oracle 10g rac故障处理
一次oracle 10g rac故障处理:
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE UNKNOWN rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE UNKNOWN rhel4-2
ora....-2.lsnr application ONLINE UNKNOWN rhel4-2
ora....4-2.gsd application ONLINE UNKNOWN rhel4-2
ora....4-2.ons application ONLINE UNKNOWN rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2
故障处理步骤：
resource按以下步骤启动：
VIP-->ONS-->INST-->LSNR-->GSD
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE UNKNOWN rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE UNKNOWN rhel4-2
ora....-2.lsnr application ONLINE UNKNOWN rhel4-2
ora....4-2.gsd application ONLINE UNKNOWN rhel4-2
ora....4-2.ons application ONLINE UNKNOWN rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2
rhel4-2->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 05:47:05 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+DG1/demo/spfiledemo.ora'
ORA-17503: ksfdopn:2 Failed to open file +DG1/demo/spfiledemo.ora
ORA-15077: could not locate ASM instance serving a required diskgroup
SQL> exit
Disconnected
rhel4-2->cd $ORACLE_HOME
rhel4-2->ls
assistants crs has jdbc log oc4j oraInst.loc precomp root.sh srvm
bin css hs jdk md odbc ord racg root.sh.old sysman
cdata ctx install jlib mesg olap oui rdbms slax uix
cfgtoollogs dbs install.platform jre mgw OPatch owm relnotes sqlj wwg
clone demo inventory ldap network opmn perl rhel4-1_demo1 sqlnet.log xdk
config diagnostics javavm lib nls oracore plsql rhel4-2_demo2 sqlplus
rhel4-2->cd dbs
rhel4-2->ls
ab_+ASM2.dat hc_+ASM2.dat hc_demo2.dat init+ASM2.ora initdemo2.ora initdw.ora init.ora orapw+ASM2 orapwdemo2
rhel4-2->export ORACLE_SID=+ASM2
rhel4-2->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 05:47:51 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ASM instance started
Total System Global Area 92274688 bytes
Fixed Size 1217884 bytes
Variable Size 65890980 bytes
ASM Cache 25165824 bytes
ASM diskgroups mounted
SQL>
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE UNKNOWN rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE UNKNOWN rhel4-2
ora....-2.lsnr application ONLINE UNKNOWN rhel4-2
ora....4-2.gsd application ONLINE UNKNOWN rhel4-2
ora....4-2.ons application ONLINE ONLINE rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2
rhel4-2->echo $ORACLE_SID
+ASM2
rhel4-2->cat ~/.bash_profile |grep SID
export ORACLE_SID=demo1 （这里配置错误！！！）
rhel4-2->export ORACLE_SID=demo1（这里错误！！！）
rhel4-2->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 05:49:15 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
LRM-00109: could not open parameter file '/u01/app/oracle/product/10.2.0/db_1/dbs/initdemo1.ora'
SQL> exit
Disconnected
rhel4-2->cd $ORACLE_HOME
rhel4-2->cd dbs
rhel4-2->ls
ab_+ASM2.dat hc_+ASM2.dat hc_demo2.dat init+ASM2.ora initdemo2.ora initdw.ora init.ora orapw+ASM2 orapwdemo2
rhel4-2->echo $ORACLE_SID
demo1
rhel4-2->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 05:49:38 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
LRM-00109: could not open parameter file '/u01/app/oracle/product/10.2.0/db_1/dbs/initdemo1.ora'
SQL> exit
Disconnected
rhel4-2->
rhel4-1->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 06:54:21 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected.
SQL> show parameter spfile
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
spfile string +DG1/demo/spfiledemo.ora
SQL>
RAC spfile 共享！！！
rhel4-2->vi ./.bash_profile
rhel4-2->source ./.bash_profile
rhel4-2->echo
rhel4-2->echo $ORACLE_SID
demo2
rhel4-2->sqlplus /nolog
SQL*Plus: Release 10.2.0.1.0 - Production on Thu Apr 1 05:50:56 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL> conn / as sysdba
Connected to an idle instance.
SQL> startup
ORACLE instance started.
Total System Global Area 184549376 bytes
Fixed Size 1218388 bytes
Variable Size 100665516 bytes
Database Buffers 75497472 bytes
Redo Buffers 7168000 bytes
Database mounted.
Database opened.
SQL>
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE ONLINE rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE ONLINE rhel4-2
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE ONLINE rhel4-2
ora....-2.lsnr application ONLINE UNKNOWN rhel4-2
ora....4-2.gsd application ONLINE UNKNOWN rhel4-2
ora....4-2.ons application ONLINE ONLINE rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2
rhel4-1->
rhel4-2->crs_start ora.rhel4-2.gsd
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rhel4-2.gsd'
CRS-0223: Resource 'ora.rhel4-2.gsd' has placement error.
rhel4-2->crs_stop ora.rhel4-2.gsd
Attempting to stop `ora.rhel4-2.gsd` on member `rhel4-2`
Stop of `ora.rhel4-2.gsd` on member `rhel4-2` succeeded.
rhel4-2->crs_start ora.rhel4-2.gsd
Attempting to start `ora.rhel4-2.gsd` on member `rhel4-2`
Start of `ora.rhel4-2.gsd` on member `rhel4-2` succeeded.
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE ONLINE rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE ONLINE rhel4-2
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE ONLINE rhel4-2
ora....-2.lsnr application ONLINE UNKNOWN rhel4-2
ora....4-2.gsd application ONLINE ONLINE rhel4-2
ora....4-2.ons application ONLINE ONLINE rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2
rhel4-2->crs_stop ora.rhel4-2.LISTENER_RHEL4-2.lsnr
Attempting to stop `ora.rhel4-2.LISTENER_RHEL4-2.lsnr` on member `rhel4-2`
Stop of `ora.rhel4-2.LISTENER_RHEL4-2.lsnr` on member `rhel4-2` succeeded.
rhel4-2->crs_start ora.rhel4-2.LISTENER_RHEL4-2.lsnr
Attempting to start `ora.rhel4-2.LISTENER_RHEL4-2.lsnr` on member `rhel4-2`
Start of `ora.rhel4-2.LISTENER_RHEL4-2.lsnr` on member `rhel4-2` succeeded.
rhel4-2->
rhel4-1->crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.demo.db application ONLINE ONLINE rhel4-2
ora....o1.inst application ONLINE ONLINE rhel4-1
ora....o2.inst application ONLINE ONLINE rhel4-2
ora....SM1.asm application ONLINE ONLINE rhel4-1
ora....-1.lsnr application ONLINE ONLINE rhel4-1
ora....4-1.gsd application ONLINE ONLINE rhel4-1
ora....4-1.ons application ONLINE ONLINE rhel4-1
ora....4-1.vip application ONLINE ONLINE rhel4-1
ora....SM2.asm application ONLINE ONLINE rhel4-2
ora....-2.lsnr application ONLINE ONLINE rhel4-2
ora....4-2.gsd application ONLINE ONLINE rhel4-2
ora....4-2.ons application ONLINE ONLINE rhel4-2
ora....4-2.vip application ONLINE ONLINE rhel4-2