数据库集群资源状态不正常,数据库sqlplus可正常启动,
但是集群资源ora.db_name.db 状态是offline,
且客户端无法通过scanip连接数据库
[root@dbn02 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.ARCH.dg ora....up.type 0/5 0/ ONLINE OFFLINE
ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE dbn01
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE dbn02
ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE dbn01
ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn.db ora....se.type 0/2 0/1 ONLINE OFFLINE
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE dbn01
ora....01.lsnr application 0/5 0/0 ONLINE ONLINE dbn01
ora.dbn01.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn01.ons application 0/3 0/0 ONLINE ONLINE dbn01
ora.dbn01.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn01
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE dbn02
ora....02.lsnr application 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn02.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn02.ons application 0/3 0/0 ONLINE ONLINE dbn02
ora.dbn02.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn02
ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE dbn01
ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE dbn02
ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE dbn01
ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE dbn01
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE dbn02
之前已经在数据库级别把ARCH磁盘组删除了,但是集群资源里还在,并且无法online db资源,报以下错误
[root@dbn02 bin]# ./srvctl start instance -d dbn -i dbn1
PRCR-1013 : Failed to start resource ora.dbn.db
PRCR-1064 : Failed to start resource ora.dbn.db on node dbn01
CRS-5017: The resource action "ora.ARCH.dg start" encountered the following error:
ORA-15032: not all alterations performed
ORA-15017: diskgroup "ARCH" cannot be mounted
ORA-15063: ASM discovered an insufficient number of disks for diskgroup "ARCH"
. For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/dbn01/agent/crsd/oraag".
CRS-2674: Start of 'ora.ARCH.dg' on 'dbn01' failed
删除已经不存在的ARCH资源,报错
[root@dbn02 bin]# ./crsctl delete resource ora.ARCH.dg
CRS-2730: Resource 'ora.dbn.db' depends on resource 'ora.ARCH.dg'
CRS-4000: Command Delete failed, or completed with errors.
查看集群数据库配置,发现DISK GROUPS 里仍然为 DATA和ARCH
[root@dbn02 bin]# ./srvctl config database -d dbn
Database unique name: dbn
Database name: dbn
Oracle home: /u01/app/oracle/product/11.2.0/db_1
Oracle user: oracle
Spfile: +DATA/dbn/spfiledbn.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: dbn
Database instances: dbn1,dbn2
Disk Groups: DATA,ARCH
Mount point paths:
Services:
Type: RAC
Database is administrator managed
修改集群数据库资源配置
[root@dbn02 bin]# ./srvctl modify database -d dbn -a 'DATA'
查看配置,diskgroup 已经只剩余DATA磁盘组了
[root@dbn02 bin]# ./srvctl config database -d dbn
Database unique name: dbn
Database name: dbn
Oracle home: /u01/app/oracle/product/11.2.0/db_1
Oracle user: oracle
Spfile: +DATA/dbn/spfiledbn.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: dbn
Database instances: dbn1,dbn2
Disk Groups: DATA
Mount point paths:
Services:
Type: RAC
Database is administrator managed
重新执行删除命令,删除ARCH资源
[root@dbn02 bin]# ./crsctl delete resource ora.ARCH.dg
资源已经删除
[root@dbn02 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE dbn01
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE dbn02
ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE dbn01
ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn.db ora....se.type 0/2 0/1 ONLINE OFFLINE
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE dbn01
ora....01.lsnr application 0/5 0/0 ONLINE ONLINE dbn01
ora.dbn01.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn01.ons application 0/3 0/0 ONLINE ONLINE dbn01
ora.dbn01.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn01
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE dbn02
ora....02.lsnr application 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn02.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn02.ons application 0/3 0/0 ONLINE ONLINE dbn02
ora.dbn02.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn02
ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE dbn01
ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE dbn02
ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE dbn01
ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE dbn01
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE dbn02
启动db资源
[root@dbn02 bin]# ./srvctl start instance -d dbn -i dbn1
状态检查,恢复正常
[root@dbn02 bin]# ./crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.DATA.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE dbn01
ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE dbn02
ora.OCR.dg ora....up.type 0/5 0/ ONLINE ONLINE dbn01
ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE dbn01
ora.cvu ora.cvu.type 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn.db ora....se.type 0/2 0/1 ONLINE ONLINE dbn01
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE dbn01
ora....01.lsnr application 0/5 0/0 ONLINE ONLINE dbn01
ora.dbn01.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn01.ons application 0/3 0/0 ONLINE ONLINE dbn01
ora.dbn01.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn01
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE dbn02
ora....02.lsnr application 0/5 0/0 ONLINE ONLINE dbn02
ora.dbn02.gsd application 0/5 0/0 OFFLINE OFFLINE
ora.dbn02.ons application 0/3 0/0 ONLINE ONLINE dbn02
ora.dbn02.vip ora....t1.type 0/0 0/0 ONLINE ONLINE dbn02
ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINE
ora....network ora....rk.type 0/5 0/ ONLINE ONLINE dbn01
ora.oc4j ora.oc4j.type 0/1 0/2 ONLINE ONLINE dbn02
ora.ons ora.ons.type 0/3 0/ ONLINE ONLINE dbn01
ora....ry.acfs ora....fs.type 0/5 0/ ONLINE ONLINE dbn01
ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE dbn02