环境：RHEL5.8 RAC 11.2.0.3.0

1：查看ORC和voting disk信息：

In 11g Release 2 your voting disk data is automatically backed up in the OCR whenever there is a configuration change.

所以恢复时恢复备份OCR即可，这里和10g是不同的，不需要备份voting disk，备份OCR即可

2：使用cluvfy 工具检查OCR完整性

[grid@rac1 ~]$ cluvfy comp ocr -n all

Verifying OCR integrity

Checking OCR integrity...

Checking the absence of a non-clustered configuration...

All nodes free of non-clustered, local-only configurations

ASM Running check passed. ASM is running on all specified nodes

Checking OCR config file "/etc/oracle/ocr.loc"...

OCR config file "/etc/oracle/ocr.loc" check successful

Disk group for ocr location "+CRSDATA" available on all the nodes

NOTE:

This check does not verify the integrity of the OCR contents. Execute 'ocrcheck' as a privileged user to verify the contents of OCR.

OCR integrity check passed

Verification of OCR integrity was successful.

3：使用ocrcheck检测OCR内容的完整性

[grid@rac1 ~]$ ocrcheck

Status of Oracle Cluster Registry is as follows :

Version : 3

Total space (kbytes) : 262120

Used space (kbytes) : 3016

Available space (kbytes) : 259104

ID : 1236405787

Device/File Name : +CRSDATA

Device/File integrity check succeeded

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check bypassed due to non-privileged user --如果使用root用户执行ocrcheck时，会显示Logical corruption check succeeded

4：检测voting disk的信息

[grid@rac1 ~]$ crsctl query css votedisk

## STATE File Universal Id File Name Disk group

-- ----- ----------------- --------- ---------

1. ONLINE 2b1bd0c122584f5abf72033b2b2d26bd (/dev/asm-b_crs) [CRSDATA]

2. ONLINE 2bc03776cdd94f5cbfb9165c473fdb0e (/dev/asm-c_crs) [CRSDATA]

3. ONLINE 3b43c39513a64f2dbf7083a9510ada89 (/dev/asm-d_crs) [CRSDATA]

Located 3 voting disk(s).

从上面看出，OCR和voting disk都位于+CRSDATA磁盘组，注意+CRSDATA磁盘组还有ASM的启动参数文件，ASM启动是根据磁盘头的kfdhdb.spfile指向ASM上的此磁盘的UA NUMBER从而读取spfile文件

5：手动备份一份OCR信息：

[root@rac1 grid]# ocrconfig -export /tmp/ocr_20130717.dmp

[root@rac1 grid]# ll /tmp/ocr_20130717.dmp -h

-rw------- 1 root root 102K Jul 17 14:45 /tmp/ocr_20130717.dmp

ocrconfig -manualbakcup /u01/app/11.2.0.3/grid/cdata/ad-cluster/ocr20160315.ocr

6：查看OCR自动备份信息

[grid@rac1 ~]$ ocrconfig -showbackup

rac1 2013/07/16 15:45:24 /u01/app/11.2.0.3/grid/cdata/ad-cluster/backup00.ocr

rac2 2013/07/16 08:13:38 /u01/app/11.2.0.3/grid/cdata/ad-cluster/backup01.ocr

rac2 2013/07/16 04:14:09 /u01/app/11.2.0.3/grid/cdata/ad-cluster/backup02.ocr

rac2 2013/07/16 00:14:38 /u01/app/11.2.0.3/grid/cdata/ad-cluster/day.ocr

rac2 2013/07/07 04:40:11 /u01/app/11.2.0.3/grid/cdata/ad-cluster/week.ocr

PROT-25: Manual backups for the Oracle Cluster Registry are not available

7：保存一份ASM参数文件，如果提前没保存，可以到$CRS_HOME/dbs/init.ora获取一份，后面此启动参数的详细内容

[grid@rac1 dbs]$ sqlplus / as sysasm

SQL> create pfile='/tmp/asm_pfile_130717.txt' from spfile;

File created.

8：破坏保存OCR信息的磁盘组+CRSDATA

[root@rac1 dev]# dd if=/dev/zero of=/dev/asm-b_crs bs=1024 count=1000

[root@rac1 dev]# dd if=/dev/zero of=/dev/asm-c_crs bs=1024 count=1000

11：强制关闭CRS:

[root@rac1 dev]# crsctl stop crs -f

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

[root@rac1 dev]# crsctl stop crs -f

CRS-2797: Shutdown is already in progress for 'rac1', waiting for it to complete

CRS-4133: Oracle High Availability Services has been stopped.

12：以独占模式启动rac1

[root@rac1 dev]# crsctl start crs -excl -nocrs

CRS-4123: Oracle High Availability Services has been started.

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac1'

CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'rac1'

CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'

CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'

CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

CRS-2676: Start of 'ora.drivers.acfs' on 'rac1' succeeded

CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

12：创建CRSVOTEDISK磁盘组以及spfile

[grid@rac1 ~]$ asmcmd

ASMCMD> ls

空的

[grid@rac1 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.3.0 Production on Wed Jul 17 16:58:18 2013

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL>shutdown abort

SQL>startup pfile='/tmp/asm_pfile_130717.txt';

SQL> create diskgroup GRIDDG external redundancy disk '/dev/raw/raw1'attribute 'compatible.asm'='11.2.0.0.0', 'compatible.rdbms'='11.2.0.0.0';

Diskgroup created.

SQL> create spfile='+GRIDDG' from pfile='/tmp/asm_pfile_130717.txt';

File created.

SQL> quit

Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

[grid@rac1 ~]$ asmcmd

ASMCMD> ls

GRIDDG/

ASMCMD> ls GRIDDG

ad-cluster/

ASMCMD> ls GRIDDG/ad-cluster/

ASMPARAMETERFILE/

ASMCMD> ls GRIDDG/ad-cluster/ASMPARAMETERFILE

REGISTRY.253.821034567

13：Restore OCR from backup:

[root@rac1 dev]# ocrconfig -restore /u01/app/11.2.0.3/grid/cdata/ad-cluster/backup00.ocr

ocrconfig -import /tmp/ocr_20130717.dmp

可以看到增加了一个OCRFILE文件夹

ASMCMD> ls CRSVOTEDISK/ad-cluster

ASMPARAMETERFILE/

OCRFILE/

ASMCMD> ls CRSVOTEDISK/ad-cluster/OCRFILE -l

Type Redund Striped Time Sys Name

OCRFILE MIRROR COARSE JUL 17 17:00:00 Y REGISTRY.255.821036449

ASMCMD> ls CRSVOTEDISK/ad-cluster/ASMPARAMETERFILE -l

Type Redund Striped Time Sys Name

ASMPARAMETERFILE MIRROR COARSE JUL 17 17:00:00 Y REGISTRY.253.821034567

检测成功

[root@rac1 dev]# ocrcheck

Status of Oracle Cluster Registry is as follows :

Version : 3

Total space (kbytes) : 262120

Used space (kbytes) : 3016

Available space (kbytes) : 259104

ID : 1236405787

Device/File Name : +CRSVOTEDISK

Device/File integrity check succeeded

Device/File not configured

Cluster registry integrity check succeeded

14：Restore the Voting Disk:

[root@rac1 dev]# crsctl query css votedisk

## STATE File Universal Id File Name Disk group

-- ----- ----------------- --------- ---------

1. OFFLINE 2b1bd0c122584f5abf72033b2b2d26bd () []

2. OFFLINE 2bc03776cdd94f5cbfb9165c473fdb0e () []

3. ONLINE 3b43c39513a64f2dbf7083a9510ada89 (/dev/asm-d_crs) [CRSDATA]

Located 3 voting disk(s).

[root@rac1 dev]# crsctl replace votedisk +GRIDDG

CRS-4602: Failed 27 to add voting file 5818c2c531394f45bff13c5a7532c8d4.

CRS-4602: Failed 27 to add voting file 1ce0436528624faabf7d4a1dd8dc978a.

CRS-4602: Failed 27 to add voting file 09def2b244af4f42bf13679a8aa0ff73.

Failure 27 with Cluster Synchronization Services while deleting voting disk.

Failed to replace voting disk group with +CRSVOTEDISK.

CRS-4000: Command Replace failed, or completed with errors.

停止crs以正常方式启动：

[root@rac1 ~]# crsctl stop crs

[root@rac1 ~]# crsctl start crs

此时，crs和voting disk已经完成恢复，但要注意修改rac2上的/etc/oracle/ocr.loc里面的ocrconfig_loc=+CRSVOTEDISK ，不然启动报错：

[/u01/app/11.2.0.3/grid/bin/oraagent.bin(19510)]CRS-5019:All OCR locations are on ASM disk groups [CRSDATA], and none of these disk groups are mounted. Details are at "(:CLSN00100:)" in "/u01/app/11.2.0.3/grid/log/rac1/agent/ohasd/oraagent_grid/oraagent_grid.log".

2013-07-18 00:10:33.678

2013-07-18 00:11:03.614

[root@rac2 ~]# crsctl start crs

[root@rac1 ~]# crs_stat -t

Name Type Target State Host

------------------------------------------------------------

ora.CRSDATA.dg ora....up.type ONLINE OFFLINE

ora.DATA.dg ora....up.type ONLINE ONLINE rac1

ora....ER.lsnr ora....er.type ONLINE ONLINE rac1

ora....N1.lsnr ora....er.type ONLINE ONLINE rac1

ora.asm ora.asm.type ONLINE ONLINE rac1

ora.chris.db ora....se.type ONLINE ONLINE rac1

ora.cvu ora.cvu.type ONLINE ONLINE rac1

ora.gsd ora.gsd.type OFFLINE OFFLINE

ora....network ora....rk.type ONLINE ONLINE rac1

ora.oc4j ora.oc4j.type ONLINE ONLINE rac1

ora.ons ora.ons.type ONLINE ONLINE rac1

ora....SM1.asm application ONLINE ONLINE rac1

ora....C1.lsnr application ONLINE ONLINE rac1

ora.rac1.gsd application OFFLINE OFFLINE

ora.rac1.ons application ONLINE ONLINE rac1

ora.rac1.vip ora....t1.type ONLINE ONLINE rac1

ora....SM2.asm application ONLINE ONLINE rac2

ora....C2.lsnr application ONLINE ONLINE rac2

ora.rac2.gsd application OFFLINE OFFLINE

ora.rac2.ons application ONLINE ONLINE rac2

ora.rac2.vip ora....t1.type ONLINE ONLINE rac2

ora....ry.acfs ora....fs.type ONLINE ONLINE rac1

ora.scan1.vip ora....ip.type ONLINE ONLINE rac1

来源：

环境：RHEL5.8 RAC 11.2.0.3.0

你可能感兴趣的:(环境：RHEL5.8 RAC 11.2.0.3.0)