Oracle+11g+RAC+PSU_EAM（1）

 概述和说明

1.1 概述

本文档用于记录在redhat 6.5 X86_64位系统上安装配置Oracle 11gR2(11.2.0.4.0) EBSRAC+PSU

的详细步骤。安装配置两台redhat6.5 X86_64位Linux系统的机器，然后在这两台Linux机器

上配置Oracle 11gR2 EBSRAC系统。其中，操作系统选择Oracle公司的redhat 6.5 X86_64位Linux

系统，数据库软件采用目前Oracle 11gR2最新版本的11.2.0.4.0。

1.2 软件获取

操作系统：  Redhat  Enterprise Linux 6

Oracle软件：Oracle 11g Release 2 (11.2) Software (64 bit)

PSU : p22646198_112040_Linux-x86-64

其中，Oracle软件可以通过上述连接直接获取版本为11.2.0.1.0的安装介质，或者通过MetaLink官方网站获取最新版本的11.2.0.4.0安装介质，其中patch编号为13390677

2 安装前准备工作

2.1 资源规划

IP地址均选择手动配置，而不是DHCP动态分配，且要求指定的IP在网络里是唯一的。主机名也分别要求指定为唯一，避免冲突。主机名、IP地址在前期规划要慎重，一经指定，最好不要轻易改变，避免一些不必要的麻烦。这里列出两台机器前期规划的主机名、IP地址信息：

更改主机名：hostnamectl set-hostname ebsrac1

Hostname	Short Hostname	Type	IP Address	Interface
ebsrac1	ebsrac1	Public IP	192.168.1.33	eno16777736
ebsrac1-vip	ebsrac1-vip	Virtual IP	192.168.1.133	eno16777736:1
ebsrac1-priv	ebsrac1-priv	Private IP	192.168.86.13	ens34
ebsrac2	ebsrac2	Public IP	192.168.1.44	eth0
ebsrac2-vip	ebsrac2-vip	Virtual IP	192.168.1.144	eth0:1
ebsrac2-priv	ebsrac2-priv	Private IP	192.168.86.44	eth1
scan-cluster	scan-cluster	SCAN IP	192.168.1.55	eth0
			192.168.1.56 192.168.1.157

(2.1网络配置信息表)

其中，EBSRAC每台机器至少需要配置3个IP地址，在安装操作系统的过程中，我们需要配置公网IP和私有IP即可，虚拟IP在安装集群件时分配。Public IP、Virtual IP、SCAN IP必须配置在同一网段。SCAN IP是Oracle 11g新推出的，在配置11g EBSRAC时需要指定。由于现场条件的限制，我们的SCAN IP通过/etc/hosts来解析来实现。

2.2 配置 /etc/hosts文件

参照Figure 2.1网络配置信息表，修改节点1的/etc/hosts配置文件。

2.4 建用户、改口令、修改用户配置文件

配置12CR1 ORCLE RAC需要安装Oracle Grid Infrastructure软件、Oracle数据库软件，其中Grid软件等同于Oracle 10g的Clusterware集群件。Oracle建议以不同的用户分别安装Grid Infrastructure软件、Oracle数据库软件，我们这里以grid用户安装Grid Infrastructure，oracle用户安装Oracle数据库软件。并且grid、oracle用户需要属于不同的用户组。在配置RAC时，还要求这两个用户在RAC的不同节点上uid、gid要一致。用户、组的对应信息见下表：

Group Name	Group ID	Group Info	Oracle User(1100)	Grid User(1101)
oinstall	1000	Inventory Group	Y	Y
dba	1300	OSDBA Group	Y
oper	1301	OSOPER Group	Y
asmadmin	1200	OSASM		Y
asmoper	1202	OSOPER for ASM		Y
asmdba	1201	OSDBA for ASM	Y	Y

(Figure 2.4用户、组配置信息表)

我们可以通过执行下述shell脚本的1_preusers.sh来完成用户、组的创建，脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# ./1_perusers.sh

Now create 4 groups named 'oinstall','dba','asmadmin','asmdba'

Plus 2 users named 'oracle','grid',Also setting the Environment

Creating mailbox file: File exists

Changing password for user grid.

passwd: all authentication tokens updated successfully.

Creating mailbox file: File exists

Changing password for user oracle.

passwd: all authentication tokens updated successfully.

The Groups and users has been created

The Environment for grid,oracle also has been set successfully

[root@ebsrac1 scripts]# su - oracle

ebsrac1-> id

uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1201(asmdba),1300(dba)

ebsrac1-> exit

logout

[root@ebsrac1 scripts]# su - grid

ebsrac1-> id

uid=1100(grid) gid=1000(oinstall) groups=1000(oinstall),1200(asmadmin),1201(asmdba)

说明：在节点ebsrac2上执行该脚本时，需要将grid用户环境变量ORACLE_SID修改为+ASM2，oracle用户环境变量ORACLE_SID修改为ebsracdb2

2.5 建路径、改权限

关于grid、oracle用户的环境变量配置信息，见下述表格。

Environment Variable	Grid User	Oracle User
ORACLE_BASE	/u01/app/grid	/u01/app/oracle/product
ORACLE_HOME	/u01/app/11.2.0/grid	/u01/app/oebsracl/product/11.2.0
ORACLE_SID [ebsrac1]	+ASM1	ebsracdb1
ORACLE_SID [ebsrac2]	+ASM2	ebsracdb2

(Figure 2.5环境变量配置信息表)

通过执行脚本2_predir.sh来完成相关路径、权限的配置。脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# ./2_predir.sh

Now create the necessary directory for oracle,grid users and change the authention to oracle,grid users...

The necessary directory for oracle,grid users and change the authention to oracle,grid users has been finished

[root@ebsrac1 scripts]# cd /u01

[root@ebsrac1 u01]# ls -l

total 12

drwxrwxr-x. 4 root root 4096 Dec 29 04:30 app

drwxrwxr-x  2 root root 4096 Dec 29 04:30 scripts

drwxrwxr-x. 4 root root 4096 Dec 17 22:31 soft

[root@ebsrac1 u01]# cd app

[root@ebsrac1 app]# ls -l

total 8

drwxrwxr-x 3 grid   oinstall 4096 Dec 29 04:30 grid

drwxrwxr-x 3 oracle oinstall 4096 Dec 29 04:30 oracle

2.6 修改/etc/security/limits.conf，配置oracle、grid用户的shell限制

  通过执行脚本3_prelimits.sh完成。脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# ./3_prelimit.sh

Now modify the /etc/security/limits.conf,but backup it named /etc/security/limits.conf.bak before

Modifing the /etc/security/limits.conf has been succeed.

[root@ebsrac1 scripts]#

2.7 修改/etc/pam.d/login配置文件

   通过执行脚本4_prelogin.sh完成。脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# ./4_perlogin.sh

Now modify the /etc/pam.d/login,but with a backup named /etc/pam.d/login.bak

Modifing the /etc/pam.d/login has been succeed.

[root@ebsrac1 scripts]#

2.8 修改/etc/profile文件

   通过执行脚本5_preprofile.sh完成。脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# ./5_preprofile.sh

Now modify the  /etc/profile,but with a backup named  /etc/profile.bak

Modifing the /etc/profile has been succeed.

[root@ebsrac1 scripts]#

2.9修改内核配置文件

   通过执行脚本6_presysctl.sh完成。脚本的具体内容可见本文档附录。

[root@ebsrac1 scripts]# modprobe bridge

[root@ebsrac1 scripts]# ./6_persysctl.sh

Now modify the /etc/sysctl.conf,but with a backup named /etc/sysctl.bak

Modifing the /etc/sysctl.conf has been succeed.

Now make the changes take effect.....

net.ipv4.ip_forward = 0

net.ipv4.conf.default.rp_filter = 1

net.ipv4.conf.default.accept_source_route = 0

kernel.sysrq = 0

kernel.core_uses_pid = 1

net.ipv4.tcp_syncookies = 1

net.bridge.bridge-nf-call-ip6tables = 0

net.bridge.bridge-nf-call-iptables = 0

net.bridge.bridge-nf-call-arptables = 0

kernel.msgmnb = 65536

kernel.msgmax = 65536

kernel.shmmax = 68719476736

kernel.shmall = 4294967296

fs.aio-max-nr = 1048576

kernel.shmall = 2097152

kernel.shmmax = 2147483648

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

fs.file-max = 6815744

net.ipv4.ip_local_port_range = 9000 65000

net.core.rmem_default = 1048576

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048576

fs.aio-max-nr = 1048576

fs.file-max = 6815744

kernel.shmall = 2097152

kernel.shmmax = 2147483648

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048586

net.ipv4.tcp_wmem = 262144 262144 262144

net.ipv4.tcp_rmem = 4194304 4194304 4194304

fs.aio-max-nr = 1048576

fs.file-max = 6815744

kernel.shmall = 2097152

kernel.shmmax = 2147483648

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048586

fs.aio-max-nr = 1048576

fs.file-max = 6815744

kernel.shmall = 2097152

kernel.shmmax = 2147483648

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048586

net.ipv4.tcp_wmem = 262144 262144 262144

net.ipv4.tcp_rmem = 4194304 4194304 4194304

2.10 检查软件包的安装情况

[root@dns-server tmp]# ./7_precheck.sh

Now check install rpm package

libaio-devel sysstat unixODBC unixODBC-devel

[root@dns-server tmp]#

2.11 停止ntp服务，11gR2新增的检查项(如果使用NTP，请按照下面步骤配置)

[root@ebsrac1 ~]# service ntpd status

ntpd is stopped

[root@ebsrac1 ~]# chkconfig ntpd off

[root@ebsrac1 ~]# cat /etc/ntp

ntp/      ntp.conf  

[root@ebsrac1 ~]# cp /etc/ntp.conf /etc/ntp.conf.bak

[root@ebsrac1 ~]# rm -rf /etc/ntp.conf

[root@ebsrac1 ~]# 

2.12 节点2准备工作

    我们已经在ebsrac1完成基本准备配置工作，在ebsrac2上重复上述2.2到2.10节中准备工作，以完成节点2的准备工作。

    说明：2.4节中需要修改对应的环境变量。

2.13 配置oracle，grid 用户SSH对等性

   虽然在安装软件的过程中，oracle会自动配置SSH对等性，建议在安装软件之前手工配置。(这一步骤可以不操作)

配置oracle用户对等性：注意$HOME/.ssh目录 或 $HOME目录的权限 最好是700， 注意authorized_keys的权限 chmod 644 authorized_keys 这个也是要注意的 。不然配置后登录还是输入密码。

   ebsrac1:

[root@ebsrac1 ~]# su - oracle

ebsrac1-> env | grep ORA

ORACLE_UNQNAME=ebsracdb

ORACLE_SID=ebsracdb1

ORACLE_BASE=/u01/app/oracle

ORACLE_HOSTNAME=ebsrac1

ORACLE_TERM=xterm

ORACLE_HOME=/u01/app/oracle/product/11.2.0

ebsrac1-> pwd

/home/oracle

ebsrac1-> mkdir ~/.ssh

ebsrac1-> chmod 700 ~/.ssh

ebsrac1-> ls -al

total 44

drwx—— 4 oracle oinstall 4096 Apr 24 10:47 .

drwxr-xr-x 4 root   root     4096 Apr 24 09:41 ..

-rw——- 1 oracle oinstall    5 Apr 24 10:43 .bash_history

-rw-r–r– 1 oracle oinstall   33 Apr 24 09:41 .bash_logout

-rw-r–r– 1 oracle oinstall  823 Apr 24 09:41 .bash_profile

-rw-r–r– 1 oracle oinstall  124 Apr 24 09:41 .bashrc

-rw-r–r– 1 oracle oinstall  515 Apr 24 09:41 .emacs

drwxr-xr-x 4 oracle oinstall 4096 Apr 24 09:41 .mozilla

drwx—— 2 oracle oinstall 4096 Apr 24 10:47 .ssh

-rw-r–r– 1 oracle oinstall  658 Apr 24 09:41 .zshrc

ebsrac1-> ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_rsa): 

Enter passphrase (empty for no passphrase): 

Enter same passphrase again: 

Your identification has been saved in /home/oracle/.ssh/id_rsa.

Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

4a:bd:22:4c:cc:6a:33:ae:5a:de:7d:7c:8b:77:9e:81 oracle@ebsrac1

ebsrac1-> ssh-keygen -t dsa 

Generating public/private dsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_dsa): 

Enter passphrase (empty for no passphrase): 

Enter same passphrase again: 

Your identification has been saved in /home/oracle/.ssh/id_dsa.

Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.

The key fingerprint is:

8b:50:73:41:03:ad:1c:59:25:aa:40:1c:c9:5e:03:99 oracle@ebsrac1

ebsrac1-> 

 

ebsrac2:

[root@ebsrac2 ~]# su - oracle

ebsrac2-> env|grep ORA

ORACLE_UNQNAME=ebsracdb

ORACLE_SID=ebsracdb2

ORACLE_BASE=/u01/app/oracle

ORACLE_HOSTNAME=ebsrac2

ORACLE_TERM=xterm

ORACLE_HOME=/u01/app/oracle/product/11.2.0

ebsrac2-> pwd

/home/oracle

ebsrac2-> ls -al

total 40

drwx—— 3 oracle oinstall 4096 Apr 24 10:45 .

drwxr-xr-x 4 root   root     4096 Apr 24 10:44 ..

-rw——- 1 oracle oinstall   10 Apr 24 10:49 .bash_history

-rw-r–r– 1 oracle oinstall   33 Apr 24 10:44 .bash_logout

-rw-r–r– 1 oracle oinstall  823 Apr 24 10:44 .bash_profile

-rw-r–r– 1 oracle oinstall  124 Apr 24 10:44 .bashrc

-rw-r–r– 1 oracle oinstall  515 Apr 24 10:44 .emacs

drwxr-xr-x 4 oracle oinstall 4096 Apr 24 10:44 .mozilla

-rw-r–r– 1 oracle oinstall  658 Apr 24 10:44 .zshrc

ebsrac2-> mkdir ~/.ssh

ebsrac2-> chmod 700 ~/.ssh/

ebsrac2-> ls -al

total 44

drwx—— 4 oracle oinstall 4096 Apr 24 10:49 .

drwxr-xr-x 4 root   root     4096 Apr 24 10:44 ..

-rw——- 1 oracle oinstall   10 Apr 24 10:49 .bash_history

-rw-r–r– 1 oracle oinstall   33 Apr 24 10:44 .bash_logout

-rw-r–r– 1 oracle oinstall  823 Apr 24 10:44 .bash_profile

-rw-r–r– 1 oracle oinstall  124 Apr 24 10:44 .bashrc

-rw-r–r– 1 oracle oinstall  515 Apr 24 10:44 .emacs

drwxr-xr-x 4 oracle oinstall 4096 Apr 24 10:44 .mozilla

drwxrwx— 2 oracle oinstall 4096 Apr 24 10:49 .ssh

-rw-r–r– 1 oracle oinstall  658 Apr 24 10:44 .zshrc

ebsrac2-> ssh-keygen -t rsa

Generating public/private rsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_rsa): 

Enter passphrase (empty for no passphrase): 

Enter same passphrase again: 

Your identification has been saved in /home/oracle/.ssh/id_rsa.

Your public key has been saved in /home/oracle/.ssh/id_rsa.pub.

The key fingerprint is:

a0:64:81:a6:12:b2:18:4e:01:c3:bd:9d:f6:bb:55:b0 oracle@ebsrac2

ebsrac2-> ssh-keygen -t dsa

Generating public/private dsa key pair.

Enter file in which to save the key (/home/oracle/.ssh/id_dsa): 

Enter passphrase (empty for no passphrase): 

Enter same passphrase again: 

Your identification has been saved in /home/oracle/.ssh/id_dsa.

Your public key has been saved in /home/oracle/.ssh/id_dsa.pub.

The key fingerprint is:

85:56:69:73:74:a3:ef:5b:88:d7:6d:ef:90:03:b6:72 oracle@ebsrac2

ebsrac2-> 

返回节点1：

ebsrac1-> id

uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1201(asmdba),1300(dba),1301(oper)

ebsrac1-> pwd

/home/oracle

ebsrac1-> cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys

ebsrac1-> cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys 

ebsrac1-> ssh ebsrac2 cat ~/.ssh/id_rsa.pub >>~/.ssh/authorized_keys 

The authenticity of host 'ebsrac2 (192.168.1.192)' can't be established.

RSA key fingerprint is a7:6b:2c:2d:fb:c3:ff:33:af:92:cd:7b:99:3b:cf:3a.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac2,192.168.1.192' (RSA) to the list of known hosts.

oracle@ebsrac2's password: 

ebsrac1-> ssh ebsrac2 cat ~/.ssh/id_dsa.pub >>~/.ssh/authorized_keys 

oracle@ebsrac2's password: 

ebsrac1-> scp ~/.ssh/authorized_keys ebsrac2:~/.ssh/authorized_keys 

oracle@ebsrac2's password: 

authorized_keys       

100% 2040     2.0KB/s   00:00  

ebsrac1-> 

验证oracle SSH对等性：

在ebsrac1，ebsrac2两个节点上分别执行下述命令，第一次执行时需要口令验证：

ebsrac1-> id

uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1201(asmdba),1300(dba),1301(oper)

ebsrac1-> ssh ebsrac1 date

The authenticity of host 'ebsrac1 (192.168.1.191)' can't be established.

RSA key fingerprint is 16:c2:67:cd:73:dd:b7:8b:f4:07:ef:e0:fb:36:34:3e.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac1,192.168.1.191' (RSA) to the list of known hosts.

Tue Apr 24 11:28:15 CST 2012

ebsrac1-> ssh ebsrac2 date

Tue Apr 24 11:28:18 CST 2012

ebsrac1-> ssh ebsrac1-priv date

The authenticity of host 'ebsrac1-priv (192.168.94.11)' can't be established.

RSA key fingerprint is 16:c2:67:cd:73:dd:b7:8b:f4:07:ef:e0:fb:36:34:3e.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac1-priv,192.168.94.11' (RSA) to the list of known hosts.

Tue Apr 24 11:28:25 CST 2012

ebsrac1-> ssh ebsrac2-priv date

The authenticity of host 'ebsrac2-priv (192.168.94.12)' can't be established.

RSA key fingerprint is a7:6b:2c:2d:fb:c3:ff:33:af:92:cd:7b:99:3b:cf:3a.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac2-priv,192.168.94.12' (RSA) to the list of known hosts.

Tue Apr 24 11:28:30 CST 2012

ebsrac1-> ssh ebsrac1 date

The authenticity of host 'ebsrac1 (192.168.1.191)' can't be established.

RSA key fingerprint is 16:c2:67:cd:73:dd:b7:8b:f4:07:ef:e0:fb:36:34:3e.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac1' (RSA) to the list of known hosts.

Tue Apr 24 11:28:39 CST 2012

ebsrac1-> ssh ebsrac2 date

The authenticity of host 'ebsrac2 (192.168.1.192)' can't be established.

RSA key fingerprint is a7:6b:2c:2d:fb:c3:ff:33:af:92:cd:7b:99:3b:cf:3a.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac2' (RSA) to the list of known hosts.

Tue Apr 24 11:28:46 CST 2012

ebsrac1-> ssh ebsrac2-priv date

The authenticity of host 'ebsrac2-priv (192.168.94.12)' can't be established.

RSA key fingerprint is a7:6b:2c:2d:fb:c3:ff:33:af:92:cd:7b:99:3b:cf:3a.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac2-priv' (RSA) to the list of known hosts.

Tue Apr 24 11:28:52 CST 2012

ebsrac1-> ssh ebsrac1-priv date

The authenticity of host 'ebsrac1-priv (192.168.94.11)' can't be established.

RSA key fingerprint is 16:c2:67:cd:73:dd:b7:8b:f4:07:ef:e0:fb:36:34:3e.

Are you sure you want to continue connecting (yes/no)? yes

Warning: Permanently added 'ebsrac1-priv' (RSA) to the list of known hosts.

Tue Apr 24 11:28:59 CST 2012

第二次执行时不再提示输入口令，并且可以成功执行命令，则表示oracle用户SSH对等性配置成功

ebsrac1：

ebsrac1-> ssh ebsrac1 date

Tue Apr 24 11:29:02 CST 2012

ebsrac1-> ssh ebsrac2 date

Tue Apr 24 11:29:07 CST 2012

ebsrac1-> ssh ebsrac1-priv date

Tue Apr 24 11:29:13 CST 2012

ebsrac1-> ssh ebsrac2-priv date

Tue Apr 24 11:29:18 CST 2012

ebsrac1-> ssh ebsrac2-priv date

Tue Apr 24 11:29:27 CST 2012

ebsrac1-> ssh ebsrac1-priv date

Tue Apr 24 11:29:33 CST 2012

ebsrac1-> 

ebsrac2：

ebsrac2-> id

uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1201(asmdba),1300(dba),1301(oper)

ebsrac2-> pwd

/home/oracle

ebsrac2-> ssh ebsrac1 date

Tue Apr 24 11:32:06 CST 2012

ebsrac2-> ssh ebsrac2 date

Tue Apr 24 11:32:09 CST 2012

ebsrac2-> ssh ebsrac1-priv date

Tue Apr 24 11:32:14 CST 2012

ebsrac2-> ssh ebsrac2-priv date

Tue Apr 24 11:32:17 CST 2012

ebsrac2-> ssh ebsrac1 date

Tue Apr 24 11:32:26 CST 2012

ebsrac2-> ssh ebsrac2 date

Tue Apr 24 11:32:29 CST 2012

ebsrac2-> ssh ebsrac1-priv date

Tue Apr 24 11:32:39 CST 2012

ebsrac2-> ssh ebsrac2-priv date

Tue Apr 24 11:32:43 CST 2012

ebsrac2->

至此，Oracle用户SSH对等性配置完成！重复上述步骤，以grid用户配置其对等性。

2.14 配置ASM磁盘

我们已经对EBSRAC双节点挂载配置好了共享磁盘，接下来需要将这些共享磁盘格式化、然后用udev将其配置为ASM磁盘，用于将来存放OCR、Voting Disk和数据库用。

注意：只需在其中1个节点上格式化就可以，接下来我们选择在ebsrac1节点上格式化。

2.14.1 格式化共享磁盘

① 以root用户分别在两个节点上执行fdisk命令，查看现有硬盘分区信息：

ebsrac1：

[root@ebsrac1 ~]# fdisk -l

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/tebsrack, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00010adc

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1          26      204800   83  Linux

Partition 1 does not end on cylinder boundary.

/dev/sda2              26        3534    28179456   83  Linux

/dev/sda3            3534        3917     3072000   82  Linux swap / Solaris

Disk /dev/sdb: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdc: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdd: 21.0 GB, 20971520000 bytes

255 heads, 63 sectors/tebsrack, 2549 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sde: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdf: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

ebsrac2：

[root@ebsrac2 ~]# fdisk -l

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/tebsrack, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00010adc

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1          26      204800   83  Linux

Partition 1 does not end on cylinder boundary.

/dev/sda2              26        3534    28179456   83  Linux

/dev/sda3            3534        3917     3072000   82  Linux swap / Solaris

Disk /dev/sdb: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdc: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdd: 21.0 GB, 20971520000 bytes

255 heads, 63 sectors/tebsrack, 2549 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sde: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdf: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

从上，我们可以看到目前两个节点上的分区信息一致：其中/dev/sda是用于存放操作系统的，/dev/sdb、/dev/sdc、/dev/sdd、/dev/sde 、/dev/sdf这5块盘都没有分区信息，这是我们在上一步2.13节中配置的5块共享磁盘。

② root用户在ebsrac1上格式化/dev/sdb、/dev/sdc、/dev/sdd、/dev/sde、/dev/sdf这5块盘

[root@ebsrac1 ~]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0x294eefca.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to

         switch off the mode (command 'c') and change display units to

         sectors (command 'u').

Command (m for help): m

Command action

   a   toggle a bootable flag

   b   edit bsd disklabel

   c   toggle the dos compatibility flag

   d   delete a partition

   l   list known partition types

   m   print this menu

   n   add a new partition

   o   create a new empty DOS partition table

   p   print the partition table

   q   quit without saving changes

   s   create a new empty Sun disklabel

   t   change a partition's system id

   u   change display/entry units

   v   verify the partition table

   w   write table to disk and exit

   x   extra functionality (experts only)

Command (m for help): n

Command action

   e   extended

   p   primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-500, default 1): 1

Last cylinder, +cylinders or +size{K,M,G} (1-500, default 500):

Using default value 500

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

说明：fdisk /dev/sdb表示要对/dev/sdb磁盘进行格式化，其中，输入的命令分别表示：

n表示新建1个分区；

p表示分区类型选择为primary partition 主分区；

1表示分区编号从1开始；

起始、终止柱面选择默认值，即1和500；

w表示将新建的分区信息写入硬盘分区表。

 

③ 重复上述步骤②，以root用户在ebsrac1上分别格式化其余4块磁盘：

④ 格式化完毕之后，在ebsrac1，ebsrac2节点上分别看到下述信息：

ebsrac1：

[root@ebsrac1 ~]# fdisk -l

Disk /dev/sda: 32.2 GB, 32212254720 bytes

255 heads, 63 sectors/tebsrack, 3916 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00010adc

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1          26      204800   83  Linux

Partition 1 does not end on cylinder boundary.

/dev/sda2              26        3534    28179456   83  Linux

/dev/sda3            3534        3917     3072000   82  Linux swap / Solaris

Disk /dev/sdb: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x294eefca

   Device Boot      Start         End      Blocks   Id  System

/dev/sdb1               1         500      511984   83  Linux

Disk /dev/sdc: 524 MB, 524288000 bytes

64 heads, 32 sectors/tebsrack, 500 cylinders

Units = cylinders of 2048 * 512 = 1048576 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xd9574d1a

   Device Boot      Start         End      Blocks   Id  System

/dev/sdc1               1         500      511984   83  Linux

Disk /dev/sdd: 21.0 GB, 20971520000 bytes

255 heads, 63 sectors/tebsrack, 2549 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xf0e8dafa

   Device Boot      Start         End      Blocks   Id  System

/dev/sdd1               1        2549    20474811   83  Linux

Disk /dev/sde: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xc0c606da

   Device Boot      Start         End      Blocks   Id  System

/dev/sde1               1        1274    10233373+  83  Linux

Disk /dev/sdf: 10.5 GB, 10485760000 bytes

255 heads, 63 sectors/tebsrack, 1274 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xdba80b60

   Device Boot      Start         End      Blocks   Id  System

/dev/sdf1               1        1274    10233373+  83  Linux

至此，格式化共享磁盘完毕。

    

使用udev来创建ASM磁盘过程

通过脚本create_asmdisk.sh绑定磁盘信息。脚本信息见附件。两个节点都执行

[root@ebsrac1 ]# ./create_asmdisk.sh

[root@ebsrac1 ]# more 99-oracle-asmdevices.rules

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

7e32b6324b300000000", NAME="asm-diskb", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

7e32b63344800000002", NAME="asm-diskc", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

7e32b63486b00000003", NAME="asm-diskd", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

7e32b63495400000004", NAME="asm-diske", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

7e32b6349c500000005", NAME="asm-diskf", OWNER="grid", GROUP="asmadmin", MODE="0660"

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name", RESULT=="36d0d04b100637

启动udev

[root@ebsracdb1 rman]#start_udev

查看asm情况

[root@ebsracdb1 rman]# ls -l /dev/asm*

brw-rw---- 1 grid asmadmin 8,  16 May  6 16:50 /dev/asm-diskb

brw-rw---- 1 grid asmadmin 8,  32 May  6 16:50 /dev/asm-diskc

brw-rw---- 1 grid asmadmin 8,  48 May  6 16:30 /dev/asm-diskd

brw-rw---- 1 grid asmadmin 8,  64 May  6 16:47 /dev/asm-diske

brw-rw---- 1 grid asmadmin 8,  80 May  6 16:50 /dev/asm-diskf