Create Oracle ASM Cluster File Systems (ACFS) in Oracle Database 11g Release 2
OS版本是Oracle Linux5.8 x86_64,Oracle Database和Grid Infrastructure版本是11.2.0.3,双节点RAC。
[root@vzwc1 ~]# cat /etc/issue Oracle Linux Server release 5.8 Kernel \r on an \m [root@vzwc1 ~]# uname -p x86_64 [root@vzwc1 ~]# [root@vzwc1 ~]# [root@vzwc1 ~]# su - grid [grid@vzwc1 ~]$ crsctl query crs activeversion Oracle Clusterware active version on the cluster is [11.2.0.3.0] [grid@vzwc1 ~]$ [grid@vzwc1 ~]$ su - oracle Password: [oracle@vzwc1 ~]$ sqlplus -V SQL*Plus: Release 11.2.0.3.0 Production
必须打上最新版本的PSU补丁,使用最新版的opatch软件(patch NO 6880880)打上11.2.0.3.5的PSU补丁(patch NO14727347)。
[root@vzwc1 ~]# opatch version OPatch Version: 11.2.0.3.3 OPatch succeeded.
[root@vzwc1 ~]# lsmod |grep oracle oracleacfs 1616046 0 oracleadvm 220230 0 oracleoks 283115 2 oracleacfs,oracleadvm [root@vzwc1 ~]# [root@vzwc1 ~]# /u01/app/11.2.0/grid/bin/acfsdriverstate -orahome /u01/app/11.2.0/grid version ACFS-9325: Driver OS kernel version = 2.6.32-300.0.4.el5uek(x86_64). ACFS-9326: Driver Oracle version = 121021. [root@vzwc1 ~]# [root@vzwc1 ~]# [root@vzwc1 ~]# /u01/app/11.2.0/grid/bin/acfsdriverstate -orahome $ORACLE_HOME supported ACFS-9200: Supported
grid用户PSU
[grid@vzwc2 ~]$ opatch lspatches
15876003;Grid Infrastructure Patch Set Update : 11.2.0.3.5 (14727347)
14727310;Database Patch Set Update : 11.2.0.3.5 (14727310)
[grid@vzwc2 ~]$
[grid@vzwc2 ~]$
[grid@vzwc2 ~]$ opatch lsinv
Oracle Interim Patch Installer version 11.2.0.3.3
Copyright (c) 2012, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/11.2.0/grid
Central Inventory : /u01/app/oraInventory
from : /u01/app/11.2.0/grid/oraInst.loc
OPatch version : 11.2.0.3.3
OUI version : 11.2.0.3.0
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2013-04-17_16-29-54PM_1.log
Lsinventory Output file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/lsinv/lsinventory2013-04-17_16-29-54PM.txt
--------------------------------------------------------------------------------
Installed Top-level Products (1):
Oracle Grid Infrastructure 11.2.0.3.0
There are 1 products installed in this Oracle Home.
Interim patches (2) :
Patch 15876003 : applied on Wed Apr 17 15:15:09 CST 2013
Unique Patch ID: 15680307
Patch description: "Grid Infrastructure Patch Set Update : 11.2.0.3.5 (14727347)"
Created on 11 Jan 2013, 06:19:07 hrs PST8PDT
Bugs fixed:
15876003, 14275572, 13919095, 13696251, 13348650, 12659561, 13039908
14277586, 13987807, 14625969, 13938166, 13825231, 13036424, 12794268
13011520, 13569812, 12758736, 13000491, 13498267, 13077654, 13001901
13550689, 13430715, 13806545, 13634583, 11675721, 14082976, 14271305
12771830, 12538907, 13947200, 12996428, 14102704, 13066371, 13483672
12594616, 13879428, 13540563, 12897651, 12897902, 13241779, 12896850
12726222, 12829429, 12728585, 13079948, 12876314, 13090686, 12925041
12995950, 13251796, 12650672, 12398492, 12848480, 13582411, 13652088
12990582, 13857364, 12975811, 12917897, 13653178, 13082238, 12947871
13037709, 13371153, 12878750, 10114953, 11772838, 13058611, 13001955
14001941, 11836951, 12965049, 13440962, 12765467, 13727853, 13425727
12885323, 14407395, 13965075, 13339443, 12784559, 14242977, 13332363
13074261, 12971251, 13811209, 12709476, 14168708, 14096821, 13993634
13460353, 13523527, 12857064, 13719731, 13396284, 12899169, 13111013
12558569, 13323698, 12867511, 12639013, 10260842, 12959140, 13085732
12829917, 10317921, 13843080, 12934171, 12849377, 12349553, 13924431
13869978, 12680491, 12914824, 13789135, 12730342, 13334158, 12950823
10418841, 12832204, 13355963, 13531373, 13776758, 12720728, 13620816
13002015, 13023609, 13024624, 12791719, 13886023, 13255295, 13821454
12782756, 14152875, 14100232, 14186070, 14569263, 13912373, 12873909
13845120, 14214257, 12914722, 13243172, 12842804, 13045518, 12765868
12772345, 12663376, 13345868, 14059576, 13683090, 12932852, 13889047
12695029, 14588629, 13146560, 13038806, 14251904, 14070200, 13820621
14304758, 13396356, 13697828, 13258062, 12834777, 14371335, 12996572
13941934, 14711358, 13657366, 13019958, 12810890, 13888719, 14637577
13502441, 13726162, 13880925, 14153867, 13506114, 12820045, 13604057
12823838, 13877508, 12823042, 14494305, 13582706, 13617861, 12825835
13263435, 13025879, 13853089, 14009845, 13410987, 13570879, 13637590
12827493, 13247273, 13068077
Patch 14727310 : applied on Wed Apr 17 15:08:44 CST 2013
Unique Patch ID: 15663328
Patch description: "Database Patch Set Update : 11.2.0.3.5 (14727310)"
Created on 27 Dec 2012, 00:06:30 hrs PST8PDT
Sub-patch 14275605; "Database Patch Set Update : 11.2.0.3.4 (14275605)"
Sub-patch 13923374; "Database Patch Set Update : 11.2.0.3.3 (13923374)"
Sub-patch 13696216; "Database Patch Set Update : 11.2.0.3.2 (13696216)"
Sub-patch 13343438; "Database Patch Set Update : 11.2.0.3.1 (13343438)"
Bugs fixed:
13566938, 13593999, 10350832, 14138130, 12919564, 13624984, 13588248
13080778, 13804294, 14258925, 12873183, 13645875, 12880299, 14664355
14409183, 12998795, 14469008, 13719081, 13492735, 12857027, 14263036
14263073, 13742433, 13732226, 12905058, 13742434, 12849688, 12950644
13742435, 13464002, 12879027, 13534412, 14613900, 12585543, 12535346
12588744, 11877623, 12847466, 13649031, 13981051, 12582664, 12797765
14262913, 12923168, 13612575, 13384182, 13466801, 13484963, 11063191
13772618, 13070939, 12797420, 13041324, 12976376, 11708510, 13742437
13026410, 13737746, 13742438, 13326736, 13001379, 13099577, 14275605
13742436, 9873405, 9858539, 14040433, 12662040, 9703627, 12617123
12845115, 12764337, 13354082, 13397104, 12964067, 13550185, 12780983
12583611, 14546575, 13476583, 15862016, 11840910, 13903046, 15862017
13572659, 13718279, 13657605, 13448206, 13419660, 14480676, 13632717
14063281, 13430938, 13467683, 13420224, 14548763, 12646784, 14035825
12861463, 12834027, 15862021, 13377816, 13036331, 14727310, 13685544
13499128, 15862018, 12829021, 15862019, 12794305, 14546673, 12791981
13503598, 13787482, 10133521, 12718090, 13399435, 14023636, 12401111
13257247, 13362079, 12917230, 13923374, 14480675, 13524899, 13559697
14480674, 13916709, 14076523, 13773133, 13340388, 13366202, 13528551
12894807, 13343438, 13454210, 12748240, 14205448, 13385346, 15853081
12971775, 13035804, 13544396, 13035360, 14062795, 12693626, 13332439
14038787, 14062796, 12913474, 14841409, 14390252, 13370330, 14062797
13059165, 14062794, 12959852, 13358781, 12345082, 12960925, 9659614
13699124, 14546638, 13936424, 13338048, 12938841, 12658411, 12620823
12656535, 14062793, 12678920, 13038684, 14062792, 13807411, 12594032
13250244, 15862022, 9761357, 12612118, 13742464, 14052474, 13457582
13527323, 15862020, 12780098, 13502183, 13705338, 13696216, 10263668
15862023, 13554409, 15862024, 13103913, 13645917, 14063280, 13011409
Rac system comprising of multiple nodes
Local node = vzwc2
Remote node = vzwc1
--------------------------------------------------------------------------------
OPatch succeeded.
oracle用户PSU
[oracle@vzwc2 ~]$ opatch lspatches
14727310;Database Patch Set Update : 11.2.0.3.5 (14727310)
15876003;Grid Infrastructure Patch Set Update : 11.2.0.3.5 (14727347)
[oracle@vzwc2 ~]$
[oracle@vzwc2 ~]$
[oracle@vzwc2 ~]$ opatch lsinv
Oracle Interim Patch Installer version 11.2.0.3.3
Copyright (c) 2012, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/11.2.0/dbhome_1
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/11.2.0/dbhome_1/oraInst.loc
OPatch version : 11.2.0.3.3
OUI version : 11.2.0.3.0
Log file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/opatch2013-04-17_16-31-06PM_1.log
Lsinventory Output file location : /u01/app/oracle/product/11.2.0/dbhome_1/cfgtoollogs/opatch/lsinv/lsinventory2013-04-17_16-31-06PM.txt
--------------------------------------------------------------------------------
Installed Top-level Products (1):
Oracle Database 11g 11.2.0.3.0
There are 1 products installed in this Oracle Home.
Interim patches (2) :
Patch 14727310 : applied on Wed Apr 17 15:24:24 CST 2013
Unique Patch ID: 15663328
Patch description: "Database Patch Set Update : 11.2.0.3.5 (14727310)"
Created on 27 Dec 2012, 00:06:30 hrs PST8PDT
Sub-patch 14275605; "Database Patch Set Update : 11.2.0.3.4 (14275605)"
Sub-patch 13923374; "Database Patch Set Update : 11.2.0.3.3 (13923374)"
Sub-patch 13696216; "Database Patch Set Update : 11.2.0.3.2 (13696216)"
Sub-patch 13343438; "Database Patch Set Update : 11.2.0.3.1 (13343438)"
Bugs fixed:
13566938, 13593999, 10350832, 14138130, 12919564, 13624984, 13588248
13080778, 13804294, 14258925, 12873183, 13645875, 12880299, 14664355
14409183, 12998795, 14469008, 13719081, 13492735, 12857027, 14263036
14263073, 13742433, 13732226, 12905058, 13742434, 12849688, 12950644
13742435, 13464002, 12879027, 13534412, 14613900, 12585543, 12535346
12588744, 11877623, 12847466, 13649031, 13981051, 12582664, 12797765
14262913, 12923168, 13612575, 13384182, 13466801, 13484963, 11063191
13772618, 13070939, 12797420, 13041324, 12976376, 11708510, 13742437
13026410, 13737746, 13742438, 13326736, 13001379, 13099577, 14275605
13742436, 9873405, 9858539, 14040433, 12662040, 9703627, 12617123
12845115, 12764337, 13354082, 13397104, 12964067, 13550185, 12780983
12583611, 14546575, 13476583, 15862016, 11840910, 13903046, 15862017
13572659, 13718279, 13657605, 13448206, 13419660, 14480676, 13632717
14063281, 13430938, 13467683, 13420224, 14548763, 12646784, 14035825
12861463, 12834027, 15862021, 13377816, 13036331, 14727310, 13685544
13499128, 15862018, 12829021, 15862019, 12794305, 14546673, 12791981
13503598, 13787482, 10133521, 12718090, 13399435, 14023636, 12401111
13257247, 13362079, 12917230, 13923374, 14480675, 13524899, 13559697
14480674, 13916709, 14076523, 13773133, 13340388, 13366202, 13528551
12894807, 13343438, 13454210, 12748240, 14205448, 13385346, 15853081
12971775, 13035804, 13544396, 13035360, 14062795, 12693626, 13332439
14038787, 14062796, 12913474, 14841409, 14390252, 13370330, 14062797
13059165, 14062794, 12959852, 13358781, 12345082, 12960925, 9659614
13699124, 14546638, 13936424, 13338048, 12938841, 12658411, 12620823
12656535, 14062793, 12678920, 13038684, 14062792, 13807411, 12594032
13250244, 15862022, 9761357, 12612118, 13742464, 14052474, 13457582
13527323, 15862020, 12780098, 13502183, 13705338, 13696216, 10263668
15862023, 13554409, 15862024, 13103913, 13645917, 14063280, 13011409
Patch 15876003 : applied on Wed Apr 17 15:19:36 CST 2013
Unique Patch ID: 15680307
Patch description: "Grid Infrastructure Patch Set Update : 11.2.0.3.5 (14727347)"
Created on 11 Jan 2013, 06:19:07 hrs PST8PDT
Bugs fixed:
15876003, 14275572, 13919095, 13696251, 13348650, 12659561, 13039908
14277586, 13987807, 14625969, 13938166, 13825231, 13036424, 12794268
13011520, 13569812, 12758736, 13000491, 13498267, 13077654, 13001901
13550689, 13430715, 13806545, 13634583, 11675721, 14082976, 14271305
12771830, 12538907, 13947200, 12996428, 14102704, 13066371, 13483672
12594616, 13879428, 13540563, 12897651, 12897902, 13241779, 12896850
12726222, 12829429, 12728585, 13079948, 12876314, 13090686, 12925041
12995950, 13251796, 12650672, 12398492, 12848480, 13582411, 13652088
12990582, 13857364, 12975811, 12917897, 13653178, 13082238, 12947871
13037709, 13371153, 12878750, 10114953, 11772838, 13058611, 13001955
14001941, 11836951, 12965049, 13440962, 12765467, 13727853, 13425727
12885323, 14407395, 13965075, 13339443, 12784559, 14242977, 13332363
13074261, 12971251, 13811209, 12709476, 14168708, 14096821, 13993634
13460353, 13523527, 12857064, 13719731, 13396284, 12899169, 13111013
12558569, 13323698, 12867511, 12639013, 10260842, 12959140, 13085732
12829917, 10317921, 13843080, 12934171, 12849377, 12349553, 13924431
13869978, 12680491, 12914824, 13789135, 12730342, 13334158, 12950823
10418841, 12832204, 13355963, 13531373, 13776758, 12720728, 13620816
13002015, 13023609, 13024624, 12791719
Rac system comprising of multiple nodes
Local node = vzwc2
Remote node = vzwc1
--------------------------------------------------------------------------------
OPatch succeeded.
Manual ACFS/ADVM installation.
you will be able to create ASM volumes
[grid@vzwc1 ~]$ sqlplus / as sysasm SQL*Plus: Release 11.2.0.3.0 Production on Wed Apr 17 16:23:06 2013 Copyright (c) 1982, 2011, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options SQL> alter diskgroup dsgdg add volume ebernal size 6G; Diskgroup altered.
Then create the ACFS filesystem
[grid@vzwc1 ~]$ /sbin/mkfs -t acfs -b 4k /dev/asm/ebernal-401 mkfs.acfs: version = 11.2.0.3.0 mkfs.acfs: on-disk version = 39.0 mkfs.acfs: volume = /dev/asm/ebernal-401 mkfs.acfs: volume size = 6442450944 mkfs.acfs: Format complete.
Register the ASM Volume (ADVM) & ACFS filesystem in the Oracle Registry
[grid@vzwc1 ~]$ /sbin/acfsutil registry -f -a /dev/asm/ebernal-401 /dsgacfs acfsutil registry: mount point /dsgacfs successfully added to Oracle Registry
[root@vzwc1 ~]# mkdir /dsgacfs [root@vzwc1 ~]# mount -t acfs /dev/asm/ebernal-401 /dsgacfs
Verify the ACFS filesystem is mounted
[root@vzwc1 ~]# df -TH
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 38G 21G 16G 58% /
/dev/sda1 ext3 104M 25M 75M 25% /boot
tmpfs tmpfs 1.1G 733M 318M 70% /dev/shm
/dev/asm/ebernal-401
acfs 6.5G 51M 6.4G 1% /dsgacfs
ASM Configuration Assistant (ASMCA)
Test
With the newcluster file system now mounted on all Oracle RAC nodes, change the permissionsto allow user access. For the purpose of this example, I want to grant the oracleuser account and dba group read/write permissions. Run the following as rootfrom only one node in the Oracle RAC
[root@vzwc1 dsgacfs]# chown -R oracle:oinstall /dsgacfs [root@vzwc1 dsgacfs]# chmod 755 /dsgacfs
RAC1
Log in to thefirst Oracle RAC node as the oracle user account and create a test file on thenew cluster file system
[oracle@vzwc1 ~]$ echo "ACFS Test" > /dsgacfs/test.txt [oracle@vzwc1 ~]$ ls -l /dsgacfs/ total 68 drwx------ 2 oracle oinstall 65536 Apr 17 16:34 lost+found/ -rw-r--r-- 1 oracle oinstall 10 Apr 17 17:13 test.txt [oracle@vzwc1 ~]$ cat /dsgacfs/test.txt ACFS Test
Log in to thesecond Oracle RAC node as the oracle user account and verify the presenceand content of the test file
[oracle@vzwc2 ~]$ df -TH
Filesystem Type Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
ext3 38G 17G 19G 47% /
/dev/sda1 ext3 104M 25M 75M 25% /boot
tmpfs tmpfs 1.1G 712M 339M 68% /dev/shm
/dev/asm/ebernal-401
acfs 6.5G 210M 6.3G 4% /dsgacfs
[oracle@vzwc2 ~]$
[oracle@vzwc2 ~]$
[oracle@vzwc2 ~]$ ll /dsgacfs/
total 68
drwx------ 2 oracle oinstall 65536 Apr 17 17:16 lost+found/
-rw-r--r-- 1 oracle oinstall 10 Apr 17 17:18 test.txt
[oracle@vzwc2 ~]$
[oracle@vzwc2 ~]$ cat /dsgacfs/test.txt
ACFS Test
Reference documentation
How To Install/Reinstall Or Deinstall ACFS Modules/Installation Manually? [ID 1371067.1]