Install Oracle10gRac On Solaris + HDS + Veritas5.0
Install Oracle10gRac On Solaris + HDS + Veritas5.0
1.安装操作系统
# uname -a
SunOS b1000a 5.8 Generic_117350-41 sun4u sparc SUNW,Sun-Blade-1000
配置hosts文件,设置相应别名,配置一个浮动ip(配置Cluster时需要)
# cat /etc/hosts
#
# Internet host table
#
127.0.0.1 localhost
172.18.2.202 b1000a b1000a.cluster.com loghost
172.18.2.203 b1000b
172.18.2.204 vip
172.18.2.205 b1000a_vip
172.18.2.206 b1000b_vip
192.168.12.1 b1000a_priv
192.168.12.2 b1000b_priv
5.安装VERITAS STORAGE FOUNDATION FOR ORACLE RAC 5.0软件
1).设置rsh许可
可以简单的配置.rhosts文件
# cat /.rhosts
+
#
在两台主机分别执行以下命令测试设置是否生效
# rsh cluster2 date
Fri Sep 3 04:06:56 CST 2004
2.使用安装工具进行安装
# ls
cluster_file_solutions_gsg.pdf perl storage_foundation_for_oracle_rac
gnu rr_moved support
installer storage_foundation_cluster_file_system windows
# ./installer
VERITAS Cluster File Solutions 4.0
Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.
VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.
VERITAS Cluster File Solutions 4.0
VERITAS Product Version Installed Licensed
===========================================================================
Storage Foundation for Cluster File System no yes
Storage Foundation for Oracle RAC no yes
Enterprise Administrator GUI no
Selection Menu:
I) Install/Upgrade a Product C) Configure an Installed Product
L) License a Product P) Perform a Preinstallation Check
U) Uninstall a Product D) View a Product Description
Q) Quit ?) Help
Enter a Selection: [I,C,L,P,U,D,Q,?] I
--选择安装软件,最好在此前使用L,输入有效的License或Demo License
VERITAS Cluster File Solutions 4.0
1) VERITAS Storage Foundation for Cluster File System
2) VERITAS Storage Foundation for Oracle RAC
3) VERITAS Enterprise Administrator GUI
B) Back to previous menu
Select a product to install: [1-3,b,q] 2
--此处安装的是For Oracle RAC的版本
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.
VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.
Enter the system names separated by spaces on which to install SFRAC: cluster1 cluster2
--输入需要安装Cluster的节点名称
Checking system communication:
Checking OS version on cluster1 ................................................................................. SunOS 5.9
Checking VRTSdbac package ................................................................................... not installed
Verifying communication with cluster2 ..................................................................... ping successful
Attempting rsh with cluster2 ............................................................................... rsh successful
Attempting rcp with cluster2 ............................................................................... rcp successful
Checking OS version on cluster2 ................................................................................. SunOS 5.9
Checking VRTSdbac package ................................................................................... not installed
Creating log directory on cluster2 ................................................................................... Done
Logs for installer are being created in /var/tmp/installer902153656.
Using /usr/bin/rsh and /usr/bin/rcp to communicate with remote systems.
Initial system check completed successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
VERITAS Infrastructure package installation:
Installing VERITAS Infrastructure packages on cluster1:
Checking VRTScpi package .......................................................................... version 4.0.5 installed
Checking VRTSvlic package ..................................................................... version 3.02.005d installed
Installing VERITAS Infrastructure packages on cluster2:
Checking VRTScpi package .......................................................................... version 4.0.5 installed
Checking VRTSvlic package ..................................................................... version 3.02.005d installed
VERITAS Infrastructure packages installed successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Each system requires a SFRAC product license before installation. License keys for additional product features should also be
added at this time.
Some license keys are node locked and are unique per system. Other license keys, such as demo keys and site license keys, are
registered on all systems and must be entered on the first system.
SFRAC Licensing Verification:
Checking SFRAC license key on cluster1 ............................................. Storage Foundation for Oracle RAC Demo
Do you want to enter another license key for cluster1? [y,n,q,?] (n)
Checking SFRAC license key on cluster2 ............................................. Storage Foundation for Oracle RAC Demo
Do you want to enter another license key for cluster2? [y,n,q,?] (n)
--此处进行的是License验证,我的此前已经输入了Demo License
SFRAC licensing verified successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
installer will install the following SFRAC packages:
VRTSperl VERITAS Perl 5.8.0 Redistribution
VRTSob VERITAS Enterprise Administrator Service
VRTSmuob VERITAS Enterprise Administrator Service Localized Package
VRTSobgui VERITAS Enterprise Administrator
VRTSvxvm VERITAS Volume Manager Binaries
VRTSvmman VERITAS Volume Manager Manual Pages
VRTSvmdoc VERITAS Volume Manager Documentation
VRTSvmpro VERITAS Volume Manager Management Services Provider
VRTSfspro VERITAS File System Management Services Provider
VRTSalloc VERITAS Volume Manager Intelligent Storage Provisioning
VRTSddlpr VERITAS Device Discovery Layer Services Provider
VRTSvxfs VERITAS File System
VRTStep VERITAS Task Provider
VRTSap VERITAS Action Provider
VRTSfppm VERITAS File Placement Policy Manager
VRTSfsman VERITAS File System Manual Pages
VRTSfsdoc VERITAS File System Documentation
VRTSllt VERITAS Low Latency Transport
VRTSgab VERITAS Group Membership and Atomic Broadcast
Press [Return] to continue:
...continued:
VRTSvxfen VERITAS I/O Fencing
VRTSvcs VERITAS Cluster Server
VRTSvcsmg VERITAS Cluster Server Message Catalogs
VRTSvcsag VERITAS Cluster Server Bundled Agents
VRTSvcsmn VERITAS Cluster Server Man Pages
VRTScspro VERITAS Cluster Server VEA Provider
VRTSvcsdc VERITAS Cluster Server Documentation
VRTSjre VERITAS Java Runtime Environment Redistribution
VRTScutil VERITAS Cluster Utilities
VRTScssim VERITAS Cluster Server Simulator
VRTScscw VERITAS Cluster Server Configuration Wizards
VRTSweb VERITAS Java Web Server
VRTSvcsw VERITAS Cluster Manager (Web Console)
VRTScscm VERITAS Cluster Server Cluster Manager
VRTScavf VERITAS Cluster Server Agents for Cluster File System
VRTSglm VERITAS Group Lock Manager
VRTSgms VERITAS Group Messaging Services
VRTSodm VERITAS Oracle Disk Manager
VRTSvail VERITAS Array Provider
VRTSdbac VERITAS Oracle Real Application Cluster Support Package
Press [Return] to continue:
...continued:
VRTSracdc VERITAS Storage Foundation 4.0 for Oracle RAC Documentation
VRTSvcsor VERITAS Cluster Server Oracle Enterprise Extension
VRTScsocw VERITAS Cluster Server Oracle 9i RAC Wizard
VRTSvcsvr VERITAS Cluster Server VVR Agent
VRTSdbckp VERITAS Storage Foundation Checkpoint Scripts
VRTSvxmsa VERITAS Mapping Service, Application Libraries
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Checking system installation requirements:
Checking SFRAC installation requirements on cluster1:
Checking VRTSperl package ................................................................................... not installed
Checking VRTSob package ..................................................................................... not installed
Checking VRTSmuob package ................................................................................... not installed
Checking VRTSobgui package .................................................................................. not installed
Checking VRTSvxvm package ................................................................................... not installed
Checking VRTSvmman package .................................................................................. not installed
Checking VRTSvmdoc package .................................................................................. not installed
Checking VRTSvmpro package .................................................................................. not installed
Checking VRTSfspro package .................................................................................. not installed
Checking VRTSalloc package .................................................................................. not installed
Checking VRTSddlpr package .................................................................................. not installed
Checking VRTSvxfs package ................................................................................... not installed
Checking VRTStep package .................................................................................... not installed
Checking VRTSap package ..................................................................................... not installed
Checking VRTSfppm package ................................................................................... not installed
Checking VRTSfsman package .................................................................................. not installed
Checking VRTSfsdoc package .................................................................................. not installed
Checking VRTSllt package .................................................................................... not installed
Checking VRTSgab package .................................................................................... not installed
Checking VRTSvxfen package .................................................................................. not installed
Checking VRTSvcs package .................................................................................... not installed
Checking VRTSvcsmg package .................................................................................. not installed
Checking VRTSvcsag package .................................................................................. not installed
Checking VRTSvcsmn package .................................................................................. not installed
Checking VRTScspro package .................................................................................. not installed
Checking VRTSvcsdc package .................................................................................. not installed
Checking VRTSjre package .................................................................................... not installed
Checking VRTScutil package .................................................................................. not installed
Checking VRTScssim package .................................................................................. not installed
Checking VRTScscw package ................................................................................... not installed
Checking VRTSweb package .................................................................................... not installed
Checking VRTSvcsw package ................................................................................... not installed
Checking VRTScscm package ................................................................................... not installed
Checking VRTScavf package ................................................................................... not installed
Checking VRTSglm package .................................................................................... not installed
Checking VRTSgms package .................................................................................... not installed
Checking VRTSodm package .................................................................................... not installed
Checking VRTSvail package ................................................................................... not installed
Checking VRTSdbac package ................................................................................... not installed
Checking VRTSracdc package .................................................................................. not installed
Checking VRTSvcsor package .................................................................................. not installed
Checking VRTScsocw package .................................................................................. not installed
Checking VRTSvcsvr package .................................................................................. not installed
Checking VRTSdbckp package .................................................................................. not installed
Checking VRTSvxmsa package .................................................................................. not installed
Checking required SunOS patch 113277-08 on cluster1 ................................................... 113277-24 installed
Checking VERITAS patch 115209 ............................................................................... not installed
Checking VERITAS patch 115212 ............................................................................... not installed
Checking VERITAS patch 115210 ............................................................................... not installed
Checking VERITAS patch 115217 ............................................................................... not installed
Checking for any Solaris patch issues ................................................................................ None
Checking file system space .................................................................... required space is available
Checking odm driver ........................................................................................... not running
Checking vxgms driver ......................................................................................... not running
Checking vxportal driver ...................................................................................... not running
Checking fdd driver ........................................................................................... not running
Checking qlog driver .......................................................................................... not running
Checking vxfs driver .......................................................................................... not running
Checking VRTSweb process ...................................................................................... not running
Checking had process .......................................................................................... not running
Checking hashadow process ..................................................................................... not running
Checking CmdServer process .................................................................................... not running
Checking notifier process ..................................................................................... not running
Checking vxsvc process ........................................................................................ not running
Checking vcsmm driver ......................................................................................... not running
Checking lmx driver ........................................................................................... not running
Checking odm driver ........................................................................................... not running
Checking vxgms driver ......................................................................................... not running
Checking vxfen driver ......................................................................................... not running
Checking gab driver ........................................................................................... not running
Checking llt driver ........................................................................................... not running
Checking vxportal driver ...................................................................................... not running
Checking fdd driver ........................................................................................... not running
Checking qlog driver .......................................................................................... not running
Checking vxfs driver .......................................................................................... not running
Checking SFRAC installation requirements on cluster2:
Checking VRTSperl package ................................................................................... not installed
Checking VRTSob package ..................................................................................... not installed
Checking VRTSmuob package ................................................................................... not installed
Checking VRTSobgui package .................................................................................. not installed
Checking VRTSvxvm package ................................................................................... not installed
Checking VRTSvmman package .................................................................................. not installed
Checking VRTSvmdoc package .................................................................................. not installed
Checking VRTSvmpro package .................................................................................. not installed
Checking VRTSfspro package .................................................................................. not installed
Checking VRTSalloc package .................................................................................. not installed
Checking VRTSddlpr package .................................................................................. not installed
Checking VRTSvxfs package ................................................................................... not installed
Checking VRTStep package .................................................................................... not installed
Checking VRTSap package ..................................................................................... not installed
Checking VRTSfppm package ................................................................................... not installed
Checking VRTSfsman package .................................................................................. not installed
Checking VRTSfsdoc package .................................................................................. not installed
Checking VRTSllt package .................................................................................... not installed
Checking VRTSgab package .................................................................................... not installed
Checking VRTSvxfen package .................................................................................. not installed
Checking VRTSvcs package .................................................................................... not installed
Checking VRTSvcsmg package .................................................................................. not installed
Checking VRTSvcsag package .................................................................................. not installed
Checking VRTSvcsmn package .................................................................................. not installed
Checking VRTScspro package .................................................................................. not installed
Checking VRTSvcsdc package .................................................................................. not installed
Checking VRTSjre package .................................................................................... not installed
Checking VRTScutil package .................................................................................. not installed
Checking VRTScssim package .................................................................................. not installed
Checking VRTScscw package ................................................................................... not installed
Checking VRTSweb package .................................................................................... not installed
Checking VRTSvcsw package ................................................................................... not installed
Checking VRTScscm package ................................................................................... not installed
Checking VRTScavf package ................................................................................... not installed
Checking VRTSglm package .................................................................................... not installed
Checking VRTSgms package .................................................................................... not installed
Checking VRTSodm package .................................................................................... not installed
Checking VRTSvail package ................................................................................... not installed
Checking VRTSdbac package ................................................................................... not installed
Checking VRTSracdc package .................................................................................. not installed
Checking VRTSvcsor package .................................................................................. not installed
Checking VRTScsocw package .................................................................................. not installed
Checking VRTSvcsvr package .................................................................................. not installed
Checking VRTSdbckp package .................................................................................. not installed
Checking VRTSvxmsa package .................................................................................. not installed
Checking required SunOS patch 113277-08 on cluster2 ................................................... 113277-24 installed
Checking VERITAS patch 115209 ............................................................................... not installed
Checking VERITAS patch 115212 ............................................................................... not installed
Checking VERITAS patch 115210 ............................................................................... not installed
Checking VERITAS patch 115217 ............................................................................... not installed
Checking for any Solaris patch issues ................................................................................ None
Checking file system space .................................................................... required space is available
Checking odm driver ........................................................................................... not running
Checking vxgms driver ......................................................................................... not running
Checking vxportal driver ...................................................................................... not running
Checking fdd driver ........................................................................................... not running
Checking qlog driver .......................................................................................... not running
Checking vxfs driver .......................................................................................... not running
Checking VRTSweb process ...................................................................................... not running
Checking had process .......................................................................................... not running
Checking hashadow process ..................................................................................... not running
Checking CmdServer process .................................................................................... not running
Checking notifier process ..................................................................................... not running
Checking vxsvc process ........................................................................................ not running
Checking vcsmm driver ......................................................................................... not running
Checking lmx driver ........................................................................................... not running
Checking odm driver ........................................................................................... not running
Checking vxgms driver ......................................................................................... not running
Checking vxfen driver ......................................................................................... not running
Checking gab driver ........................................................................................... not running
Checking llt driver ........................................................................................... not running
Checking vxportal driver ...................................................................................... not running
Checking fdd driver ........................................................................................... not running
Checking qlog driver .......................................................................................... not running
Checking vxfs driver .......................................................................................... not running
Installation requirement checks completed successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Before SFRAC is installed, be sure you have reviewed the VERITAS Storage Foundation 4.0 for Oracle RAC Installation and
Configuration Guide
A copy of a previous VxVM configuration is present on the system cluster2.
Do you want to restore and reuse the previous VxVM configuration of system cluster2 [y,n,q,?] (y) n
--如果之前安装过,配置文件有备份，可以重用，也可以重新配置
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
It is possible to install SFRAC packages without performing configuration.
SFRAC cannot be started without proper configuration.
It is optional to configure SFRAC now. If you choose to configure SFRAC later, you can either do so manually or run the
installsfrac -configure command.
Are you ready to configure SFRAC? [y,n,q] (y)
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
installer will now ask sets of SFRAC configuration-related questions.
When a [b] is presented after a question, 'b' may be entered to go back to the first question of the configuration set.
When a [?] is presented after a question, '?' may be entered for help or additional information about the question.
Following each set of questions, the information you have entered will be presented for confirmation. To repeat the set of
questions and correct any previous errors, enter 'n' at the confirmation prompt.
No configuration changes are made to the systems until all configuration questions are completed and SFRAC is installed
successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
To configure VCS for SFRAC the following is required:
A unique Cluster name
A unique Cluster ID number between 0-255
Two or more NIC cards per system used for heartbeat links
All systems are being configured to create one cluster
Enter the unique cluster name: [?] ora9i
Enter the unique Cluster ID number between 0-255: [b,?] 1
--输入Cluster名称及ID号
Discovering NICs on cluster1 ......... discovered bge0 bge1 bge2 bge3 chipid driverinfo lpfc0 parameters phydata statistics
Enter the NIC for the first private heartbeat link on cluster1: [b,?] bge1
Would you like to configure a second private heartbeat link? [y,n,q,b,?] (y)
Enter the NIC for the second private heartbeat link on cluster1: [b,?] bge2
Would you like to configure a third private heartbeat link? [y,n,q,b,?] (n)
Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)
--选择心跳网卡,最好有两块
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Cluster information verification:
Cluster Name: ora9i
Cluster ID Number: 1
Private Heartbeat NICs for cluster1: link1=bge1 link2=bge2
Private Heartbeat NICs for cluster2: link1=bge1 link2=bge2
Is this information correct? [y,n,q] (y)
--确认配置信息后继续
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
The following information is required to configure Cluster Manager:
A public NIC used by each system in the cluster
A Virtual IP address and netmask for Cluster Manager
Do you want to configure Cluster Manager (Web Console) [y,n,q] (y)
Active NIC devices discovered on cluster1: bge0
Enter the NIC for Cluster Manager (Web Console) to use on cluster1: [b,?] (bge0)
Is bge0 to be the public NIC used by all systems [y,n,q,b,?] (y)
Enter the Virtual IP address for Cluster Manager: [b,?] 172.16.33.74
Enter the netmask for IP 172.16.33.74: [b,?] (255.255.255.0)
--设置虚拟浮动ip地址
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Cluster Manager (Web Console) verification:
NIC: bge0
IP: 172.16.33.74
Netmask: 255.255.255.0
Is this information correct? [y,n,q] (y)
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
The following information is required to configure SMTP notification:
The domain-based hostname of the SMTP server
The email address of each SMTP recipient
A minimum severity level of messages to send to each recipient
Do you want to configure SMTP notification? [y,n,q] (y) n
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
The following information is required to configure SNMP notification:
System names of SNMP consoles to receive VCS trap messages
SNMP trap daemon port numbers for each console
A minimum severity level of messages to send to each console
Do you want to configure SNMP notification? [y,n,q] (y) n
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Enter Cluster Volume Manager cluster reconfiguration timeout (sec): (200)
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
SFRAC packages can be installed on systems consecutively or simultaneously. Installing packages on systems consecutively takes
more time but allows for better error handling.
Would you like to install Storage Foundation for Oracle RAC packages on all systems simultaneously? [y,n,q,?] (y)
--是否同时安装两个节点,此前配置好了rsh才有效
Installing Storage Foundation for Oracle RAC 4.0 on all systems simultaneously:
Copying VRTSperl.tar.gz to cluster2 ................................................................... Done 1 of 147 steps
Installing VRTSperl 4.0.2 on cluster1 ................................................................. Done 2 of 147 steps
Installing VRTSperl 4.0.2 on cluster2 ................................................................. Done 3 of 147 steps
Copying VRTSob.tar.gz to cluster2 ..................................................................... Done 4 of 147 steps
Installing VRTSob 3.2.514.0 on cluster1 ............................................................... Done 5 of 147 steps
Installing VRTSmuob 3.2.514.0 on cluster1 ............................................................. Done 6 of 147 steps
Installing VRTSob 3.2.514.0 on cluster2 ............................................................... Done 7 of 147 steps
Copying VRTSmuob.tar.gz to cluster2 ................................................................... Done 8 of 147 steps
Installing VRTSobgui 3.2.514.0 on cluster1 ............................................................ Done 9 of 147 steps
Installing VRTSmuob 3.2.514.0 on cluster2 ............................................................ Done 10 of 147 steps
Copying VRTSobgui.tar.gz to cluster2 ................................................................. Done 11 of 147 steps
Installing VRTSobgui 3.2.514.0 on cluster2 ........................................................... Done 12 of 147 steps
Copying VRTSvxvm.tar.gz to cluster2 .................................................................. Done 13 of 147 steps
Installing VRTSvxvm 4.0 on cluster1 .................................................................. Done 14 of 147 steps
Installing VRTSvmman 4.0 on cluster1 ................................................................. Done 15 of 147 steps
Installing VRTSvmdoc 4.0 on cluster1 ................................................................. Done 16 of 147 steps
Installing VRTSvmpro 4.0 on cluster1 ................................................................. Done 17 of 147 steps
Installing VRTSfspro 4.0 on cluster1 ................................................................. Done 18 of 147 steps
Installing VRTSalloc 4.0 on cluster1 ................................................................. Done 19 of 147 steps
Installing VRTSddlpr 4.0 on cluster1 ................................................................. Done 20 of 147 steps
Installing VRTSvxvm 4.0 on cluster2 .................................................................. Done 21 of 147 steps
Copying VRTSvmman.tar.gz to cluster2 ................................................................. Done 22 of 147 steps
Installing VRTSvmman 4.0 on cluster2 ................................................................. Done 23 of 147 steps
Installing VRTSvxfs 4.0 on cluster1 .................................................................. Done 24 of 147 steps
Installing VRTStep 1.20.025 on cluster1 .............................................................. Done 25 of 147 steps
Copying VRTSvmdoc.tar.gz to cluster2 ................................................................. Done 26 of 147 steps
Installing VRTSap 2.00.015 on cluster1 ............................................................... Done 27 of 147 steps
Installing VRTSfppm 4.0 on cluster1 .................................................................. Done 28 of 147 steps
Installing VRTSvmdoc 4.0 on cluster2 ................................................................. Done 29 of 147 steps
Installing VRTSfsman 4.0 on cluster1 ................................................................. Done 30 of 147 steps
Copying VRTSvmpro.tar.gz to cluster2 ................................................................. Done 31 of 147 steps
Installing VRTSfsdoc 4.0 on cluster1 ................................................................. Done 32 of 147 steps
Installing VRTSllt 4.0 on cluster1 ................................................................... Done 33 of 147 steps
Installing VRTSgab 4.0 on cluster1 ................................................................... Done 34 of 147 steps
Installing VRTSvmpro 4.0 on cluster2 ................................................................. Done 35 of 147 steps
Copying VRTSfspro.tar.gz to cluster2 ................................................................. Done 36 of 147 steps
Installing VRTSvxfen 4.0 on cluster1 ................................................................. Done 37 of 147 steps
Installing VRTSfspro 4.0 on cluster2 ................................................................. Done 38 of 147 steps
Copying VRTSalloc.tar.gz to cluster2 ................................................................. Done 39 of 147 steps
Installing VRTSvcs 4.0 on cluster1 ................................................................... Done 40 of 147 steps
Installing VRTSvcsmg 4.0 on cluster1 ................................................................. Done 41 of 147 steps
Installing VRTSvcsag 4.0 on cluster1 ................................................................. Done 42 of 147 steps
Installing VRTSvcsmn 4.0 on cluster1 ................................................................. Done 43 of 147 steps
Installing VRTScspro 4.0 on cluster1 ................................................................. Done 44 of 147 steps
Installing VRTSvcsdc 4.0 on cluster1 ................................................................. Done 45 of 147 steps
Installing VRTSalloc 4.0 on cluster2 ................................................................. Done 46 of 147 steps
Copying VRTSddlpr.tar.gz to cluster2 ................................................................. Done 47 of 147 steps
Installing VRTSddlpr 4.0 on cluster2 ................................................................. Done 48 of 147 steps
Installing VRTSjre 1.4 on cluster1 ................................................................... Done 49 of 147 steps
Installing VRTScutil 4.0 on cluster1 ................................................................. Done 50 of 147 steps
Copying VRTSvxfs.tar.gz to cluster2 .................................................................. Done 51 of 147 steps
Installing VRTScssim 4.0 on cluster1 ................................................................. Done 52 of 147 steps
Installing VRTScscw 4.0 on cluster1 .................................................................. Done 53 of 147 steps
Installing VRTSweb 4.0 on cluster1 ................................................................... Done 54 of 147 steps
Installing VRTSvcsw 4.0 on cluster1 .................................................................. Done 55 of 147 steps
Installing VRTScscm 4.0 on cluster1 .................................................................. Done 56 of 147 steps
Installing VRTScavf 4.0 on cluster1 .................................................................. Done 57 of 147 steps
Installing VRTSglm 4.0 on cluster1 ................................................................... Done 58 of 147 steps
Installing VRTSgms 4.0 on cluster1 ................................................................... Done 59 of 147 steps
Installing VRTSodm 4.0 on cluster1 ................................................................... Done 60 of 147 steps
Installing VRTSvxfs 4.0 on cluster2 .................................................................. Done 61 of 147 steps
Copying VRTStep.tar.gz to cluster2 ................................................................... Done 62 of 147 steps
Installing VRTStep 1.20.025 on cluster2 .............................................................. Done 63 of 147 steps
Copying VRTSap.tar.gz to cluster2 .................................................................... Done 64 of 147 steps
Installing VRTSap 2.00.015 on cluster2 ............................................................... Done 65 of 147 steps
Copying VRTSfppm.tar.gz to cluster2 .................................................................. Done 66 of 147 steps
Installing VRTSvail 4.0.0 on cluster1 ................................................................ Done 67 of 147 steps
Installing VRTSfppm 4.0 on cluster2 .................................................................. Done 68 of 147 steps
Installing VRTSdbac 4.0 on cluster1 .................................................................. Done 69 of 147 steps
Copying VRTSfsman.tar.gz to cluster2 ................................................................. Done 70 of 147 steps
Installing VRTSracdc 4.0 on cluster1 ................................................................. Done 71 of 147 steps
Installing VRTSvcsor 4.0 on cluster1 ................................................................. Done 72 of 147 steps
Installing VRTScsocw 4.0 on cluster1 ................................................................. Done 73 of 147 steps
Installing VRTSvcsvr 4.0 on cluster1 ................................................................. Done 74 of 147 steps
Installing VRTSdbckp 4.0 on cluster1 ................................................................. Done 75 of 147 steps
Installing VRTSfsman 4.0 on cluster2 ................................................................. Done 76 of 147 steps
Installing VRTSvxmsa 4.0 on cluster1 ................................................................. Done 77 of 147 steps
Copying VRTSfsdoc.tar.gz to cluster2 ................................................................. Done 78 of 147 steps
Installing VRTSfsdoc 4.0 on cluster2 ................................................................. Done 79 of 147 steps
Copying VRTSllt.tar.gz to cluster2 ................................................................... Done 80 of 147 steps
Adding patch 115209-05 on cluster1 ................................................................... Done 81 of 147 steps
Installing VRTSllt 4.0 on cluster2 ................................................................... Done 82 of 147 steps
Copying VRTSgab.tar.gz to cluster2 ................................................................... Done 83 of 147 steps
Adding patch 115212-05 on cluster1 ................................................................... Done 84 of 147 steps
Adding patch 115210-05 on cluster1 ................................................................... Done 85 of 147 steps
Installing VRTSgab 4.0 on cluster2 ................................................................... Done 86 of 147 steps
Copying VRTSvxfen.tar.gz to cluster2 ................................................................. Done 87 of 147 steps
Installing VRTSvxfen 4.0 on cluster2 ................................................................. Done 88 of 147 steps
Copying VRTSvcs.tar.gz to cluster2 ................................................................... Done 89 of 147 steps
Installing VRTSvcs 4.0 on cluster2 ................................................................... Done 90 of 147 steps
Copying VRTSvcsmg.tar.gz to cluster2 ................................................................. Done 91 of 147 steps
Installing VRTSvcsmg 4.0 on cluster2 ................................................................. Done 92 of 147 steps
Adding patch 115217-01 on cluster1 ................................................................... Done 93 of 147 steps
Copying VRTSvcsag.tar.gz to cluster2 ................................................................. Done 94 of 147 steps
Installing VRTSvcsag 4.0 on cluster2 ................................................................. Done 95 of 147 steps
Copying VRTSvcsmn.tar.gz to cluster2 ................................................................. Done 96 of 147 steps
Installing VRTSvcsmn 4.0 on cluster2 ................................................................. Done 97 of 147 steps
Copying VRTScspro.tar.gz to cluster2 ................................................................. Done 98 of 147 steps
Installing VRTScspro 4.0 on cluster2 ................................................................. Done 99 of 147 steps
Copying VRTSvcsdc.tar.gz to cluster2 ................................................................ Done 100 of 147 steps
Installing VRTSvcsdc 4.0 on cluster2 ................................................................ Done 101 of 147 steps
Copying VRTSjre.tar.gz to cluster2 .................................................................. Done 102 of 147 steps
Installing VRTSjre 1.4 on cluster2 .................................................................. Done 103 of 147 steps
Copying VRTScutil.tar.gz to cluster2 ................................................................ Done 104 of 147 steps
Installing VRTScutil 4.0 on cluster2 ................................................................ Done 105 of 147 steps
Copying VRTScssim.tar.gz to cluster2 ................................................................ Done 106 of 147 steps
Installing VRTScssim 4.0 on cluster2 ................................................................ Done 107 of 147 steps
Copying VRTScscw.tar.gz to cluster2 ................................................................. Done 108 of 147 steps
Installing VRTScscw 4.0 on cluster2 ................................................................. Done 109 of 147 steps
Copying VRTSweb.tar.gz to cluster2 .................................................................. Done 110 of 147 steps
Installing VRTSweb 4.0 on cluster2 .................................................................. Done 111 of 147 steps
Copying VRTSvcsw.tar.gz to cluster2 ................................................................. Done 112 of 147 steps
Installing VRTSvcsw 4.0 on cluster2 ................................................................. Done 113 of 147 steps
Copying VRTScscm.tar.gz to cluster2 ................................................................. Done 114 of 147 steps
Installing VRTScscm 4.0 on cluster2 ................................................................. Done 115 of 147 steps
Copying VRTScavf.tar.gz to cluster2 ................................................................. Done 116 of 147 steps
Installing VRTScavf 4.0 on cluster2 ................................................................. Done 117 of 147 steps
Copying VRTSglm.tar.gz to cluster2 .................................................................. Done 118 of 147 steps
Installing VRTSglm 4.0 on cluster2 .................................................................. Done 119 of 147 steps
Copying VRTSgms.tar.gz to cluster2 .................................................................. Done 120 of 147 steps
Installing VRTSgms 4.0 on cluster2 .................................................................. Done 121 of 147 steps
Copying VRTSodm.tar.gz to cluster2 .................................................................. Done 122 of 147 steps
Installing VRTSodm 4.0 on cluster2 .................................................................. Done 123 of 147 steps
Copying VRTSvail.tar.gz to cluster2 ................................................................. Done 124 of 147 steps
Installing VRTSvail 4.0.0 on cluster2 ............................................................... Done 125 of 147 steps
Copying VRTSdbac.tar.gz to cluster2 ................................................................. Done 126 of 147 steps
Installing VRTSdbac 4.0 on cluster2 ................................................................. Done 127 of 147 steps
Copying VRTSracdc.tar.gz to cluster2 ................................................................ Done 128 of 147 steps
Installing VRTSracdc 4.0 on cluster2 ................................................................ Done 129 of 147 steps
Copying VRTSvcsor.tar.gz to cluster2 ................................................................ Done 130 of 147 steps
Installing VRTSvcsor 4.0 on cluster2 ................................................................ Done 131 of 147 steps
Copying VRTScsocw.tar.gz to cluster2 ................................................................ Done 132 of 147 steps
Installing VRTScsocw 4.0 on cluster2 ................................................................ Done 133 of 147 steps
Copying VRTSvcsvr.tar.gz to cluster2 ................................................................ Done 134 of 147 steps
Installing VRTSvcsvr 4.0 on cluster2 ................................................................ Done 135 of 147 steps
Copying VRTSdbckp.tar.gz to cluster2 ................................................................ Done 136 of 147 steps
Installing VRTSdbckp 4.0 on cluster2 ................................................................ Done 137 of 147 steps
Copying VRTSvxmsa.tar.gz to cluster2 ................................................................ Done 138 of 147 steps
Installing VRTSvxmsa 4.0 on cluster2 ................................................................ Done 139 of 147 steps
Copying patch 115209-05 to cluster2 ................................................................. Done 140 of 147 steps
Adding patch 115209-05 on cluster2 .................................................................. Done 141 of 147 steps
Copying patch 115212-05 to cluster2 ................................................................. Done 142 of 147 steps
Adding patch 115212-05 on cluster2 .................................................................. Done 143 of 147 steps
Copying patch 115210-05 to cluster2 ................................................................. Done 144 of 147 steps
Adding patch 115210-05 on cluster2 .................................................................. Done 145 of 147 steps
Copying patch 115217-01 to cluster2 ................................................................. Done 146 of 147 steps
Adding patch 115217-01 on cluster2 .................................................................. Done 147 of 147 steps
Storage Foundation for Oracle RAC installation completed successfully.
Press [Return] to continue:
The enclosure-based naming scheme is a feature of Volume Manager. It allows one to reference disks using a symbolic name that is
more meaningful than the operating system's normal device access name. This symbolic name is typically derived from the array
name.
Evaluating which systems can be configured for the enclosure-based naming scheme...
System cluster1 is eligible -- can configure.
System cluster2 is eligible -- can configure.
Do you want to set up the enclosure-based naming scheme? [y,n,q,?] (n)
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Configuring Storage Foundation for Oracle RAC:
Creating Cluster Server configuration files .......................................................................... Done
Copying configuration files to cluster1 .............................................................................. Done
Copying configuration files to cluster2 .............................................................................. Done
Storage Foundation for Oracle RAC configured successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Do you want to start Storage Foundation for Oracle RAC processes now? [y,n,q] (y)
Starting SFRAC:
Starting LLT on cluster1 .......................................................................................... Started
Starting LLT on cluster2 .......................................................................................... Started
Starting GAB on cluster1 .......................................................................................... Started
Starting GAB on cluster2 .......................................................................................... Started
Starting Cluster Server on cluster1 ............................................................................... Started
Checking SFRAC drivers on cluster1 ................................................................................ Checked
Starting SFRAC drivers on cluster1 ................................................................................ Started
Starting Cluster Server on cluster2 ............................................................................... Started
Checking SFRAC drivers on cluster2 ................................................................................ Checked
Starting SFRAC drivers on cluster2 ................................................................................ Started
Confirming SFRAC startup ................................................................................ 2 systems RUNNING
Evaluating which systems can now be started...
System cluster1 is eligible -- can be started.
System cluster2 is eligible -- can be started.
Preparing to start VxVM on target systems...
Begin starting VxVM on system cluster1
Disabling enclosure-based naming ..................................................................................... Done
Starting vxconfigd for VxVM ..................................................................................... Succeeded
Done starting VxVM on system cluster1
Begin starting VxVM on system cluster2
Disabling enclosure-based naming ..................................................................................... Done
Starting vxconfigd for VxVM ..................................................................................... Succeeded
Done starting VxVM on system cluster2
Done with starting VxVM on target systems...
Press [Return] to continue:
Configuring CFS agents for SFRAC:
Confirming VxVM configuration daemons startup ......................................................... All systems Enabled
Starting CFS agents ............................................................................................... Started
Full activation of Cluster Manager, Cluster Volume Manager,
and Cluster File System requires a reboot on All Systems.
Execute /usr/sbin/shutdown -y -i6 -g0 to properly restart your systems
Many Volume Manager commands affect the contents or configuration of a disk group. Such commands require that the user specify a
disk group. This is accomplished by using the -g option of a command or setting the VXVM_DEFAULTDG environment variable. An
alternative to these two methods is to configure the default disk group of a system.
Evaluating which systems can now have their default disk group configured...
System cluster1 is eligible -- can set the default disk group.
System cluster2 is eligible -- can set the default disk group.
Do you want to set up the default disk group for each system? [y,n,q,?] (y)
Will you specify one disk group name for all eligible systems? [y,n,q,?] (y)
Specify a default disk group for all systems or type 'l' to display a listing of existing disk group(s). [?] l
No previous disk group(s) were detected.
Specify a default disk group for all systems or type 'l' to display a listing of existing disk group(s). [?] 9iRac
You have decided to specify the default disk groups as follows:
Host: cluster1 .......................................................................................... Disk group: 9iRac
Host: cluster2 .......................................................................................... Disk group: 9iRac
Note: If 'nodg' is displayed, then the host will be configured to have no default disk group.
Is this correct? [y,n,q] (y)
Setting default diskgroup to 9iRac on cluster1 ....................................................................... Done
Setting default diskgroup to 9iRac on cluster2 ....................................................................... Done
Preparing to start daemons on target systems...
Starting vxcached on cluster1 ..................................................................................... Success
Starting vxcached on cluster2 ..................................................................................... Success
Storage Foundation for Oracle RAC was started successfully.
Press [Return] to continue:
VERITAS STORAGE FOUNDATION FOR ORACLE RAC 4.0 INSTALLATION PROGRAM
Installation of Storage Foundation for Oracle RAC 4.0 has completed successfully.
The installation summary is saved at:
/opt/VRTS/install/logs/installer902153656.summary
The installer log is saved at:
/opt/VRTS/install/logs/installer902153656.log
The installation response file is saved at:
/opt/VRTS/install/logs/installer902153656.response
#
至此安装完成
下面是安装管理GUI的过程
# ./installer
VERITAS Cluster File Solutions 4.0
Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.
VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.
VERITAS Cluster File Solutions 4.0
VERITAS Product Version Installed Licensed
===========================================================================
Storage Foundation for Cluster File System 4.0 yes
Storage Foundation for Oracle RAC 4.0 yes
Enterprise Administrator GUI 3.2.514.0
Selection Menu:
I) Install/Upgrade a Product C) Configure an Installed Product
L) License a Product P) Perform a Preinstallation Check
U) Uninstall a Product D) View a Product Description
Q) Quit ?) Help
Enter a Selection: [I,C,L,P,U,D,Q,?] I
VERITAS Cluster File Solutions 4.0
1) VERITAS Storage Foundation for Cluster File System
2) VERITAS Storage Foundation for Oracle RAC
3) VERITAS Enterprise Administrator GUI
B) Back to previous menu
Select a product to install: [1-3,b,q] 3
VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM
Copyright (c) 2004 VERITAS Software Corporation. All rights reserved.
VERITAS, the VERITAS Logo and all other VERITAS product names and slogans are trademarks or registered trademarks of VERITAS
Software Corporation. VERITAS and the VERITAS Logo Reg. U.S. Pat. & Tm. Off. Other product names and/or slogans mentioned herein
may be trademarks or registered trademarks of their respective companies.
Enter the system names separated by spaces on which to install VEA GUI: cluster1 cluster2
Checking system communication:
Checking OS version on cluster1 ................................................................................. SunOS 5.9
Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
Verifying communication with cluster2 ..................................................................... ping successful
Attempting rsh with cluster2 ............................................................................... rsh successful
Attempting rcp with cluster2 ............................................................................... rcp successful
Checking OS version on cluster2 ................................................................................. SunOS 5.9
Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
Creating log directory on cluster2 ................................................................................... Done
Logs for installer are being created in /var/tmp/installer902160337.
Using /usr/bin/rsh and /usr/bin/rcp to communicate with remote systems.
Initial system check completed successfully.
Press [Return] to continue:
VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM
Checking system installation requirements:
Checking VEA GUI installation requirements on cluster1:
Checking VRTScpi package .......................................................................... version 4.0.5 installed
Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
Checking VERITAS patch 115210 ......................................................................... 115210-05 installed
Checking for any Solaris patch issues ................................................................................ None
Checking VEA GUI installation requirements on cluster2:
Checking VRTScpi package .......................................................................... version 4.0.5 installed
Checking VRTSobgui package .................................................................... version 3.2.514.0 installed
Checking VERITAS patch 115210 ......................................................................... 115210-05 installed
Checking for any Solaris patch issues ................................................................................ None
Installation requirement checks completed successfully.
Press [Return] to continue:
VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM
VERITAS ENTERPRISE ADMINISTRATOR GUI 4.0 INSTALLATION PROGRAM
VEA GUI packages can be installed on systems consecutively or simultaneously. Installing packages on systems consecutively takes
more time but allows for better error handling.
Would you like to install Enterprise Administrator GUI packages on all systems simultaneously? [y,n,q,?] (y)
Installing Enterprise Administrator GUI 4.0 on all systems simultaneously:
All VEA GUI packages are already installed.
The installer log is saved at:
/opt/VRTS/install/logs/installer902160337.log
#
# reboot
Sep 2 16:46:07 cluster1 reboot: rebooted by root
Sep 2 16:46:07 cluster1 gab: GAB INFO V-15-1-20032 Port h closed
Sep 2 16:46:07 /usr/lib/snmp/snmpdx: received signal 15
Sep 2 16:46:07 rpcbind: rpcbind terminating on signal.
Sep 2 16:46:07 EV_AGENT[285]: Signal TERM received
Sep 2 16:46:07 cluster1 syslogd: going down on signal 15
syncing file systems... done
rebooting...
SC Alert: Host System has Reset
Sun Fire V210, No Keyboard
Copyright 1998-2002 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.8.2, 4096 MB memory installed, Serial #54274573.
Ethernet address 0:3:ba:3c:2a:d, Host ID: 833c2a0d.
Rebooting with command: boot
Boot device: disk File and args:
SunOS Release 5.9 Version Generic_117171-07 64-bit
Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
NOTICE:
Emulex LightPulse FC SCSI/IP 6.01c
NOTICE: lpfc0: Firmware Rev 3.90A7 (C2D3.90A7)
NOTICE: lpfc0: WWPN:10:00:00:00:c9:3d:cf:d3 WWNN:20:00:00:00:c9:3d:cf:d3 DID 0x10a00
WARNING: /pci@1d,700000/fibre-channel@1/sd@0,0 (sd30):
Corrupt label; wrong magic number
Hardware watchdog enabled
Error: All paths to 6006016028A61000C2BDC4C591D4D811 are dead.
Error: 6006016028A61000C2BDC4C591D4D811 is dead.
Error: All paths to 6006016028A610009A75213E91D4D811 are dead.
Error: 6006016028A610009A75213E91D4D811 is dead.
Error: All paths to 6006016028A61000F42A89D591D4D811 are dead.
Error: 6006016028A61000F42A89D591D4D811 is dead.
Error: All paths to 6006016028A61000F075BD4E93D4D811 are dead.
Error: 6006016028A61000F075BD4E93D4D811 is dead.
Error: All paths to 60060160D2A91000AE22B826A6DED811 are dead.
Error: 60060160D2A91000AE22B826A6DED811 is dead.
Error: All paths to 6006016028A610005035CED392D4D811 are dead.
Error: 6006016028A610005035CED392D4D811 is dead.
Error: All paths to 6006016028A61000C65024C992D4D811 are dead.
Error: 6006016028A61000C65024C992D4D811 is dead.
VxVM sysboot INFO V-5-2-3244 Starting restore daemon...
VxVM sysboot INFO V-5-2-3445 starting in boot mode...
NOTICE: VxVM vxdmp V-5-0-34 added disk array DISKS, datype = Disk
configuring IPv4 interfaces: bge0ifconfig: setifflags: SIOCSLIFFLAGS: lpfc0: Cannot assign requested address
lpfc0.
Setting netmask of lpfc0 to 255.255.255.0
ifconfig: setifflags: SIOCSLIFFLAGS: lpfc0: Cannot assign requested address
Hostname: cluster1
Configuring /dev and /devices
LLT INFO V-14-1-10009 LLT Protocol available
GAB INFO V-15-1-20021 GAB available
LMX Multiplexor available
Configuring the /dev directory (compatibility devices)
Setting up paths
VxVM vxvm-startup2 INFO V-5-2-503 VxVM general startup...
The system is coming up. Please wait.
checking ufs filesystems
/dev/rdsk/c0t0d0s5: is logging.
/dev/rdsk/c0t0d0s7: is logging.
Starting LLT...
Starting LLT done.
Starting LMX
starting rpc services: rpcbind done.
Setting netmask of bge0 to 255.255.255.0
Setting default IPv4 interface for multicast: add net 224.0/4: gateway cluster1
syslog service starting.
Starting Navisphere Agent
Starting GAB...
Sep 2 16:48:45 cluster1 gab: GAB INFO V-15-1-20026 Port a registration waiting for seed port membership
Starting GAB done.
Starting ODM...
Sep 2 16:48:46 cluster1 llt: LLT INFO V-14-1-10024 link 1 (bge2) node 1 active
Sep 2 16:48:46 cluster1 llt: LLT INFO V-14-1-10024 link 0 (bge1) node 1 active
Sep 2 16:48:46 cluster1 gab: GAB INFO V-15-1-20026 Port d registration waiting for seed port membership
Starting vxfen..
Starting vxfen.. Done
Starting VCSMM
Sep 2 16:48:48 cluster1 gab: GAB INFO V-15-1-20026 Port o registration waiting for seed port membership
VCS FEN vxfenconfig NOTICE Driver will be disabled.
Sep 2 16:48:48 cluster1 gab: GAB INFO V-15-1-20026 Port b registration waiting for seed port membership
Sep 2 16:48:50 cluster1 gab: GAB INFO V-15-1-20036 Port d gen 2a9201 membership 01
Sep 2 16:48:50 cluster1 gab: GAB INFO V-15-1-20036 Port a gen 2a9202 membership 01
volume management starting.
The system is ready.
cluster1 console login: Sep 2 16:48:55 cluster1 gab: GAB INFO V-15-1-20036 Port o gen 2a9204 membership 01
Sep 2 16:48:55 cluster1 gab: GAB INFO V-15-1-20036 Port b gen 2a9205 membership 01
Sep 2 16:48:55 cluster1 vcsmm: VCS RAC INFO V-10-1-15047 plat_reconfig_ioctl: dev_ioctl failed, vxfen may not be configured
Sep 2 16:48:55 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-35 Fencing driver going into RUNNING state
VCS NOTICE V-16-1-10619 'HAD' starting on: cluster1
VCS NOTICE V-16-1-10620 Waiting for local cluster configuration status
VCS NOTICE V-16-1-10625 Local cluster configuration valid
VCS NOTICE V-16-1-11034 Registering for cluster membership
VCS NOTICE V-16-1-11035 Waiting for cluster membership
Sep 2 16:49:03 cluster1 gab: GAB INFO V-15-1-20036 Port h gen 2a9205 membership 01
VCS INFO V-16-1-10077 Received new cluster membership
VCS NOTICE V-16-1-10082 System (cluster1) is in Regular Membership - Membership: 0x3
VCS NOTICE V-16-1-10082 System () is in Regular Membership - Membership: 0x3
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS ERROR V-16-1-50129 Operation 'hares -modify' rejected as the node is in CURRENT_DISCOVER_WAIT state
VCS NOTICE V-16-1-10075 Building from remote system
VCS NOTICE V-16-1-10066 Entering RUNNING state
Sep 2 16:49:07 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-34 The ioctl VXFEN_IOC_CLUSTSTAT returned 0
Sep 2 16:49:11 cluster1 gab: GAB INFO V-15-1-20036 Port u gen 2a9207 membership 01
Sep 2 16:49:11 cluster1 gab: GAB INFO V-15-1-20032 Port u closed
Sep 2 16:49:11 cluster1 vxio: WARNING: VxVM vxio V-5-0-360 volcvm_vxnodeid_daemon:cluster join failed: error 11
Sep 2 16:49:17 cluster1 vxfen: NOTICE: VCS FEN INFO V-11-1-34 The ioctl VXFEN_IOC_CLUSTSTAT returned 0
Sep 2 16:49:25 cluster1 gab: GAB INFO V-15-1-20036 Port u gen 2a9209 membership 0
Sep 2 16:49:25 cluster1 gab: GAB INFO V-15-1-20038 Port u gen 2a9209 k_jeopardy ;1
Sep 2 16:49:25 cluster1 gab: GAB INFO V-15-1-20040 Port u gen 2a9209 visible ;1
Sep 2 16:49:30 cluster1 gab: GAB INFO V-15-1-20036 Port v gen 2a920a membership 01
Sep 2 16:49:35 cluster1 gab: GAB INFO V-15-1-20036 Port w gen 2a920c membership 01
Sep 2 16:49:36 cluster1 gab: GAB INFO V-15-1-20032 Port u closed
Sep 2 16:49:44 cluster1 gab: GAB INFO V-15-1-20036 Port q gen 2a920e membership 01
Sep 2 16:49:46 cluster1 gab: GAB INFO V-15-1-20036 Port f gen 2a9210 membership 01
cluster1 console login:
#./installer –rsh –installonly
#./installsfrac –rsh –configure
Configure I/O Fencing
Test disk
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw –n
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw –c vxfencoorddg
Creating the vxfencoorddg Disk Group
# vxdg –coordinator=on init vxfencoorddg c1t1d0
# vxdg -g vxfencoorddg adddisk c2t1d0
# vxdg -g vxfencoorddg adddisk c3t1d0
Test DiskGroup
# /opt/VRTSvcs/vxfen/bin/vxfentsthdw -c vxfencoorddg
# vxdg deport vxfencoorddg
# vxdg -t import vxfencoorddg
# vxdg deport vxfencoorddg
# echo "vxfencoorddg" > /etc/vxfendg
# haconf -dump –makero
# hastop –all
# cd /etc/VRTSvcs/conf/config
# cp main.cf main.orig
#vi main.cf
cluster rac_cluster1 (
UserNames = { admin = "cDRpdxPmHpzS." }
Administrators = { admin }
HacliUserLevel = COMMANDROOT
CounterInterval = 5
UseFence = SCSI3
)
# cp /etc/vxfen.d/vxfenmode_scsi3_dmp /etc/vxfenmode
# vxfenadm -d
# /sbin/gabconfig -a
GAB Port Memberships ========================================================
Port a gen 4a1c0001 membership 01
Port b gen g8ty0002 membership 01
Port d gen 40100001 membership 01
Port f gen f1990002 membership 01
Port h gen d8850002 membership 01
Port o gen f1100002 membership 01
Port q gen 28d10002 membership 01
Port v gen 1fc60002 membership 01
Port w gen 15ba0002 membership 01
6.配置共享磁盘
1).创建磁盘组
# vxdiskadm
Volume Manager Support Operations
Menu: VolumeManager/Disk
1 Add or initialize one or more disks
2 Encapsulate one or more disks
3 Remove a disk
4 Remove a disk for replacement
5 Replace a failed or removed disk
6 Mirror volumes on a disk
7 Move volumes from a disk
8 Enable access to (import) a disk group
9 Remove access to (deport) a disk group
10 Enable (online) a disk device
11 Disable (offline) a disk device
12 Mark a disk as a spare for a disk group
13 Turn off the spare flag on a disk
14 Unrelocate subdisks back to a disk
15 Exclude a disk from hot-relocation use
16 Make a disk available for hot-relocation use
17 Prevent multipathing/Suppress devices from VxVM's view
18 Allow multipathing/Unsuppress devices from VxVM's view
19 List currently suppressed/non-multipathed devices
20 Change the disk naming scheme
21 Get the newly connected/zoned disks in VxVM view
22 Change/Display the default disk layouts
23 Mark a disk as allocator-reserved for a disk group
24 Turn off the allocator-reserved flag on a disk
list List disk information
? Display help about menu
?? Display help about the menuing system
q Exit from menus
Select an operation to perform: 1
Add or initialize disks
Menu: VolumeManager/Disk/AddDisks
Use this operation to add one or more disks to a disk group. You can
add the selected disks to an existing disk group or to a new disk group
that will be created as a part of the operation. The selected disks may
also be added to a disk group as spares. Or they may be added as
nohotuses to be excluded from hot-relocation use. The selected
disks may also be initialized without adding them to a disk group
leaving the disks available for use as replacement disks.
More than one disk or pattern may be entered at the prompt. Here are
some disk selection examples:
all: all disks
c3 c4t2: all disks on both controller 3 and controller 4, target 2
c3t4d2: a single disk (in the c#t#d# naming scheme)
xyz_0 : a single disk (in the enclosure based naming scheme)
xyz_ : all disks on the enclosure whose name is xyz
Select disk devices to add: [,all,list,q,?] list
DEVICE DISK GROUP STATUS
c0t0d0 - - online invalid
c0t1d0 - - online invalid
c2t0d2 - - online
Select disk devices to add: [,all,list,q,?] c2t0d2
Here is the disk selected. Output format: [Device_Name]
c2t0d2
Continue operation? [y,n,q,?] (default: y)
You can choose to add this disk to an existing disk group, a
new disk group, or leave the disk available for use by future
add or replacement operations. To create a new disk group,
select a disk group name that does not yet exist. To leave
the disk available for future use, specify a disk group name
of "none".
Which disk group [,none,list,q,?] (default: 9iRac) oradg
There is no active disk group named oradg.
Create a new group named oradg? [y,n,q,?] (default: y)
Create the disk group as a CDS disk group? [y,n,q,?] (default: y)
Use a default disk name for the disk? [y,n,q,?] (default: y)
Add disk as a spare disk for oradg? [y,n,q,?] (default: n)
Exclude disk from hot-relocation use? [y,n,q,?] (default: n)
A new disk group will be created named oradg and the selected disks
will be added to the disk group with default disk names.
c2t0d2
Continue with operation? [y,n,q,?] (default: y)
The following disk device appears to have been initialized already.
The disk is currently available as a replacement disk.
Output format: [Device_Name]
c2t0d2
Use this device? [y,n,q,?] (default: y)
The following disk you selected for use appears to already have
been initialized for the Volume Manager. If you are certain the
disk has already been initialized for the Volume Manager, then you
do not need to reinitialize the disk device.
Output format: [Device_Name]
c2t0d2
Reinitialize this device? [y,n,q,?] (default: y)
Initializing device c2t0d2.
Enter desired private region length
[,q,?] (default: 2048)
VxVM NOTICE V-5-2-120
Creating a new disk group named oradg containing the disk
device c2t0d2 with the name oradg01.
Add or initialize other disks? [y,n,q,?] (default: n)
Volume Manager Support Operations
Menu: VolumeManager/Disk
1 Add or initialize one or more disks
2 Encapsulate one or more disks
3 Remove a disk
4 Remove a disk for replacement
5 Replace a failed or removed disk
6 Mirror volumes on a disk
7 Move volumes from a disk
8 Enable access to (import) a disk group
9 Remove access to (deport) a disk group
10 Enable (online) a disk device
11 Disable (offline) a disk device
12 Mark a disk as a spare for a disk group
13 Turn off the spare flag on a disk
14 Unrelocate subdisks back to a disk
15 Exclude a disk from hot-relocation use
16 Make a disk available for hot-relocation use
17 Prevent multipathing/Suppress devices from VxVM's view
18 Allow multipathing/Unsuppress devices from VxVM's view
19 List currently suppressed/non-multipathed devices
20 Change the disk naming scheme
21 Get the newly connected/zoned disks in VxVM view
22 Change/Display the default disk layouts
23 Mark a disk as allocator-reserved for a disk group
24 Turn off the allocator-reserved flag on a disk
list List disk information
? Display help about menu
?? Display help about the menuing system
q Exit from menus
Select an operation to perform: q
Goodbye.
2).设置共享磁盘组
# vxdg list
NAME STATE ID
oradg enabled,cds 1094209675.12.cluster2
# vxdg free
GROUP DISK DEVICE TAG OFFSET LENGTH FLAGS
oradg oradg01 c2t0d2s2 c2t0d2 0 244143872 -
3).通过以下方式验证主节点:
# vxclustadm -v nodestate
state: cluster member
nodeId=1
masterId=1 --这就是主节点id
neighborId=0
members=0x3
joiners=0x0
leavers=0x0
reconfig_seqnum=0x2a9209
vxfen=off
# fsclustadm idtoname 1
cluster1
或者使用:
# vxdctl -c mode
mode: enabled: cluster active - SLAVE
master: cluster1
如果你的输出出现以下提示:
# ./vxclustadm -v nodestate
state: out of cluster
这说明你没有正确配置IO Fencing.我们可以通过如下方式禁用IO Fencing.
创建/etc/vxfenmode 文件
增加一行:
vxfen_mode=disabled
重起Cluster既可.
4).在master节点上进行以下操作
# vxdg deport oradg
# vxdg -s import oradg
# vxdg list
NAME STATE ID
oradg enabled,shared,cds 1094209675.12.cluster2
#
5).此时在另外节点上
应该可以看到此共享磁盘组
# vxdg list
NAME STATE ID
oradg enabled,shared,cds 1094209675.12.cluster2
# hostname
cluster1
#
7.修改系统内核参数
为安装Oracle做准备
在/etc/system文件末尾追加以下参数,两台主机都需要修改:
* kernal parameter for Oracle database add by:gqgai
set shmsys:shminfo_shmmax=4294967295
set shmsys:shminfo_shmmin=1
set shmsys:shminfo_shmmni=100
set shmsys:shminfo_shmseg=10
set semsys:seminfo_semmni=1024
set semsys:seminfo_semmsl=1510
set semsys:seminfo_semmns=3010
set semsys:seminfo_semopm=100
set semsys:seminfo_semvmx=32767
修改后重新启动主机
8.划分磁盘空间,安装前的准备
Directory Component
/app Mountpoint for Oracle/CRS binaries
/app/crshome CRS_HOME
/app/oracle ORACLE_BASE
/app/oracle/home ORACLE_HOME
/ocrvote Mountpoint for OCR/Vote
/oradata Mountpoint for Oracle database
#chown –R oracle:dba /app
#chown –R oracle:dba /app/crshome
#chown –R oracle:dba /app/oracle
#chown –R oracle:dba /app/oracle/home
#chown –R oracle:dba /app/ocrvote
#chown –R oracle:dba /oradata
Creating OCR and VOTE-disk volumes
#vxdg –s init ocrvotedg ocrvotedg01=Disk_1
#vxassist –g ocrvotedg make ocrvotevol 1g
#mkfs –F vxfs /dev/vx/rdsk/ocrvotedg/ocrvotevol
#mount –F vxfs –o cluster /dev/vx/dsk/ocrvotedg/ocrvotevol /ocrvote
#rsh b100b mount –F vxfs –o cluster /dev/vx/dsk/ocrvotedg/ocrvotevol /ocrvote
#cd /ocrvote
#touch ocr vote
#chown –R oracle:dba ocr vote
ADD OCR to VCS
#hares –add ocrvote_mnt CFSMount cvm
#hares –modify ocrvote_mnt Critical 0
#hares –modify ocrvote_mnt MountPoint “/ocrvote”
#hares –modify ocrvote_mnt BlockDevice “/dev/vx/dsk/ocrvotedg/ocrvotevol”
#hares –add ocrvote_voldg CVMVolDg cvm
#hares –modify ocrvote_voldg CVMDiskGroup ocrvotedg
#hares –modify ocrvote_voldg CVMVolume –add ocrvotevol
#hares –modify ocrvote_voldg CVMActivation sw
#hares -add cssd Application cvm
#hares -modify cssd StartProgram /opt/VRTSvcs/rac/bin/cssd-online
#hares -modify cssd StopProgram /opt/VRTSvcs/rac/bin/cssd-offline
#hares -modify cssd CleanProgram /opt/VRTSvcs/rac/bin/cssd-clean
#hares -modify cssd MonitorProgram /opt/VRTSvcs/rac/bin/cssd-monitor
#hares –link ocrvote_mnt ocrvote_voldg
#hares –link ocrvote_mnt vxfsckd
#hares –link ocrvote_voldg cvm_clus
#hares –link cssd cssd ora_priv
#hares –link cssd cssd ocrvote_mnt
#hares –modify ocrvote_voldg Enabled 1
#hares –modify ocrvote_mnt Enabled 1
#haconf –dump –makero
Installing CRS
#cd /opt/VRTS/install/
#./installsfrac –rsh –configure
Veritas Storage Foundation for Oracle RAC 5.0 Configuration Program
Main Menu
1) Check systems for SFRAC ** INSTRUCTIONS ONLY **
2) Configure SFRAC
3) Prepare to install Oracle
4) Install or relink Oracle
Select an option [1-4,q,?] 3
#./$CRS_HOME/bin/vipca
Installing Oracle
Veritas Storage Foundation for Oracle RAC 5.0 Configuration Program
Main Menu
1) Check systems for SFRAC ** INSTRUCTIONS ONLY **
2) Configure SFRAC
3) Prepare to install Oracle
4) Install or relink Oracle
Select an option [1-4,q,?] 4
ADD Oracle Aagent to VCS
group OracleRAC (
SystemList = { b1000a = 0, b1000b = 1 }
Parallel = 1
)
CFSMount oradata_mnt (
Critical = 0
MountPoint = "/oradata"
BlockDevice = "/dev/vx/dsk/oradg/oradgvol"
)
CVMVolDg oradata_voldg (
Critical = 0
CVMDiskGroup = oradg
CVMActivation = sw
)
Netlsnr ora_lsnr (
Critical = 0
Owner = oracle
Home = "/app/oracle/home"
TnsAdmin = "/app/oracle/home/network/admin/tnsnames.ora"
Listener = LISTENER
)
Oracle oracle (
Critical = 0
Sid @b1000a = ora1
Sid @b1000b = ora2
Owner = oracle
Home = "/app/oracle/home"
Pfile @b1000a = "/app/oracle/home/dbs/initora1.ora"
Pfile @b1000b = "/app/oracle/home/dbs/initora2.ora"
)
ora_lsnr requires oracle
oracle requires oradata_mnt
oradata_mnt requires oradata_voldg
$srvconfig –init
$gsdctl start (2 nodes)
$netca
13.开始创建数据库
$ dbca -datafileDestination /rac_ts
创建Oracle9i Rac数据库
14,Configure Listener.ora Spfile
Create or check the file sqlnet.ora in $ORACLE_HOME/network/admin
NAMES.DEFAULT_DOMAIN = testlab.ibm.com
NAMES.DIRECTORY_PATH= (TNSNAMES)
Create or check the file listener.ora in $ORACLE_HOME/network/admin
create or check the file tnsnames.ora
$ lsnrctl start
$ lsnrctl stop
$ lsnrctl
创建Oracle9i Rac数据库
1. 设置Oracle用户环境变量
修改.profile文件,增加如下环境变量:
DBCA_RAW_CONFIG=/opt/oracle/admin/Rac9i/create/DBCA_RAW_CONFIG.txt
export DBCA_RAW_CONFIG
2.设置rsh支持
编辑.rhost文件
$ id
uid=800(oracle) gid=800(dba)
$ more $HOME/.rhosts
+
$ hostname
cluster1
$ rsh cluster2 date
Sun Sep 5 15:46:27 CST 2004FIG
.
Oracle 10G
1建立心跳线
Vi /etc/VRTSvcs/conf/config/main.cf
include "PrivNIC.cf"
vxassist -g oradg -U gen make OCRFile 256m
vxassist -g oradg -U gen make OCRFile2 256m
vxassist -g oradg -U gen make CSSFile 256m
vxassist -g oradg -U gen make CSSFile2 256m
vxassist -g oradg -U gen make CSSFile3 256m
转自：http://blog.chinaunix.net/u1/42994/showart_1218241.html