oracle 11gR2 增加节点

环境介绍：

        ORACLE 11gR2 4节点RAC系统。

        RHCE 5.5 X64平台。

先试验删节点的操作。删除节点4信息。

 

删除后重新加入节点4的信息。以下是增加节点4的oracle 软件部分。

 

1.
拷贝grid目录下的olsnodes ,crsctl 文件拷贝到oracle的目录下。
[root@lir-rac1 ~]# cp /u01/app/11.2.0.0/grid/bin/olsnodes*  /u02/app/oracle/product/11.2.0/db_1/bin/
[root@lir-rac1 ~]# cp /u01/app/11.2.0.0/grid/bin/srvctl*  /u02/app/oracle/product/11.2.0/db_1/bin/
[root@lir-rac1 ~]# cp /u01/app/11.2.0.0/grid/bin/crsctl*  /u02/app/oracle/product/11.2.0/db_1/bin/

2.

--更新列表
[oracle@lir-rac1 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=/u02/app/oracle/product/11.2.0/db_1/  "CLUSTER_NODES={lir-rac1,lir-rac2,lir-rac3}" CRS=TRUE
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 16998 MB    Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /u01/app/oraInventory
'UpdateNodeList' was successful.

 

3.

检查节点数：
[oracle@lir-rac1 bin]$ olsnodes -n
lir-rac1        1
lir-rac2        2
lir-rac3        3

4.

加oracle用户的节点信息。
[oracle@lir-rac1 bin]$ ./addNode.sh "CLUSTER_NEW_NODES={lir-rac4}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={lir-rac4-vip}"
Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 16998 MB    Passed
Checking monitor: must be configured to display at least 256 colors.    Actual 16777216    Passed
Oracle Universal Installer, Version 11.2.0.1.0 Production
Copyright (C) 1999, 2009, Oracle. All rights reserved.

Performing tests to see whether nodes lir-rac2,lir-rac3,lir-rac4 are available
............................................................... 100% Done.

.
-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
   Source: /u02/app/oracle/product/11.2.0/db_1
   New Nodes
Space Requirements
   New Nodes
      lir-rac4
         /: Required 5.11GB : Available 30.38GB
Installed Products
   Product Names
      Oracle Database 11g 11.2.0.1.0
      Sun JDK 1.5.0.17.0
      Installer SDK Component 11.2.0.1.0
      Oracle One-Off Patch Installer 11.2.0.0.2
      Oracle Universal Installer 11.2.0.1.0
      Oracle Configuration Manager Deconfiguration 10.3.1.0.0
      Oracle DBCA Deconfiguration 11.2.0.1.0
      Oracle RAC Deconfiguration 11.2.0.1.0
      Oracle Database Deconfiguration 11.2.0.1.0
      Oracle Configuration Manager 10.3.1.1.0
      Oracle ODBC Driverfor Instant Client 11.2.0.1.0
      LDAP Required Support Files 11.2.0.1.0
      SSL Required Support Files for InstantClient 11.2.0.1.0
      Bali Share 1.1.18.0.0
      Oracle Extended Windowing Toolkit 3.4.47.0.0
      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
      Oracle Real Application Testing 11.2.0.1.0
      Oracle Database Vault J2EE Application 11.2.0.1.0
      Oracle Label Security 11.2.0.1.0
      Oracle Data Mining RDBMS Files 11.2.0.1.0
      Oracle OLAP RDBMS Files 11.2.0.1.0
      Oracle OLAP API 11.2.0.1.0
      Platform Required Support Files 11.2.0.1.0
      Oracle Database Vault option 11.2.0.1.0
      Oracle RAC Required Support Files-HAS 11.2.0.1.0
      SQL*Plus Required Support Files 11.2.0.1.0
      Oracle Display Fonts 9.0.2.0.0
      Oracle Ice Browser 5.2.3.6.0
      Oracle JDBC Server Support Package 11.2.0.1.0
      Oracle SQL Developer 11.2.0.1.0
      Oracle Application Express 11.2.0.1.0
      XDK Required Support Files 11.2.0.1.0
      RDBMS Required Support Files for Instant Client 11.2.0.1.0
      SQLJ Runtime 11.2.0.1.0
      Database Workspace Manager 11.2.0.1.0
      RDBMS Required Support Files 11.2.0.1.0
      Oracle Globalization Support 11.2.0.1.0
      Exadata Storage Server 11.2.0.1.0
      Provisioning Advisor Framework 10.2.0.4.2
      Enterprise Manager Database Plugin -- Repository Support 11.2.0.1.0
      Enterprise Manager Repository Core Files 10.2.0.4.2
      Enterprise Manager Database Plugin -- Agent Support 11.2.0.1.0
      Enterprise Manager Grid Control Core Files 10.2.0.4.2
      Enterprise Manager Common Core Files 10.2.0.4.2
      Enterprise Manager Agent Core Files 10.2.0.4.2
      Agent Required Support Files 10.2.0.4.2
      regexp 2.1.9.0.0
      Parser Generator Required Support Files 11.2.0.1.0
      Oracle 11g Warehouse Builder Required Files 11.2.0.1.0
      Oracle Notification Service (eONS) 11.2.0.1.0
      Oracle Text Required Support Files 11.2.0.1.0
      Precompiler Required Support Files 11.2.0.1.0
      Oracle Database 11g Multimedia Files 11.2.0.1.0
      Oracle Multimedia Java Advanced Imaging 11.2.0.1.0
      Oracle Multimedia Annotator 11.2.0.1.0
      Oracle JDBC/OCI Instant Client 11.2.0.1.0
      Oracle Multimedia Locator RDBMS Files 11.2.0.1.0
      Oracle Core Required Support Files 11.2.0.1.0
      Oracle Help For Java 4.2.9.0.0
      Sample Schema Data 11.2.0.1.0
      Oracle Starter Database 11.2.0.1.0
      Oracle Message Gateway Common Files 11.2.0.1.0
      Oracle XML Query 11.2.0.1.0
      XML Parser for Oracle JVM 11.2.0.1.0
      Expat libraries 2.0.1.0.1
      Installation Plugin Files 11.2.0.1.0
      Enterprise Manager Common Files 10.2.0.4.2
      Perl Modules 5.10.0.0.1
      Deinstallation Tool 11.2.0.1.0
      Oracle Quality of Service Management (Client) 11.2.0.1.0
      Perl Interpreter 5.10.0.0.1
      JAccelerator (COMPANION) 11.2.0.1.0
      Oracle Containers for Java 11.2.0.1.0
      Oracle Code Editor 1.2.1.0.0I
      Oracle Net Required Support Files 11.2.0.1.0
      Secure Socket Layer 11.2.0.1.0
      Oracle Universal Connection Pool 11.2.0.1.0
      Oracle JDBC/THIN Interfaces 11.2.0.1.0
      Oracle Multimedia Client Option 11.2.0.1.0
      Oracle Java Client 11.2.0.1.0
      Character Set Migration Utility 11.2.0.1.0
      Oracle Locale Builder 11.2.0.1.0
      PL/SQL Embedded Gateway 11.2.0.1.0
      OLAP SQL Scripts 11.2.0.1.0
      Database SQL Scripts 11.2.0.1.0
      Oracle Globalization Support 11.2.0.1.0
      Required Support Files 11.2.0.1.0
      SQL*Plus Files for Instant Client 11.2.0.1.0
      Oracle ODBC Driver 11.2.0.1.0
      Oracle Database User Interface 2.2.13.0.0
      Oracle Notification Service 11.2.0.0.0
      Enterprise Manager Minimal Integration 11.2.0.1.0
      XML Parser for Java 11.2.0.1.0
      Oracle Security Developer Tools 11.2.0.1.0
      Oracle Wallet Manager 11.2.0.1.0
      Cluster Verification Utility Common Files 11.2.0.1.0
      Oracle Clusterware RDBMS Files 11.2.0.1.0
      Oracle UIX 2.2.24.5.0
      Enterprise Manager plugin Common Files 11.2.0.1.0
      HAS Common Files 11.2.0.1.0
      Precompiler Common Files 11.2.0.1.0
      Installation Common Files 11.2.0.1.0
      Oracle Help for the  Web 2.0.14.0.0
      Oracle LDAP administration 11.2.0.1.0
      Buildtools Common Files 11.2.0.1.0
      Assistant Common Files 11.2.0.1.0
      Oracle Recovery Manager 11.2.0.1.0
      PL/SQL 11.2.0.1.0
      Generic Connectivity Common Files 11.2.0.1.0
      Oracle Database Gateway for ODBC 11.2.0.1.0
      Oracle Programmer 11.2.0.1.0
      Oracle Database Utilities 11.2.0.1.0
      Enterprise Manager Agent 10.2.0.4.2
      Oracle Netca Client 11.2.0.1.0
      SQL*Plus 11.2.0.1.0
      Oracle Call Interface (OCI) 11.2.0.1.0
      Oracle Multimedia Locator 11.2.0.1.0
      Oracle Multimedia 11.2.0.1.0
      Oracle Net 11.2.0.1.0
      Database Configuration and Upgrade Assistants 11.2.0.1.0
      Oracle XML Development Kit 11.2.0.1.0
      Oracle JVM 11.2.0.1.0
      Oracle Advanced Security 11.2.0.1.0
      Oracle Internet Directory Client 11.2.0.1.0
      HAS Files for DB 11.2.0.1.0
      Oracle Enterprise Manager Console DB 11.2.0.1.0
      Oracle Net Listener 11.2.0.1.0
      Oracle Text 11.2.0.1.0
      Oracle Net Services 11.2.0.1.0
      Oracle Database 11g 11.2.0.1.0
      Oracle OLAP 11.2.0.1.0
      Oracle Spatial 11.2.0.1.0
      Oracle Partitioning 11.2.0.1.0
      Enterprise Edition Options 11.2.0.1.0
-----------------------------------------------------------------------------

Instantiating scripts for add node (Thursday, June 10, 2010 12:32:51 PM CST)
.                                                                 1% Done.
Instantiation of add node scripts complete

Copying to remote nodes (Thursday, June 10, 2010 12:32:55 PM CST)
...............................................................................................                                 96% Done.
Home copied to new nodes

Saving inventory on nodes (Thursday, June 10, 2010 12:37:28 PM CST)
.                                                               100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the "root" user in each cluster node.
/u02/app/oracle/product/11.2.0/db_1/root.sh #On nodes lir-rac4
To execute the configuration scripts:
    1. Open a terminal window
    2. Log in as "root"
    3. Run the scripts in each cluster node
   
The Cluster Node Addition of /u02/app/oracle/product/11.2.0/db_1 was successful.
Please check '/tmp/silentInstall.log' for more details.

 

5.

节点4执行root.sh脚本。
/u02/app/oracle/product/11.2.0/db_1/root.sh #On nodes lir-rac4

 

6.

[oracle@lir-rac1 bin]$ dbca  --运行DBCA增加rac4的实例。

 

7.由于之前删除节点时，没有删除实例，导致新的实例undo表空间，thread, 及redo文件的线程号都是按照节点5的信息来生成的。重新修改这些参数完成加节点操作。

 

8.附：运行DBCA加实例rac4实例时产生的日志信息。

Thu Jun 10 16:04:55 2010
CREATE SMALLFILE UNDO TABLESPACE "UNDOTBS5" DATAFILE SIZE 13030M AUTOEXTEND ON NEXT  5120K MAXSIZE  32767M BLOCKSIZE 8192
Thu Jun 10 16:06:17 2010
Completed: CREATE SMALLFILE UNDO TABLESPACE "UNDOTBS5" DATAFILE SIZE 13030M AUTOEXTEND ON NEXT  5120K MAXSIZE  32767M BLOCKSIZE 8192
ALTER DATABASE ADD LOGFILE THREAD 5 GROUP 9  SIZE 307200K,
 GROUP 10  SIZE 307200K
Completed: ALTER DATABASE ADD LOGFILE THREAD 5 GROUP 9  SIZE 307200K,
 GROUP 10  SIZE 307200K
ALTER DATABASE ENABLE THREAD 5
Completed: ALTER DATABASE ENABLE THREAD 5
ALTER SYSTEM SET instance_number=5 SCOPE=SPFILE SID='klir4';
ALTER SYSTEM SET thread=5 SCOPE=SPFILE SID='klir4';
ALTER SYSTEM SET undo_tablespace='UNDOTBS5' SCOPE=SPFILE SID='klir4';
Thu Jun 10 16:06:39 2010
Redo thread 5 internally disabled at seq 1 (CKPT)
Thu Jun 10 16:06:39 2010
ARC3: Archiving disabled thread 5 sequence 1
Archived Log entry 2259 added for thread 5 sequence 1 ID 0x38918de5 dest 1:
Archived Log entry 2260 added for thread 5 sequence 1 ID 0x38918de5 dest 2:
Thu Jun 10 16:08:16 2010
Reconfiguration started (old inc 88, new inc 90)
List of instances:
 1 2 3 5 (myinst: 1)
 Global Resource Directory frozen
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Thu Jun 10 16:08:16 2010
 LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
Thu Jun 10 16:08:16 2010
 LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
 Set master node info
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Submitted all GCS remote-cache requests
 Fix write in gcs resources
Reconfiguration complete