The most current version of this document can be obtained in My Oracle Support Knowledge Document 1375769.1.
There is a change log at the end of this document.
Note:
Section 1: Overview
1.1 Concepts and Terminology
1.2 Oracle E-Business Suite Release 12.2 Architecture
1.3 Oracle E-Business Suite Release 12.2 File System Layout for Shared Application Tier
Section 2: Planning Deployment Options
Section 3: Configuring a Shared Application Tier File System with 12.2 Rapid Install
3.1 Install the Database Tier on Node 1
3.2 Install the Primary Application Tier on Node 2
3.3 Execute the Adpreclone Utility on the Run and Patch File System
Section 4: Adding a Node to the Shared Application Tier File System
4.1 Export the Required Application Tier File System From the Primary Application Tier Node
4.2 Mount the Application Tier File System on the Secondary Application Tier Node
4.3 Add the Secondary Application Tier Node to the Farm
You can configure multiple application node machines working with a single Oracle E-Business Suite database node. This creation of a "multi-node" Oracle E-Business Suite instance is frequently done to lower cost of ownership (many small machines are cheaper than one big one), increase fault tolerance (one machine fails, others do not), or scale the instance (support more users and a greater load).
When configuring Oracle E-Business Suite to use a shared application tier file system, the application tier node can be configured to perform any of the standard application tier services, such as Forms, Web, and Concurrent Processing (Batch).
Note the following definitions:
A multi-node installation of Release 12.2 supports both shared and non-shared application tier file systems. An application tier file system consists of:
A service is a functional set of Oracle E-Business Suite application processes running on one or more nodes. Where applicable, the term 'service' replaces the more traditional term of 'server'.
The following are the major application tier services:
A primary application tier node is the first (and perhaps only) application tier node where the APPL_TOP, COMMON_TOP, OracleAS 10.1.2 Oracle Home, WebLogic and the WebTier Oracle Home are installed and configured.
A secondary application tier node is an additional application tier node where the APPL_TOP, COMMON_TOP, OracleAS 10.1.2 Oracle Home, Oracle WebLogic Server and WebTier Oracle Homes are visible and configured.
The APPL_TOP, COMMON_TOP, OracleAS 10.1.2 Oracle Home, Oracle WebLogic Server, and WebTier Oracle Home file systems are mounted on this node either from the primary application tier node or from an NFS server.
The Instance Home is the top-level directory that contains all the instance specific files associated with an application tier node (APPL_TOP and OracleAS 10.1.2 Oracle Home files). In a shared file system, each application tier will have a unique Instance Home.
The Oracle E-Business Suite Release 12.2 architecture is a framework for multi-tiered, distributed computing. In this model, various services are distributed among multiple levels, or tiers, as shown in the figures below. Refer to Oracle Applications Concepts in the Oracle Applications Documentation Library to learn more about Oracle E-Business Suite architecture.
In a shared file system, all application tier files including the instance_top are installed on a shared disk resource, which is mounted on each application tier node. Any application tier node can be configured to perform any of the standard application tier services, such as Forms, Web and Concurrent Processing (Batch) services. All changes made to the shared file system are immediately accessible to all application tier nodes.
Note for customers using OCFS2 File System:
When setting up Oracle E-Business Suite to use a shared application tier file system, an application tier node can be configured to perform any of the standard application tier services, such as Forms, Web, or Concurrent Processing (Batch).
An application tier will have a unique Instance Home associated with it. The instance home can be placed at the default shared location as configured by rapid install/rapid clone or can be relocated to a local disk on the respective application tier. Oracle recommed the instance home to be configured on the shared disk.
Note: The following must all be true In a shared file system:
Shared Application Tier File System is the preferred deployment model for Oracle E-Business Suite Release 12.2.
In Release 12.2, two application tier file systems are installed on the primary application tier node. Provided to support online patching, they are known as the run file system and the patch file system. The run file system is where the application tier processes are run from. The patch file system is used by the adop (AD Online Patching) utility to update Oracle E-Business Suite code and configuration during an online patching cycle.
For more information about online patching, refer to Oracle E-Business Suite Concepts and Oracle E-Business Suite Maintenance Guide.
This section describe the steps an administrator need to perform to prepare for a shared file system installation. The Rapid Install utility only lay out a primary application tier . The subsequent nodes that share the file must be added using the add node utility as described in the section 4 of this document.
The 12.2 Rapid Install utility can be used to install a new, fully configured Oracle E-Business Suite system, including the latest certified Oracle E-Business Suite technology stack and all patches, product family release update packs, release update packs, and other updates available at the time of this Oracle E-Business Suite release. Rapid Install employs a wizard (RapidWiz) that guides you through the screens used to carry out the selected task. On the wizard screens, you enter configuration values for your system.
The Rapid Install utility supports single node installations (where the database and the application tier are installed and configured on one machine), and multinode installations (where the database and the application tier nodes are spread across different machines). Refer to Oracle E-Business Suite Installation Guide: Running Rapid Install for more information.
This document describes a two node installation scenario, where the database tier is installed on node 1 (primary database tier node) and the application tier is installed on node 2 (primary application tier node). The steps below show the sequence needed to complete the installation.
Start the RapidWiz utility on node 1. The first screen lists the components that are included in, or supported by, this release of Oracle E-Business Suite. You can see from this list that a new installation includes a fresh Oracle 11g Release 2 (11gR2) database. Enter the appropriate values as prompted by the Installer for the database and the application tier nodes, and complete the database tier installation.
Start RapidWiz on node 2. The database and associated database tier processes must be running to complete this installation successfully. The first screen lists the components that are included in, or supported by, this release of Oracle E-Business Suite. You can see from the list that a new installation of the application tier includes the Oracle Fusion Middleware Stack (which includes Oracle WebLogic Server and the Web Tier), and the Oracle Application Server stack, which includes the forms and reports and the Oracle E-Business Suite application tier code.
A successful completion of application tier installation on node 2 configures the following services:
The adpreclone utility shipped with Oracle E-Business Suite packages the required application tier components to a staging directory for subsequent clone and add node operations. You mustrun this utility before proceeding to Section 4 of this document.
The adpreclone utility requires the WebLogic Administration process to be running from the file system where the utility is run. This is required to package the Oracle Fusion Middleware components and its configuration. Perform the commands shown below on both the run and patch file systems:
On the run file system:
$ cd <inst-top-run-fs>/admin/scripts
$ ./adadminsrvctl.sh start
$ ./adpreclone.pl appsTier
$ ./adstpall.sh <apps-user-name>/<apps-password>
On the patch file system:
$ cd <inst-top-patch-fs>/admin/scripts
$ ./adadminsrvctl.sh start forcepatchfs
$ ./adpreclone.pl appsTier
$ ./adstpall.sh <apps-user-name>/<apps-password>
forcepatchfs
Follow section 4 after completing the installation of the database tier node and the primary application tier node.
Please note that an administrator can also use the Rapid Clone utlity to lay down the file system, configure the primary application tier node and subsequently add secondary application tier nodes using the share file system.
The tasks listed in this section assume that you have completed Section 3 of this document. The node to be added now will be known as the secondary application tier node. This node can be configured to run all services except for the Oracle WebLogic Administration Server
The following example will be used to explain the provisioning process better.
The following application tier file systems need to be exported from the primary application tier:
On a Linux system, execute the following commands as the root user to mount the application tier file system on to the secondary node.
/u01/12.2/fs1 appstier2.company.com(rw,sync,no_root_squash)
/u01/12.2/fs2 appstier2.company.com(rw,sync,no_root_squash)
/u01/12.2/fs_ne appstier2.company.com(rw,sync,no_root_squash)
/u01/12.2/oraInventory appstier2.company.com(rw,sync,no_root_squash)
$ /sbin/service nfs status
$ /sbin/service nfs start
$ $ /usr/sbin/exportfs -a
$ /usr/sbin/exportfs
The following application tier file system need to be mounted on the secondary application tier node from the primary node.
$ /sbin/service nfs status
$ /sbin/service nfs start
$ /bin/mkdir -p /u01/12.2/fs1
$ /bin/mkdir -p /u01/12.2/fs2
$ /bin/mkdir -p /u01/12.2/fs_ne
$ /bin/mkdir -p /u01/12.2/oraInventory
$ /bin/chown -R oracle /u01/12.2/fs1
$ /bin/chown -R oracle /u01/12.2/fs2
$ /bin/chown -R oracle /u01/12.2/fs_ne
$ /bin/chown -R oracle /u01/12.2/oraInventory
$ /bin/chgrp -R dba /u01/12.2/fs1
$ /bin/chgrp -R dba /u01/12.2/fs2
$ /bin/chgrp -R dba /u01/12.2/fs_ne
$ /bin/chgrp -R dba oraInventory
$ cd /u01/12.2/fs1
$ /bin/mount -t nfs -o rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp appstier1.company.com:/u01/12.2/fs1 .
$ cd /u01/12.2/fs2
$ /bin/mount -t nfs -o rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp appstier1.company.com:/u01/12.2/fs2 .
$ cd /u01/12.2/fs_ne
$ /bin/mount -t nfs -o rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp appstier1.company.com:/u01/12.2/fs_ne
.
$ cd /u01/12.2/oraInventory
$ /bin/mount -t nfs -o rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp appstier1.company.com:/u01/12.2/oraInventory .
$ cd /etc
$ vi fstab
vi
(or an equivalent editor), add lines as per the following example:
appstier1.company.com
:/u01/12.2/fs1
/u01/12.2/fs1 nfs rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp 0 0appstier1.company.com
:/u01/12.2/fs2
/u01/12.2/fs2 nfs rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp 0 0
appstier1.company.com
:/u01/12.2/fs_ne
/u01/12.2/fs_ne nfs rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp 0 0
appstier1.company.com
:/u01/12.2/oraInventory
/u01/12.2/oraInventory nfs rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp 0 0
The primary decision that an administrator need to make before proceeding with the steps given below is to decide what services are going to be configured on the secondary node. The new node that you are planning to add can run any service except for WebLogic Administration Server, which is only configured on the primary application tier node. Follow the steps given below to add a node.
A sample pairsfile for the run file system is instantiated into the relevant instance home on the primary application tier node. The name of the file is<SID>_<primary_node_name>_<file_edition_type>.txt
, located in the <INST_TOP>/appl/admin/ directory. For a configuration with an instance name of VIS, the pairsfile will be/u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1_run.txt
.
Carry out the instructions below to prepare the pairsfile for configuring the run file system.
$ mkdir -p /u01/12.2/pairsfiles/run
$ cd /u01/12.2/pairsfile
/
run
$ cp /u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1_run.txt myrunpairsfile.txt
Carry out the instructions below to configure the run file system on the secondary node.
$
export PATH=/u01/12.2/fs1/FMW_Home/webtier/perl/bin:$PATH
$ cd /u01/12.2/fs1/EBSapps/comn/clone/bin
$ /u01/12.2/fs1/FMW_Home/webtier/perl/bin/perl ./adclonectx.pl \
addnode contextfile=/u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1.xml \
pairsfile=/u01/12.2/pairsfile/run/myrunpairsfile.txt \
outfile=/u01/12.2/fs1/inst/apps/VIS_appstier2/appl/admin/VIS_appstier2.xml
Carry out the instructions given below to prepare the pair files for configuring the patch file system.
<SID>_<primary_node_name>_<file_edition_type>.txt
, and located in the <inst_top>/appl/admin/
directory. For a configuration with an instance name of VIS, the pairsfile will be /u01/12.2/fs2/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1_patch.txt.$ /bin/mkdir -p /u01/12.2/pairsfiles/patch
$ cd /u01/12.2/pairsfile
/
patch
$ /bin/cp /u01/12.2/fs2/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1_patch.txt mypatchpairsfile.txt
Carry out the instructions given below to configure the patch file system on the secondary node:
$
export PATH=/u01/12.2/fs2/FMW_Home/webtier/perl/bin:$PATH
$ cd /u01/12.2/fs2/EBSapps/comn/clone/bin
$ /u01/12.2/fs2/FMW_Home/webtier/perl/bin/perl ./adclonectx.pl \
addnode contextfile=/u01/12.2/fs2/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1.xml \
pairsfile=/u01/12.2/pairsfile/patch/mypatchpairsfile.txt \
outfile=/u01/12.2/fs2/inst/apps/VIS_appstier2/appl/admin/VIS_appstier2.xml
DELTA 7 Code Level Flow
The AD/TXK D7 patch introduce a new flow that adds both the run and patch edition file system with a single command. The steps given below configures both Run and Patch edition file system for a new node that is going to be added to the farm.
1. Ensure the correct perl utility is in the $PATH. You must use the perl utility installed in the Fusion Middleware Oracle Home.
For example:
$ export PATH=/u01/12.2/fs1/FMW_Home/webtier/perl/bin:$PATH
2. Ensure the WebLogic Administration Server is running from both run and Patch file system on the primary application tier node.
3. A sample pairsfile for the run/patch file system is instantiated into the instance home on the primary application tier node. The file is called <SID>_<primary_node_name>_.txt
, and located in the <inst_top>/appl/admin/
directory. For a configuration with an instance name of VIS, the pairsfile will be /u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1.txt.
4.Create the required directories and copy the pairsfile into a directory of your choice on the secondary application tier node. For example:
$ /bin/mkdir -p /u01/12.2/pairsfiles
$ cd /u01/12.2/pairsfile
$ /bin/cp /u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1.txt mypairsfile.txt
5. Execute adclonectx utility to configure both run and Patch file system
$ cd /u01/12.2/fs1/EBSapps/comn/clone/bin
$ /u01/12.2/fs1/FMW_Home/webtier/perl/bin/perl ./adclonectx.pl \
addnode contextfile=/u01/12.2/fs1/inst/apps/VIS_appstier1/appl/admin/VIS_appstier1.xml \
pairsfile=/u01/12.2/pairsfile/mypairsfile.txt \
dualfs=yes
4. Review the log files displayed by the add node utility to ensure that the add node operation has gone through successfully.
Follow the instructions given in section 5.3.2.4-5.3.2.7 ( Register the new topology from the newly added application tier node) of My Oracle Support Note Knowledge document Cloning Oracle E-Business Suite Release 12.2 with Rapid Clone (Doc ID 1383621.1) to register the new topology after adding the nodes.
The 12.2 online patching tool adop requires ssh connectivity between the primary application tier node often called as the master node configured in the intranet with other application tier nodes configured in both the Intranet and in the DMZ. This connectivity is required for the remote invocation of the patching procedures on all the nodes. See Set up Secure Shell on Application tier Nodes in the Oracle E-Business Suite Maintenance Guide for more information.
The recommendation given below are based on the testing performed by Oracle Development on commodity hardware running Linux operating system. The parameters listed below may not apply to Oracle Engineered systems. Please refer to Oracle E-Business Suite on Oracle Engineered Systems for more details on the mount options to be used.These parameters also may need to be tuned depending on various attributes related to network setup between the application tier machines , shared storage used, load on the storage server etc. Please contact your storage vendor to tune the NFS parameters for best throughput.
Platform
|
NFS Mount Options for Application Tier
|
NFS Mount Options for Database Oracle Home | NFS Mount Options for Database Files |
---|---|---|---|
Linux | rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,nfsvers=3,tcp |
rw,intr,bg,hard,timeo=600,wsize=32768,rsize=32768,nfsvers=3,tcp |
rw,nointr,bg,hard,timeo=600,wsize=32768,rsize=32768,nfsvers=3,tcp |
Solaris | rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,vers=3,proto=tcp |
rw,intr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
rw,nointr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
IBM AIX | rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,vers=3,proto=tcp |
rw,intr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
rw,nointr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
HP Itanium | rw,nointr,bg,hard,timeo=600,wsize=65536,rsize=65536,vers=3,proto=tcp |
rw,intr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
rw,nointr,bg,hard,timeo=600,wsize=32768,rsize=32768,vers=3,proto=tcp |
please note that the nfs mount options " intr" and "nointr" mount options are deprecated with Oracle Linux re deprecated in Oracle Unbreakable Enterprise Linux and Oracle Linux kernels, 2.6.32 and later.
Date | Known Issue | Resolution | Fixed In |
---|---|---|---|
November 11, 2013 | Oracle E-Business Suite Domain creation fails on certain NFS storage with weblogic.security.SecurityInitializationException: The loading of OPSS java security policy provider failed due to exception, see the exception stack trace or the server log file for root cause. If still see no obvious cause, enable the debug flag -Djava.security.debug=jpspolicy to get more information. |
The workaround is to ensure that the storage is mounted with "noacl" NFS mount option. |
Date | Description |
---|---|
MAY 21 , 2016 |
|
FEB 23, 2015 |
|
AUG 25, 2014 |
|
JUL 24, 2014 |
|
FEB 21, 2014 |
|
NOV 25, 2013 |
|
AUG 14, 2013 |
|
MAR 13, 2012 |
|