libingquan008
libingquan008

Oracle 11g R2 Clusterware新特性 – HAIP详解

By luocs ( 十二月 18, 2012 at 上午 8:23)

前段时间在聊RAC私网(Private Network)冗余技术的时候，朋友们大多搬出Bonding技术，当时我说了个HAIP，但朋友中几乎没有对它了解的。当时，我简单介绍了下HAIP特性，今天则更细一点去了解。

HAIP全称为Highly Available Virtual IP，是Oracle从11.2.0.2版本开始提供的私有网络冗余技术，这是Oracle独有的技术，也就是说HAIP特性仅限于Oracle软件使用。

MOS上有个非常详细地文档ID 1210883.1介绍了HAIP，其中对HAIP的描述如下：
Redundant Interconnect without any 3rd-party IP failover technology (bond, IPMP or similar) is supported natively by Grid Infrastructure starting from 11.2.0.2.  Multiple private network adapters can be defined either during the installation phase or afterward using the oifcfg.  Oracle Database, CSS, OCR, CRS, CTSS, and EVM components in 11.2.0.2 employ it automatically.

Grid Infrastructure can activate a maximum of four private network adapters at a time even if more are defined. The ora.cluster_interconnect.haip resource will start one to four link local  HAIP on private network adapters for interconnect communication for Oracle RAC, Oracle ASM, and Oracle ACFS etc.

Grid automatically picks free link local addresses from reserved 169.254.*.* subnet for HAIP. According to RFC-3927, link local subnet 169.254.*.* should not be used for any other purpose. With HAIP, by default, interconnect traffic will be load balanced across all active interconnect interfaces, and corresponding HAIP address will be failed over transparently to other adapters if one fails or becomes non-communicative. .

The number of HAIP addresses is decided by how many private network adapters are active when Grid comes up on the first node in the cluster .  If there's only one active private network, Grid will create one; if two, Grid will create two; and if more than two, Grid will create four HAIPs. The number of HAIPs won't change even if more private network adapters are activated later, a restart of clusterware on all nodes is required for the number to change, however, the newly activated adapters can be used for fail over purpose. 
 
上文中第一句就说，在没有任何第三方IP故障技术(Bond,IPMP等)的支持下，Grid Infrastructure在11.2.0.2版本开始出现了HAIP特性。多个私网适配器在安装期间或者后期通过oifcfg工具来定义。在Oracle数据库中，从11.2.0.2开始CSS、OCR、CRS、CTSS和EVM组件都将自动使用这个特性。

GI最多支持4个有效地私网配置，所以定义4个以上没有任何意义。ora.cluster_interconnect.haip资源为Oracle RAC、ORACLE ASM和ORACLE ACFS等通过私网进行内部通信的组件创建1到4个HAIP地址，这些IP地址表现为169.254.*.*，因此需要保证169.254.*.*在我们的网络环境里避免使用。在下面将会给出我的环境里HAIP内容。

当GI集群中第一个节点启动的时候，根据活动的私网适配器个数来决定HAIP地址数，尽管只有一个私有网络，GI依然会分配一个HAIP地址，如果有多余两个私网适配器，GI将创建4个HAIP。4个是目前最多支持的个数，因此即使有更多的私网适配器被GI激活，HAIP个数也不再改变。

HAIP介绍到这里，大家可能已经猜想出了它的优点：
1）私有网络的带宽提升
2）负载均衡提高整个私有网络的通信能力
3）当其中一个私网借口通信失败将会透明移动HAIP
4）hosts文件里不需要配置Private IP地址的解析

OK，下面就开始从我的RAC环境里看一下HAIP相关的内容

环境介绍：

  • 3-NODES Oracle Database 11g R2 RAC(With ASM) on Linux 5
  • VERSION : 11.2.0.3
  • HAIP : 配置了3个私网适配器

首先，我们在GI的安装期间，从OUI可以看到配置私网的界面，如下图：
 

[root@rac1 ~]# cd $GRID_HOME/bin
root@rac1 bin]# ./crsctl stat res -t -init
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS       
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
      1        ONLINE  ONLINE       rac1                     Started             
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       rac1                                         
ora.crf
      1        ONLINE  ONLINE       rac1                                         
ora.crsd
      1        ONLINE  ONLINE       rac1                                         
ora.cssd
      1        ONLINE  ONLINE       rac1                                         
ora.cssdmonitor
      1        ONLINE  ONLINE       rac1                                         
ora.ctssd
      1        ONLINE  ONLINE       rac1                     ACTIVE:0            
ora.diskmon
      1        OFFLINE OFFLINE                                                   
ora.drivers.acfs
      1        ONLINE  ONLINE       rac1                                         
ora.evmd
      1        ONLINE  ONLINE       rac1                                         
ora.gipcd
      1        ONLINE  ONLINE       rac1                                         
ora.gpnpd
      1        ONLINE  ONLINE       rac1                                         
ora.mdnsd
      1        ONLINE  ONLINE       rac1 

-- 从以上信息中我们可以发现这两行：
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       rac1  

即为HAIP资源状态为ONLINE。

上面环境介绍里已经说明，我的这套RAC是配置了3个私网适配器。

首先查看下网络接口配置信息：
[root@rac1 bin]# ./oifcfg getif
eth0  192.168.53.0  global  public
eth1  10.0.53.0  global  cluster_interconnect
eth2  10.0.53.0  global  cluster_interconnect
eth3  10.0.53.0  global  cluster_interconnect
-- 可以看出3个有效私网接口eth1、eth2、eth3

再查看下详细地网络接口信息：
[root@rac1 bin]# ./oifcfg iflist -p -n
eth0  192.168.53.0  PRIVATE  255.255.255.0
eth1  10.0.53.0  PRIVATE  255.255.255.0
eth1  169.254.192.0  UNKNOWN  255.255.192.0
eth1  169.254.0.0  UNKNOWN  255.255.192.0
eth2  10.0.53.0  PRIVATE  255.255.255.0
eth2  169.254.64.0  UNKNOWN  255.255.192.0
eth3  10.0.53.0  PRIVATE  255.255.255.0
eth3  169.254.128.0  UNKNOWN  255.255.192.0

查看主机接口信息：
[root@rac1 bin]# ip a
...部分省略...
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:89:8d:da brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.10/24 brd 10.0.53.255 scope global eth1
    inet 169.254.199.113/18 brd 169.254.255.255 scope global eth1:1
    inet 169.254.25.108/18 brd 169.254.63.255 scope global eth1:2
    inet6 fe80::a00:27ff:fe89:8dda/64 scope link 
       valid_lft forever preferred_lft forever
4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:ad:77:7d brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.11/24 brd 10.0.53.255 scope global eth2
    inet 169.254.81.139/18 brd 169.254.127.255 scope global eth2:1
    inet6 fe80::a00:27ff:fead:777d/64 scope link 
       valid_lft forever preferred_lft forever
5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:27:0f:39 brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.111/24 brd 10.0.53.255 scope global eth3
    inet 169.254.154.185/18 brd 169.254.191.255 scope global eth3:1
    inet6 fe80::a00:27ff:fe27:f39/64 scope link 
       valid_lft forever preferred_lft forever
...部分省略...

以下为这套RAC最近一次启动的时候告警日志里留下的HAIP相关信息：
Private Interface 'eth1:2' configured from GPnP for use as a private interconnect.
  [name='eth1:2', type=1, ip=169.254.25.108, mac=08-00-27-89-8d-da, net=169.254.0.0/18, mask=255.255.192.0, use=haip:cluster_interconnect/62]
Private Interface 'eth2:1' configured from GPnP for use as a private interconnect.
  [name='eth2:1', type=1, ip=169.254.81.139, mac=08-00-27-ad-77-7d, net=169.254.64.0/18, mask=255.255.192.0, use=haip:cluster_interconnect/62]
Private Interface 'eth3:1' configured from GPnP for use as a private interconnect.
  [name='eth3:1', type=1, ip=169.254.154.185, mac=08-00-27-27-0f-39, net=169.254.128.0/18, mask=255.255.192.0, use=haip:cluster_interconnect/62]
Private Interface 'eth1:1' configured from GPnP for use as a private interconnect.
  [name='eth1:1', type=1, ip=169.254.199.113, mac=08-00-27-89-8d-da, net=169.254.192.0/18, mask=255.255.192.0, use=haip:cluster_interconnect/62]
Public Interface 'eth0' configured from GPnP for use as a public interface.
  [name='eth0', type=1, ip=192.168.53.1, mac=08-00-27-03-53-1b, net=192.168.53.0/24, mask=255.255.255.0, use=public/1]
Public Interface 'eth0:1' configured from GPnP for use as a public interface.
  [name='eth0:1', type=1, ip=192.168.53.11, mac=08-00-27-03-53-1b, net=192.168.53.0/24, mask=255.255.255.0, use=public/1]
Public Interface 'eth0:2' configured from GPnP for use as a public interface.
  [name='eth0:2', type=1, ip=192.168.53.6, mac=08-00-27-03-53-1b, net=192.168.53.0/24, mask=255.255.255.0, use=public/1]
Picked latch-free SCN scheme 3
...中间部分参数等相关内容略...
Cluster communication is configured to use the following interface(s) for this instance
  169.254.25.108
  169.254.81.139
  169.254.154.185
  169.254.199.113


另外，为了介绍单一私有网络环境，我把我另外一个RAC环境里的内容摘了下来：

私网配置信息：
[grid@pos1 ~]$ oifcfg getif
eth2  10.0.53.0  global  cluster_interconnect
bond0  192.168.53.0  global  public

详细查看网络接口信息：
[grid@pos1 ~]$ oifcfg iflist -p -n
eth2  10.0.53.0  PRIVATE  255.255.255.0
eth2  169.254.0.0  UNKNOWN  255.255.0.0
eth3  10.0.0.0  PRIVATE  255.255.255.0
bond0  192.168.53.0  PRIVATE  255.255.255.0

查看主机接口信息：
[grid@pos1 ~]$ /sbin/ip a
...部分省略...
4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether e8:39:35:a8:3f:5a brd ff:ff:ff:ff:ff:ff
    inet 10.0.51.10/24 brd 10.0.51.255 scope global eth2
    inet 169.254.138.86/16 brd 169.254.255.255 scope global eth2:1
...部分省略...

我们也可以从动态视图v$cluster_interconnects里查看到GI自动分配的HAIP地址信息
SQL> select name, ip_address from v$cluster_interconnects;

NAME                           IP_ADDRESS
------------------------------ --------------------------------

eth2:1                         169.254.138.86

下面看下私网失败的情况

为模拟失败，我手动down掉了eth3接口
[root@rac1 bin]# ifdown eth3

查看网络接口信息，已经看不到eth3相关内容了
[root@rac1 bin]# ./oifcfg iflist -p -n
eth0  192.168.53.0  PRIVATE  255.255.255.0
eth1  10.0.53.0  PRIVATE  255.255.255.0
eth1  169.254.0.0  UNKNOWN  255.255.192.0
eth1  169.254.128.0  UNKNOWN  255.255.192.0
eth2  10.0.53.0  PRIVATE  255.255.255.0
eth2  169.254.64.0  UNKNOWN  255.255.192.0
eth2  169.254.192.0  UNKNOWN  255.255.192.0

查看主机信息，发现原本在eth3接口上的HAIP地址169.254.154.185/18已经透明飘逸到了eht1接口上
[root@rac1 bin]# ip a
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:89:8d:da brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.10/24 brd 10.0.53.255 scope global eth1
    inet 169.254.25.108/18 brd 169.254.63.255 scope global eth1:2
    inet 169.254.154.185/18 brd 169.254.191.255 scope global eth1:3
    inet6 fe80::a00:27ff:fe89:8dda/64 scope link 
       valid_lft forever preferred_lft forever
4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:ad:77:7d brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.11/24 brd 10.0.53.255 scope global eth2
    inet 169.254.81.139/18 brd 169.254.127.255 scope global eth2:1
    inet 169.254.199.113/18 brd 169.254.255.255 scope global eth2:2
    inet6 fe80::a00:27ff:fead:777d/64 scope link 
       valid_lft forever preferred_lft forever

我们从一些日志里能够获取到私网通信失败相关的日志内容：
[root@rac1 ~]# cd $GRID_HOME/log/rac1/ohasd
[root@rac1 ohasd]# tail -f ohasd.log 
...抓取相关内容…
2012-12-18 04:45:49.455: [GIPCHGEN][1147304256]gipchaInterfaceFail: marking interface failing 0x9fae090 { host '', haName 'CLSFRAME_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x184d }
2012-12-18 04:45:49.713: [GIPCHGEN][1128393024]gipchaInterfaceDisable: disabling interface 0x9fae090 { host '', haName 'CLSFRAME_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x19cd }
2012-12-18 04:45:49.713: [GIPCHDEM][1128393024]gipchaWorkerCleanInterface: performing cleanup of disabled interface 0x9fae090 { host '', haName 'CLSFRAME_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x19ed }


[root@rac1 ~]# cd $GRID_HOME/log/rac1/agent/ohasd/orarootagent_root/
[root@rac1 orarootagent_root]# tail -f orarootagent_root.log 
...抓取相关内容…
2012-12-18 04:45:48.168: [ USRTHRD][1132529984] {0:0:2} failed to receive ARP request
2012-12-18 04:45:48.168: [ USRTHRD][1132529984] {0:0:2} Assigned IP 169.254.154.185 no longer valid on inf eth3
2012-12-18 04:45:48.202: [ USRTHRD][1132529984] {0:0:2} VipActions::startIp {
2012-12-18 04:45:48.231: [ USRTHRD][1132529984] {0:0:2} Adding 169.254.154.185 on eth3:1
2012-12-18 04:45:48.235: [ USRTHRD][1132529984] {0:0:2} VipActions::startIp }
2012-12-18 04:45:48.236: [ USRTHRD][1132529984] {0:0:2} Reassigned IP:  169.254.154.185 on interface eth3
2012-12-18 04:45:48.404: [ USRTHRD][1126226240] {0:0:2} HAIP:  Updating member info HAIP1;10.0.53.0#0;10.0.53.0#1
2012-12-18 04:45:48.422: [ USRTHRD][1126226240] {0:0:2} HAIP:  Moving ip '169.254.154.185' from inf 'eth3' to inf 'eth1'
2012-12-18 04:45:48.422: [ USRTHRD][1126226240] {0:0:2} pausing thread
2012-12-18 04:45:48.423: [ USRTHRD][1126226240] {0:0:2} posting thread
2012-12-18 04:45:48.423: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start {
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start }
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} HAIP:  Moving ip '169.254.199.113' from inf 'eth1' to inf 'eth2'
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} pausing thread
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} posting thread
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start {
2012-12-18 04:45:48.432: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start }
2012-12-18 04:45:48.433: [ USRTHRD][1140934976] {0:0:2} [NetHAWork] thread started
2012-12-18 04:45:48.433: [ USRTHRD][1140934976] {0:0:2}  Arp::sCreateSocket { 
2012-12-18 04:45:48.433: [ USRTHRD][1143036224] {0:0:2} [NetHAWork] thread started
2012-12-18 04:45:48.433: [ USRTHRD][1143036224] {0:0:2}  Arp::sCreateSocket { 
2012-12-18 04:45:48.435: [ USRTHRD][1140934976] {0:0:2}  Arp::sCreateSocket } 
2012-12-18 04:45:48.436: [ USRTHRD][1140934976] {0:0:2} Starting Probe for ip 169.254.154.185
2012-12-18 04:45:48.436: [ USRTHRD][1140934976] {0:0:2} Transitioning to Probe State
2012-12-18 04:45:48.436: [ USRTHRD][1143036224] {0:0:2}  Arp::sCreateSocket } 
2012-12-18 04:45:48.436: [ USRTHRD][1143036224] {0:0:2} Starting Probe for ip 169.254.199.113
2012-12-18 04:45:48.436: [ USRTHRD][1143036224] {0:0:2} Transitioning to Probe State
2012-12-18 04:45:48.619: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:48.619: [ USRTHRD][1140934976] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:48.620: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:49.327: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:49.327: [ USRTHRD][1143036224] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:49.328: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:50.390: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:50.390: [ USRTHRD][1140934976] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:50.391: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:50.802: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:50.803: [ USRTHRD][1143036224] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:50.803: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:52.373: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:52.373: [ USRTHRD][1140934976] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:52.388: [ USRTHRD][1140934976] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:52.388: [ USRTHRD][1140934976] {0:0:2} Transitioning to Announce State
2012-12-18 04:45:52.548: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe { 
2012-12-18 04:45:52.548: [ USRTHRD][1143036224] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:52.549: [ USRTHRD][1143036224] {0:0:2}  Arp::sProbe } 
2012-12-18 04:45:52.549: [ USRTHRD][1143036224] {0:0:2} Transitioning to Announce State
2012-12-18 04:45:54.374: [ USRTHRD][1140934976] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:45:54.374: [ USRTHRD][1140934976] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:54.374: [ USRTHRD][1140934976] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:45:54.547: [ USRTHRD][1143036224] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:45:54.547: [ USRTHRD][1143036224] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:54.548: [ USRTHRD][1143036224] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:45:56.370: [ USRTHRD][1140934976] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:45:56.370: [ USRTHRD][1140934976] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2} Transitioning to Defend State
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2} VipActions::startIp {
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2} Adding 169.254.154.185 on eth1:3
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2} VipActions::startIp }
2012-12-18 04:45:56.371: [ USRTHRD][1140934976] {0:0:2} Assigned IP:  169.254.154.185 on interface eth1
2012-12-18 04:45:56.421: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop {
2012-12-18 04:45:56.546: [ USRTHRD][1143036224] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:45:56.546: [ USRTHRD][1143036224] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2} Transitioning to Defend State
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2} VipActions::startIp {
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2} Adding 169.254.199.113 on eth2:2
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2} VipActions::startIp }
2012-12-18 04:45:56.547: [ USRTHRD][1143036224] {0:0:2} Assigned IP:  169.254.199.113 on interface eth2
2012-12-18 04:45:56.750: [ USRTHRD][1132529984] {0:0:2} [NetHAWork] thread stopping
2012-12-18 04:45:56.750: [ USRTHRD][1132529984] {0:0:2} Thread:[NetHAWork]isRunning is reset to false here
2012-12-18 04:45:56.788: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop }
2012-12-18 04:45:56.788: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp {
2012-12-18 04:45:56.788: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp {
2012-12-18 04:45:56.788: [ USRTHRD][1126226240] {0:0:2} Stopping ip '169.254.154.185', inf 'eth3', mask '10.0.53.0'
2012-12-18 04:45:56.825: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp }
2012-12-18 04:45:56.825: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp }
2012-12-18 04:45:56.825: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop {
2012-12-18 04:45:57.085: [ USRTHRD][1136732480] {0:0:2} [NetHAWork] thread stopping
2012-12-18 04:45:57.085: [ USRTHRD][1136732480] {0:0:2} Thread:[NetHAWork]isRunning is reset to false here
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop }
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp {
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp {
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} Stopping ip '169.254.199.113', inf 'eth1', mask '10.0.53.0'
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp }
2012-12-18 04:45:57.097: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp }
2012-12-18 04:45:57.102: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  0 ]:  eth1 - 169.254.154.185 
2012-12-18 04:45:57.102: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  1 ]:  eth2 - 169.254.199.113 
2012-12-18 04:45:57.102: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  2 ]:  eth1 - 169.254.25.108 
2012-12-18 04:45:57.102: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  3 ]:  eth2 - 169.254.81.139 



[root@rac1 ~]# cd $GRID_HOME/log/rac1/cssd/
[root@rac1 cssd]# tail -f ocssd.log 
...抓取相关内容…
2012-12-18 04:45:48.391: [ GIPCNET][1094244672] gipcmodNetworkProcessSend: [network]  failed send attempt endp 0x1940a3d0 [0000000000000428] { gipcEndpoint : localAddr 'udp://10.0.53.111:44337', remoteAddr '', numPend 5, numReady 1, numDone 0, numDead 0, numTransfer 0, objFlags 0x0, pidPeer 0, flags 0x2, usrFlags 0x4000 }, req 0x2aaaac02d000 [000000000039a324] { gipcSendRequest : addr 'udp://10.0.53.2:10745', data 0x2aaaac03e4b8, len 272, olen 0, parentEndp 0x1940a3d0, ret gipcretEndpointNotAvailable (40), objFlags 0x0, reqFlags 0x2 }
2012-12-18 04:45:48.391: [ GIPCNET][1094244672] gipcmodNetworkProcessSend: slos op  :  sgipcnValidateSocket
2012-12-18 04:45:48.391: [ GIPCNET][1094244672] gipcmodNetworkProcessSend: slos dep :  Invalid argument (22)
2012-12-18 04:45:48.391: [ GIPCNET][1094244672] gipcmodNetworkProcessSend: slos loc :  address not 
2012-12-18 04:45:48.391: [ GIPCNET][1094244672] gipcmodNetworkProcessSend: slos info:  addr '10.0.53.111:44337', len 272, buf 0x2aaaac03e4b8, cookie 0x2aaaac02d000
2012-12-18 04:45:48.391: [GIPCXCPT][1094244672] gipcInternalSendSync: failed sync request, ret gipcretEndpointNotAvailable (40)
2012-12-18 04:45:48.391: [GIPCXCPT][1094244672] gipcSendSyncF [gipchaLowerInternalSend : gipchaLower.c : 781]: EXCEPTION[ ret gipcretEndpointNotAvailable (40) ]  failed to send on endp 0x1940a3d0 [0000000000000428] { gipcEndpoint : localAddr 'udp://10.0.53.111:44337', remoteAddr '', numPend 5, numReady 0, numDone 0, numDead 0, numTransfer 0, objFlags 0x0, pidPeer 0, flags 0x2, usrFlags 0x4000 }, addr 0x191edab0 [0000000000001325] { gipcAddress : name 'udp://10.0.53.2:10745', objFlags 0x0, addrFlags 0x1 }, buf 0x2aaaac03e4b8, len 272, flags 0x0
2012-12-18 04:45:48.391: [GIPCHGEN][1094244672] gipchaInterfaceFail: marking interface failing 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x6 }
2012-12-18 04:45:48.391: [GIPCHALO][1094244672] gipchaLowerInternalSend: failed to initiate send on interface 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x86 }, hctx 0x18e1b240 [0000000000000010] { gipchaContext : host 'rac1', name 'CSS_rac-cluster', luid '8068c448-00000000', numNode 2, numInf 3, usrFlags 0x0, flags 0x67 }
2012-12-18 04:45:48.392: [GIPCHGEN][1094244672] gipchaInterfaceFail: marking interface failing 0x194a3680 { host 'rac3', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.3:40268', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 3, flags 0x6 }
2012-12-18 04:45:48.392: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x193f9b20 { host '', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 2, idxBoot 0, flags 0x194d }
2012-12-18 04:45:48.392: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x86 }
2012-12-18 04:45:48.392: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x194a3680 { host 'rac3', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.3:40268', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 3, flags 0x86 }
2012-12-18 04:45:48.392: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0xa6 }
2012-12-18 04:45:48.392: [GIPCHGEN][1094244672] gipchaInterfaceReset: resetting interface 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0xa6 }
2012-12-18 04:45:48.392: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x194a3680 { host 'rac3', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.3:40268', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 3, flags 0xa6 }
2012-12-18 04:45:48.393: [GIPCHGEN][1094244672] gipchaInterfaceReset: resetting interface 0x194a3680 { host 'rac3', haName 'CSS_rac-cluster', local 0x193f9b20, ip '10.0.53.3:40268', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 3, flags 0xa6 }
2012-12-18 04:45:48.705: [GIPCHDEM][1094244672] gipchaWorkerCleanInterface: performing cleanup of disabled interface 0x193f9b20 { host '', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x196d }
2012-12-18 04:45:48.705: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote interface for node 'rac2', haName 'CSS_rac-cluster', inf 'udp://10.0.53.2:10745'
2012-12-18 04:45:48.705: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x194a8c10 { host 'rac2', haName 'CSS_rac-cluster', local 0x193fd310, ip '10.0.53.2:10745', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 4, flags 0x6 }
2012-12-18 04:45:48.705: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote interface for node 'rac3', haName 'CSS_rac-cluster', inf 'udp://10.0.53.3:40268'
2012-12-18 04:45:48.705: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x194a3680 { host 'rac3', haName 'CSS_rac-cluster', local 0x193fd310, ip '10.0.53.3:40268', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 3, flags 0x6 }
2012-12-18 04:45:49.831: [    CSSD][1125521728]clssnmSendingThread: sending status msg to all nodes

2012-12-18 04:45:49.831: [    CSSD][1125521728]clssnmSendingThread: sent 4 status msgs to all nodes


OK，我们手动up一下eth3以模拟恢复

[root@rac1 bin]# ./oifcfg iflist -p -n
eth0  192.168.53.0  PRIVATE  255.255.255.0
eth1  10.0.53.0  PRIVATE  255.255.255.0
eth1  169.254.0.0  UNKNOWN  255.255.192.0
eth1  169.254.192.0  UNKNOWN  255.255.192.0
eth2  10.0.53.0  PRIVATE  255.255.255.0
eth2  169.254.64.0  UNKNOWN  255.255.192.0
eth3  10.0.53.0  PRIVATE  255.255.255.0
eth3  169.254.128.0  UNKNOWN  255.255.192.0


[root@rac1 bin]# ip a
3: eth1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:89:8d:da brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.10/24 brd 10.0.53.255 scope global eth1
    inet 169.254.25.108/18 brd 169.254.63.255 scope global eth1:2
    inet 169.254.199.113/18 brd 169.254.255.255 scope global eth1:1
    inet6 fe80::a00:27ff:fe89:8dda/64 scope link 
       valid_lft forever preferred_lft forever
4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:ad:77:7d brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.11/24 brd 10.0.53.255 scope global eth2
    inet 169.254.81.139/18 brd 169.254.127.255 scope global eth2:1
    inet6 fe80::a00:27ff:fead:777d/64 scope link 
       valid_lft forever preferred_lft forever
5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast qlen 1000
    link/ether 08:00:27:27:0f:39 brd ff:ff:ff:ff:ff:ff
    inet 10.0.53.111/24 brd 10.0.53.255 scope global eth3
    inet 169.254.154.185/18 brd 169.254.191.255 scope global eth3:1
    inet6 fe80::a00:27ff:fe27:f39/64 scope link 
       valid_lft forever preferred_lft forever

ohasd.log日志内容：
2012-12-18 04:58:54.490: [GIPCHGEN][1147304256]gipchaNodeAddInterface: adding interface information for inf 0x9fae090 { host '', haName 'CLSFRAME_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x1841 }
2012-12-18 04:58:54.943: [GIPCHTHR][1128393024]gipchaWorkerCreateInterface: created local interface for node 'rac1', haName 'CLSFRAME_rac-cluster', inf 'udp://10.0.53.111:36909'
2012-12-18 04:58:54.944: [GIPCHTHR][1128393024]gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rac1', haName 'CLSFRAME_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.111'
2012-12-18 04:58:54.944: [GIPCHTHR][1128393024]gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rac1', haName 'CLSFRAME_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.111'
2012-12-18 04:58:54.944: [GIPCHTHR][1128393024]gipchaWorkerCreateInterface: created local bootstrap broadcast interface for node 'rac1', haName 'CLSFRAME_rac-cluster', inf 'udp://10.0.53.255:42424'


orarootagent_root.log日志内容：
2012-12-18 04:58:54.911: [ USRTHRD][1126226240] {0:0:2} HAIP:  Updating member info HAIP1;10.0.53.0#0;10.0.53.0#1;10.0.53.0#2
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} HAIP:  Moving ip '169.254.154.185' from inf 'eth1' to inf 'eth3'
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} pausing thread
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} posting thread
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start {
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start }
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} HAIP:  Moving ip '169.254.199.113' from inf 'eth2' to inf 'eth1'
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} pausing thread
2012-12-18 04:58:54.932: [ USRTHRD][1126226240] {0:0:2} posting thread
2012-12-18 04:58:54.933: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start {
2012-12-18 04:58:54.933: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]start }
2012-12-18 04:58:54.934: [ USRTHRD][1136732480] {0:0:2} [NetHAWork] thread started
2012-12-18 04:58:54.936: [ USRTHRD][1136732480] {0:0:2}  Arp::sCreateSocket { 
2012-12-18 04:58:54.936: [ USRTHRD][1132529984] {0:0:2} [NetHAWork] thread started
2012-12-18 04:58:54.936: [ USRTHRD][1132529984] {0:0:2}  Arp::sCreateSocket { 
2012-12-18 04:58:54.942: [ USRTHRD][1136732480] {0:0:2}  Arp::sCreateSocket } 
2012-12-18 04:58:54.942: [ USRTHRD][1136732480] {0:0:2} Starting Probe for ip 169.254.154.185
2012-12-18 04:58:54.942: [ USRTHRD][1136732480] {0:0:2} Transitioning to Probe State
2012-12-18 04:58:54.942: [ USRTHRD][1132529984] {0:0:2}  Arp::sCreateSocket } 
2012-12-18 04:58:54.942: [ USRTHRD][1132529984] {0:0:2} Starting Probe for ip 169.254.199.113
2012-12-18 04:58:54.943: [ USRTHRD][1132529984] {0:0:2} Transitioning to Probe State
2012-12-18 04:58:55.299: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:55.299: [ USRTHRD][1132529984] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:55.300: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:55.306: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:55.307: [ USRTHRD][1136732480] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:55.307: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:56.677: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:56.677: [ USRTHRD][1136732480] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:56.678: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:57.137: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:57.137: [ USRTHRD][1132529984] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:57.138: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:57.945: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:57.946: [ USRTHRD][1136732480] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:57.946: [ USRTHRD][1136732480] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:57.946: [ USRTHRD][1136732480] {0:0:2} Transitioning to Announce State
[  clsdmc][1087572288]CLSDMC.C returnbuflen=8, extraDataBuf=CC, returnbuf=6AB34B0
2012-12-18 04:58:58.176: [ora.ctssd][1087572288] {0:0:2} [check] clsdmc_respget return: status=0, ecode=0, returnbuf=[0x6ab34b0], buflen=8
2012-12-18 04:58:58.176: [ora.ctssd][1087572288] {0:0:2} [check] translateReturnCodes, return = 0, state detail = ACTIVE:0Checkcb data [0x6ab34b0]: mode[0xcc] offset[0 ms].
2012-12-18 04:58:58.654: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe { 
2012-12-18 04:58:58.654: [ USRTHRD][1132529984] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:58.655: [ USRTHRD][1132529984] {0:0:2}  Arp::sProbe } 
2012-12-18 04:58:58.655: [ USRTHRD][1132529984] {0:0:2} Transitioning to Announce State
2012-12-18 04:58:59.952: [ USRTHRD][1136732480] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:58:59.952: [ USRTHRD][1136732480] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:58:59.953: [ USRTHRD][1136732480] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:59:00.654: [ USRTHRD][1132529984] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:59:00.654: [ USRTHRD][1132529984] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:59:00.655: [ USRTHRD][1132529984] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:59:01.951: [ USRTHRD][1136732480] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:59:01.952: [ USRTHRD][1136732480] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:59:01.952: [ USRTHRD][1136732480] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:59:01.952: [ USRTHRD][1136732480] {0:0:2} Transitioning to Defend State
2012-12-18 04:59:01.952: [ USRTHRD][1136732480] {0:0:2} VipActions::startIp {
2012-12-18 04:59:01.952: [ USRTHRD][1136732480] {0:0:2} Adding 169.254.154.185 on eth3:1
2012-12-18 04:59:01.953: [ USRTHRD][1136732480] {0:0:2} VipActions::startIp }
2012-12-18 04:59:01.953: [ USRTHRD][1136732480] {0:0:2} Assigned IP:  169.254.154.185 on interface eth3
2012-12-18 04:59:02.656: [ USRTHRD][1132529984] {0:0:2}  Arp::sAnnounce { 
2012-12-18 04:59:02.656: [ USRTHRD][1132529984] {0:0:2} Arp::sSend:  sending type 1
2012-12-18 04:59:02.657: [ USRTHRD][1132529984] {0:0:2}  Arp::sAnnounce } 
2012-12-18 04:59:02.657: [ USRTHRD][1132529984] {0:0:2} Transitioning to Defend State
2012-12-18 04:59:02.657: [ USRTHRD][1132529984] {0:0:2} VipActions::startIp {
2012-12-18 04:59:02.657: [ USRTHRD][1132529984] {0:0:2} Adding 169.254.199.113 on eth1:1
2012-12-18 04:59:02.658: [ USRTHRD][1132529984] {0:0:2} VipActions::startIp }
2012-12-18 04:59:02.658: [ USRTHRD][1132529984] {0:0:2} Assigned IP:  169.254.199.113 on interface eth1
2012-12-18 04:59:02.931: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop {
2012-12-18 04:59:03.133: [ USRTHRD][1140934976] {0:0:2} [NetHAWork] thread stopping
2012-12-18 04:59:03.133: [ USRTHRD][1140934976] {0:0:2} Thread:[NetHAWork]isRunning is reset to false here
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop }
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp {
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp {
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} Stopping ip '169.254.154.185', inf 'eth1', mask '10.0.53.0'
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp }
2012-12-18 04:59:03.133: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp }
2012-12-18 04:59:03.136: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop {
2012-12-18 04:59:03.634: [ USRTHRD][1143036224] {0:0:2} [NetHAWork] thread stopping
2012-12-18 04:59:03.634: [ USRTHRD][1143036224] {0:0:2} Thread:[NetHAWork]isRunning is reset to false here
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} Thread:[NetHAWork]stop }
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp {
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp {
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} Stopping ip '169.254.199.113', inf 'eth2', mask '10.0.53.0'
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} NetInterface::sStopIp }
2012-12-18 04:59:03.635: [ USRTHRD][1126226240] {0:0:2} VipActions::stopIp }
2012-12-18 04:59:03.641: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  0 ]:  eth3 - 169.254.154.185 
2012-12-18 04:59:03.641: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  1 ]:  eth1 - 169.254.199.113 
2012-12-18 04:59:03.641: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  2 ]:  eth1 - 169.254.25.108 
2012-12-18 04:59:03.641: [ USRTHRD][1126226240] {0:0:2} USING HAIP[  3 ]:  eth2 - 169.254.81.139 
2012-12-18 04:59:04.060: [ora.crsd][1087572288] {0:0:2} [check] clsdmc_respget return: status=0, ecode=10201
2012-12-18 04:59:04.060: [ora.crsd][1087572288] {0:0:2} [check] DaemonAgent::check returned 0
2012-12-18 04:59:10.669: [ora.crf][1113618752] {0:0:2} [check] clsdmc_respget return: status=0, ecode=0
2012-12-18 04:59:10.670: [ora.crf][1113618752] {0:0:2} [check] Check return = 0, state detail = NULL

ocssd.log日志内容：
2012-12-18 04:58:54.488: [GIPCHGEN][1095821632] gipchaNodeAddInterface: adding interface information for inf 0x1a2bfec0 { host '', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.111', subnet '10.0.53.0', mask '255.255.255.0', mac '08-00-27-27-0f-39', ifname 'eth3', numRef 0, numFail 0, idxBoot 0, flags 0x1841 }
2012-12-18 04:58:54.714: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created local interface for node 'rac1', haName 'CSS_rac-cluster', inf 'udp://10.0.53.111:33643'
2012-12-18 04:58:54.714: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rac1', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.111'
2012-12-18 04:58:54.715: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created local bootstrap multicast interface for node 'rac1', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.111'
2012-12-18 04:58:54.715: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created local bootstrap broadcast interface for node 'rac1', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:42424'
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac064f20 { host 'rac2', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac065b90 { host 'rac2', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac065ef0 { host 'rac2', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac066250 { host 'rac3', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac0bed60 { host 'rac3', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHGEN][1094244672] gipchaNodeAddInterface: adding interface information for inf 0x2aaaac0bf0c0 { host 'rac3', haName 'CSS_rac-cluster', local (nil), ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1842 }
2012-12-18 04:58:54.715: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.10'
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.10'
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:42424'
2012-12-18 04:58:54.716: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac064f20 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.11'
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.11'
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:42424'
2012-12-18 04:58:54.716: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac065b90 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.716: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.111:33643'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.111:33643'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac2', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:33643'
2012-12-18 04:58:54.717: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac065ef0 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.10'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.10'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:42424'
2012-12-18 04:58:54.717: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac066250 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.11'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.11'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:42424'
2012-12-18 04:58:54.717: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac0bed60 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://224.0.0.251:42424/10.0.53.111:33643'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap multicast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'mcast://230.0.1.0:42424/10.0.53.111:33643'
2012-12-18 04:58:54.717: [GIPCHTHR][1094244672] gipchaWorkerCreateInterface: created remote bootstrap broadcast interface for node 'rac3', haName 'CSS_rac-cluster', inf 'udp://10.0.53.255:33643'
2012-12-18 04:58:54.717: [GIPCHGEN][1094244672] gipchaWorkerAttachInterface: Interface attached inf 0x2aaaac0bf0c0 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.717: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac065ef0 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.718: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac065ef0 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:54.855: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac065b90 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.855: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac065b90 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:54.855: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac066250 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.855: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac0bed60 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.855: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac0bf0c0 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.856: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac066250 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:54.856: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac0bf0c0 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.111:33643', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:54.856: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac0bed60 { host 'rac3', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.11', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:54.919: [GIPCHGEN][1094244672] gipchaInterfaceDisable: disabling interface 0x2aaaac064f20 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1846 }
2012-12-18 04:58:54.920: [GIPCHALO][1094244672] gipchaLowerCleanInterfaces: performing cleanup of disabled interface 0x2aaaac064f20 { host 'rac2', haName 'CSS_rac-cluster', local 0x1a2bfec0, ip '10.0.53.10', subnet '10.0.53.0', mask '255.255.255.0', mac '', ifname '', numRef 0, numFail 0, idxBoot 0, flags 0x1866 }
2012-12-18 04:58:57.861: [    CSSD][1125521728]clssnmSendingThread: sending status msg to all nodes
2012-12-18 04:58:57.862: [    CSSD][1125521728]clssnmSendingThread: sent 4 status msgs to all nodes

最后想说一下，Oracle的一些新特性虽很好用，但不免有一些BUG的存在，MOS ID 1210883.1文档上已列出一些BUG内容，请参考。

Permalink

1 Comment »

  1. luocs  said,
    十二月 18, 2012 @  上午 8:27

    MOS文档BUG内容部分：
    11gR2 Grid Infrastructure Redundant Interconnect and ora.cluster_interconnect.haip [ID 1210883.1]

    It's NOT supported to disable HAIP or stop HAIP while the cluster is up and running, however:
1. The feature is disabled in 11.2.0.2/11.2.0.3 if Sun Cluster exists
2. The feature does not exist in Windows 11.2.0.2/11.2.0.3
3. The feature is disabled in 11.2.0.2/11.2.0.3 if Fujitsu PRIMECLUSTER exists

4. With the fix of bug 11077756 (fixed in 11.2.0.2 GI PSU6, 11.2.0.3), HAIP will be disabled if it fails to start while running root script (root.sh or rootupgrade.sh), for more details, refer to Section bug 11077756
Known Issues
Bug 12425730
Issue: HAIP fails to start, gipcd.log shows rank 0 or "-1" for private network

Fixed in: 11.2.0.3 and onward, refer to note 1374360.1 for details.
bug 12674817

Issue: HAIP fails to start if root script (root.sh or rootupgrade.sh) is executed via sudo

Symptom:
 • Output of root script:
 CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'racnode1'
 CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
 Start action for HAIP aborted
 CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'racnode1' failed
 • $GRID_HOME/log//agent/ohasd/orarootagent_root/orarootagent_root.log
 2010-12-04 17:19:54.893: [ USRTHRD][2084] {0:3:37} failed to create arp
 2010-12-04 17:19:54.893: [ USRTHRD][2084] {0:3:37} (null) category: -2, operation: ioctl, loc: bpfopen:2,os, OS error: 14, other:
 
 OR
 
 2011-09-29 16:44:46.770: [ USRTHRD][3600] {0:3:14} failed to create arp
 2011-09-29 16:44:46.771: [ USRTHRD][3600] {0:3:14} (null) category: -2, operation: open, loc: bpfopen:1,os, OS error: 2, other:
 
 OR
 
 2011-09-29 16:44:46.770: [ USRTHRD][3600] {0:3:14} failed to create arp
 2011-09-29 16:44:46.771: [ USRTHRD][3600] {0:3:14} (null) category: -2, operation: open, loc: bpfopen:1,os, OS error: 22, other:
 
 OR
 
 2011-11-03 11:03:01.217: [ USRTHRD][25] {0:0:166} (null) category: -2, operation: open, loc: devopen:1,os, OS error: 2, other:
Solution/Workaround:

It's known on AIX and Solaris that command executed via sudo etc may not have full root environment, which could cause HAIP startup failure.

The solution is to execute root script (root.sh or rootupgrade.sh) as real root user directly. If root script already failed, it may fail with same error while re-running, and the workaround is to reboot the node and run root script as root user directly.

On AIX, alternative workaround is to execute "/usr/sbin/tcpdump -D" as root and verify that the following exists before re-running root script:
ls -ltr /dev/bpf*
cr--------   1 root     system       42,  0 Oct 03 10:32 /dev/bpf0
..
 
Bug 10332426
Issue: HAIP fails to start while running rootupgrade.sh

Symptom:
 • Output of root script:
 CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'racnode1'
 CRS-5017: The resource action "ora.cluster_interconnect.haip start"
 encountered the following error:
 Start action for HAIP aborted
 CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'racnode1' failed
 • $GRID_HOME/log/<hostname>/gipcd/gipcd.log
 2010-12-12 09:41:35.201: [ CLSINET][1088543040] Returning NETDATA: 0 interfaces
 2010-12-12 09:41:40.201: [ CLSINET][1088543040] Returning NETDATA: 0 interfaces
Solution:

The cause is mismatch of private network information in OCR and on OS, output of the following should be consistent with each other regarding network adapter name, subnet and netmask - see note 1296579.1 for what to check.
 oifcfg iflist -p -n
 oifcfg getif
 ifconfig
Bug 10363902
Issue: GIPC HA disabled or HAIP fails to start if cluster interconnect is Infiniband or any other network hardware that has hardware address (MAC) longer than 6 bytes

Fixed in: 11.2.0.3 for Linux and Solaris

Symptom:
 • Output of root script:
 CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'racnode1'
 CRS-5017: The resource action "ora.cluster_interconnect.haip start"
 encountered the following error:
 Start action for HAIP aborted
 CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'racnode1' failed
 • $GRID_HOME/log/<hostname>/gipcd/gipcd.log
 2010-12-07 13:23:08.560: [ USRTHRD][3858] {0:0:62} Arp::sCreateSocket {
 2010-12-07 13:23:08.560: [ USRTHRD][3858] {0:0:62} failed to create arp
 2010-12-07 13:23:08.561: [ USRTHRD][3858] {0:0:62} (null) category: -2,
 operation: ssclsi_aix_get_phys_addr, loc: aixgetpa:4,n, OS error: 2, other:
 
 2010-12-30 10:52:37.373: [ USRTHRD][15] {0:0:124} (null) category: -2, operation: ssclsi_dlpi_request, loc: dlpireq:8,na, OS error: 7, other:
 2010-12-30 10:52:37.462: [ USRTHRD][15] {0:0:124} Arp::sCreateSocket {
 2010-12-30 10:52:37.463: [ USRTHRD][15] {0:0:124} failed to create arp
 
 # lanscan
 Hardware Station        Crd Hdw   Net-Interface  NM  MAC       HP-DLPI DLPI
 Path     Address        In# State NamePPA        ID  Type      Support Mjr#
 ..
 LinkAgg1 0x0000004CFE8* 901 UP    lan901 snap901  9  IB        Yes     119
 ..
 IPOIB0   0x0000004CFE8* 9000 UP  lan9000 snap9000 5  IB        Yes     119
 
Bug 10357258
Issue: many HAIP created after active NIC fails in IPMP

Fixed in: 11.2.0.3, 11.2.0.2 GI PSU3, interim patch 10357258 exists for 11.2.0.2, patch 11865154 for 11.2.0.2.1, affects Solaris only

Symptom:
 • ifconfig output:
 nxge3:2: flags=21000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,STANDBY> mtu  1500 index 5
           inet 169.254.20.88 netmask ffff0000 broadcast 169.254.255.255
 nxge3:3: flags=21000842<BROADCAST,RUNNING,MULTICAST,IPv4,STANDBY> mtu 1500  index 5
           inet 169.254.20.88 netmask ffff0000 broadcast 169.254.255.255
 ..
 
 Note the same HAIP shows up multiple times
 
Bug 10397652
Issue: HAIP does not failover even when private network experiences problem (i.e. switch port disabled or such) as OS is not providing reliable link information

Fixed in: 11.2.0.3

Workaround on AIX is to set "MONITOR" flag for all private network adapters
 # ifconfig en1 monitor
 # ifconfig en1
 en1: flags=5e080863,2c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,
 GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN,MONITOR>
         inet 192.168.10.83 netmask 0xfffffc00 broadcast 192.168.11.255
         inet 169.254.74.136 netmask 0xffff8000 broadcast 169.254.127.255
          tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
Bug 10253028
Issue: "oifcfg iflist -p -n" not showing HAIP on AIX

Fixed in: Expected behaviour on AIX

Symptom:
 • "oifcfg getif" output
 en12  10.0.1.0  global  public
 en13  10.1.1.0  global  cluster_interconnect
 • "ifconfig -a" output
 en13: flags=5e080863,c0<UP,BROADCAST,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST,GROUPRT,64BIT,CHECKSUM_OFFLOAD(ACTIVE),PSEG,LARGESEND,CHAIN>
        inet 10.1.1.143 netmask 0xffffff00 broadcast 10.1.1.255
        inet 169.254.228.154 netmask 0xffff0000 broadcast 169.254.255.255
         tcp_sendspace 131072 tcp_recvspace 65536 rfc1323 0
 ..
 Note HAIP exists
 • v$cluster_interconnects
 SQL> select * from gv$cluster_interconnects;
 
   INST_ID NAME            IP_ADDRESS       IS_ SOURCE
 ---------- --------------- ---------------- ---
         1 en13            169.254.228.154  NO
         2 en13            169.254.55.162   NO
 • "oifcfg iflist -p -n" output
 en12  10.0.1.0  PUBLIC  255.255.255.0
 en13  10.1.1.0  PUBLIC  255.255.255.0
 
 Note usually we expect HAIP to be listed here as well, however it's not listed on AIX
 
  
Bug 9795321
Issue: Wrong MTU size for HAIP on Solaris, refer to note 1290585.1 for more details.
Bug 11077756
Issue: Startup failure of HAIP fails root script, fix of the bug will allow root script to continue so HAIP issue can be worked later.

Fixed in: 11.2.0.2 GI PSU6, 11.2.0.3 and above

Note: the consequence is that HAIP will be disabled. Once the cause is identified and solution is implemented, HAIP needs to be enabled when there's an outage window. To enable, as root on ALL nodes:

# $GRID_HOME/bin/crsctl modify res ora.cluster_interconnect.haip -attr "ENABLED=1" -init
# $GRID_HOME/bin/crsctl stop crs
# $GRID_HOME/bin/crsctl start crs
Bug 12546712
Issue: ASM crashes as HAIP does not fail over when two or more private network fails , refer to note 1323995.1 for more details.
Note 1366211.1
Issue: HAIP fails to start if default gateway is configured for VLAN for private network on network switch

orarootagent_root.log shows: PROBE: conflict detected src { 169.254.12.247, <gateway MAC on switch> }, target { 0.0.0.0, <private NIC MAC> }

The solution is to remove default gateway setting on network switch for private network (VLAN), refer to note 1366211.1 for more details.
bug 10114953
Issue: Only one HAIP created on HP-UX

The bug is fixed in 11.2.0.4, patch 10114953 is required before 11.2.0.4 is released.

OS kernel parameter dlpi_max_ub_promisc must be set to greater than 1 for the patch to be effective.
Note 1447517.1
Issue: HAIP fails to start on AIX as other system devices using same major/minor number as bpf devices

orarootagent_root.log shows: category: -2, operation: SETIF, loc: bpfopen:21,o, OS error: 22, other: dev /dev/bpf0, ifr en15

The solution is to ensure no other device is using same major/minor as bpf device, refer to note 1447517.1 for more details.
    回复

你可能感兴趣的:(高可用相关(rac)

  • QQ群采集助手，精准引流必备神器 2401_87347160 其他经验分享
    功能概述微信群查找与筛选工具是一款专为微信用户设计的辅助工具，它通过关键词搜索功能，帮助用户快速找到相关的微信群，并提供筛选是否需要验证的群组的功能。主要功能关键词搜索：用户可以输入关键词，工具将自动查找包含该关键词的微信群。筛选功能：工具提供筛选机制，用户可以选择是否只显示需要验证或不需要验证的群组。精准引流：通过上述功能，用户可以更精准地找到目标群组，进行有效的引流操作。3.设备需求该工具可以
  • 关于沟通这件事，项目经理不需要每次都面对面进行 流程大师兄
    很多项目经理都会遇到这样的问题，项目中由于事情太多，根本没有足够的时间去召开会议，那在这种情况下如何去有效地管理项目中的利益相关者？当然，不建议电子邮件也不需要开会的话，建议可以采取下面几种方式来形成有效的沟通，这几种方式可以帮助你努力的通过各种办法来保持和各方面的联系。项目经理首先要问自己几个问题，项目中哪些利益相关者是必须要进行沟通的？可以列出项目中所有的利益相关者清单，同时也整理出项目中哪些
  • html 中如何使用 uniapp 的部分方法 某公司摸鱼前端 htmluni-app前端
    示例代码：Documentconsole.log(window);效果展示：好了，现在就可以uni.使用相关的方法了
  • 《大清方方案》| 第二话 谁佐清欢
    和珅究竟说了些什么？竟能令堂堂九五之尊龙颜失色！此处暂且按下不表；单说这位乾隆皇帝，果真不愧是康熙从小带过的，一旦决定了要做的事，便杀伐决断毫不含糊。他当即亲自拟旨，着令和珅为钦差大臣，全权负责处理方方事件，并钦赐尚方宝剑，遇急则三品以下官员可先斩后奏。和珅身负皇上重托，岂敢有半点怠慢，当夜即率领相关人等，马不停蹄杀奔江汉。这一路上，和珅的几位幕僚一直在商讨方方事件的处置方案。有位年轻幕僚建议快刀
  • 水泥质量纠纷案代理词 徐宝峰律师
    贵州领航建设有限公司诉贵州纳雍隆庆乌江水泥有限公司产品质量纠纷案代理词尊敬的审判长、审判员：贵州千里律师事务所接受被告贵州纳雍隆庆乌江水泥有限公司的委托，指派我担任其诉讼代理人，参加本案的诉讼活动。下面，我结合本案事实和相关法律规定发表如下代理意见，供合议庭评议案件时参考：原告应当举证证明其遭受的损失与被告生产的水泥质量的因果关系。首先水泥是一种粉状水硬性无机胶凝材料。加水搅拌后成浆体，能在空气中
  • 怎么起诉借钱不还的人？怎样起诉欠款不还的人？ 影子爱学习
    怎么起诉借钱不还的人？怎样起诉欠款不还的人？如果遇到难以解决的法律问题，我们可以匹配专业律师。例如：婚姻家庭（离婚纠纷）、刑事辩护、合同纠纷、债权债务、房产（继承）纠纷、交通事故、劳动争议、人身损害、公司相关法律事务（法律顾问）等咨询推荐手机/微信:15633770876【全国案件皆可】借钱不还起诉对方需要哪些资料起诉欠钱不还的，一般需要的材料包括以下这些：借据、收据、欠条、付款凭证等证据，以及向
  • 第四天旅游线路预览——从换乘中心到喀纳斯湖 陟彼高冈yu 基于Googleearthstudio的旅游规划和预览旅游
    第四天：从贾登峪到喀纳斯风景区入口，晚上住宿贾登峪；换乘中心有4路车，喀纳斯①号车，去喀纳斯湖，路程时长约5分钟；将上面的的行程安排进行动态展示，具体步骤见”Googleearthstudio进行动态轨迹显示制作过程“、“Googleearthstudio入门教程”和“Googleearthstudio进阶教程“相关内容，得到行程如下所示：Day4-2-480p
  • 深入理解 MultiQueryRetriever：提升向量数据库检索效果的强大工具 nseejrukjhad 数据库python
    深入理解MultiQueryRetriever：提升向量数据库检索效果的强大工具引言在人工智能和自然语言处理领域，高效准确的信息检索一直是一个关键挑战。传统的基于距离的向量数据库检索方法虽然广泛应用，但仍存在一些局限性。本文将介绍一种创新的解决方案：MultiQueryRetriever，它通过自动生成多个查询视角来增强检索效果，提高结果的相关性和多样性。MultiQueryRetriever的工
  • 回溯算法-重新安排行程 chirou_ 算法数据结构图论c++图搜索
    leetcode332.重新安排行程这题我还没自己ac过，只能现在凭着刚学完的热乎劲把我对题解的理解记下来。本题我认为对数据结构的考察比较多，用什么数据结构去存数据，去读取数据，都是很重要的。classSolution{private:unordered_map>targets;boolbacktracking(intticketNum,vector&result){//1.确定参数和返回值//2
  • python os 环境变量 CV矿工 python开发语言numpy
    环境变量：环境变量是程序和操作系统之间的通信方式。有些字符不宜明文写进代码里，比如数据库密码，个人账户密码，如果写进自己本机的环境变量里，程序用的时候通过os.environ.get（）取出来就行了。os.environ是一个环境变量的字典。环境变量的相关操作importos"""设置/修改环境变量：os.environ[‘环境变量名称’]=‘环境变量值’#其中key和value均为string类
  • 【PG】常见数据库、表属性设置 江无羡 数据库
    PG的常见属性配置方法数据库复制、备份相关表的复制标识单表操作批量表操作链接数据库复制、备份相关表的复制标识单表操作通过ALTER语句单独更改一张表的复制标识。ALTERTABLE[tablename]REPLICAIDENTITYFULL;批量表操作通过代码块的方式，对某个schema中的所有表一起更新其复制标识。SELECTtablename,CASErelreplidentWHEN'd'TH
  • 2019-11-04复盘——飞来山上千寻塔，闻说鸡鸣见日升。 那一叶秋
    1、大盘篇先上老图，看习惯了，也就知道走势了图1上证指数日线图还是那张老图，自己可以在自己的相关软件上画出来，快变盘了。2、个股篇未加仓、未减仓。分析量能的时候，突然发现这么一个东西：“放量突破年线，缩量回调。”合众科技日线图其实，最近的N只个股，在技术分析上，都到了变盘的临界时候。结合这么久的走势，特别是ZJH不断放开IPO的申请，本质上说是融资难度变大，或者说是为企业的融资开创便利。但现在市场
  • 在Ubuntu中编译含有JSON的文件出现报错 芝麻糊76 Linuxkill_buglinuxubuntujson
    在ubuntu中进行JSON相关学习的时候，我发现了一些小问题，决定与大家进行分享，减少踩坑时候出现不必要的时间耗费截取部分含有JSON部分的代码进行展示char*str="{\"title\":\"JSONExample\",\"author\":{\"name\":\"JohnDoe\",\"age\":35,\"isVerified\":true},\"tags\":[\"json\",\"
  • 4招写出高价值文章 zhiliner
    文章写得泛泛是因为思考得不够深，思考得越深文章会越有价值。拿到一个主题一定要去深入挖掘事件背后的东西，比如人物困境以及趋势性的东西。写作过程中有几个深度思考的方法一、解剖，让旧素材焕发新意作为一个写作者，我们能够做的最大贡献，就是给出自己看世界的角度。解剖其实就是把这个话题相关的信息都列出来，详细的列出来，看清楚它的内部。我们看到一个老话题或者一段旧素材的时候，不要只看这个素材或者话题本身，一定要
  • 【从浅识到熟知Linux】Linux发展史 Jammingpro 从浅学到熟知Linuxlinux运维服务器
    归属专栏：从浅学到熟知Linux个人主页：Jammingpro每日努力一点点，技术变化看得见文章前言：本篇文章记录Linux发展的历史，因在介绍Linux过程中涉及的其他操作系统及人物，本文对相关内容也有所介绍。文章目录Unix发展史Linux发展史开源Linux官网企业应用情况发行版本在学习Linux前，我们可能都会问Linux从哪里来？它是如何发展的。但在介绍Linux之前，需要先介绍一下Un
  • K近邻算法_分类鸢尾花数据集 _feivirus_ 算法机器学习和数学分类机器学习K近邻
    importnumpyasnpimportpandasaspdfromsklearn.datasetsimportload_irisfromsklearn.model_selectionimporttrain_test_splitfromsklearn.metricsimportaccuracy_score1.数据预处理iris=load_iris()df=pd.DataFrame(data=ir
  • 2023-08-08 2023梦启支教团张牧泽
    学汉字历史，行传统书法——中国矿业大学梦启支教团梦启三班开展书法文化课7月20日上午8时，中国矿业大学梦启支教团在贵州省金沙县西洛街道彩虹小学开展了“书法文化”课程。该课程意在向孩子们传授汉字演变的相关知识，围绕书法发展历史讲解不同时期的字形字体特点。此课程由梦启支教团成员王耀民讲授，梦启三班全体成员参加。中国文字的发展有数千年的历史，从早期雏形的象形文字到殷商时期的甲骨文、金文，再到西周、秦朝的
  • 《吹牛大王历险记》读书随笔 赵炳森
    这本书的作者是埃·拉斯伯戈·毕尔格。（没查到相关内容，好像他只写过《吹牛大王历险记》。）最让人百思不得其解的是他居然能自己拉自己的辫子出泥潭？！我觉得自己拉自己的辫子只会把自己的辫子拉断，而不会飞出泥潭。（问:图片中底下的屁股为什么插了一根钢针？）屁股底下居然有根钢针？在泥潭应该是滑滑的吧，可是他怎么能夹紧马肚呢？马肚子应该是在马的下方。还有如果能从泥潭里把连人带马都给拽出来的话，他力气肯定很大，
  • 我与《红楼梦》‖纪念曹雪芹出生307周年！归海逸舟是周成功子阳佳乐 归海逸舟是周成功子阳佳乐
    【今日作家推荐】中国古典小说之首《红楼梦》，其作者曹雪芹是文坛泰斗。约1715年5月28日，曹雪芹出生。所以，今天推荐的是中国人众所周知的作家——曹雪芹。曹雪芹在世界读者心目中也影响广大，可以与西方世界引以为豪的莎士比亚、歌德等媲美。1、我与《红楼梦》我一直想写一篇和《红楼梦》相关的文章，现在机会终于来了！《红楼梦》作为我国家喻户晓的文学名著，其影响是空前的。还在我很小的时候，姥姥经常讲《红楼梦》
  • 2020-8-19晨间日记：看过的电影 盐大虾
    今天是周三起床：6点半就寝：11点天气：晴心情：正常纪念日：周三任务清单今日完成的任务，最重要的三件事：1.整理写过的文档2.电影《电灯泡》3.这就是街舞第三季第五期改进：早睡早起习惯养成：早睡早起，看书周目标·完成进度两篇文章学习·信息·阅读电影艺术发展史相关教材健康·饮食·锻炼吃了挺多零食，还喝了果粒橙，还是得少吃，多锻炼，不然会慢慢死掉的。人际·家人·朋友淡定交流，不放在心上。工作·思考专心
  • 系统架构设计师 需求分析篇二 AmHardy 软件架构设计师系统架构需求分析面向对象分析分析模型UML和SysML
    面向对象分析方法1.用例模型构建用例模型一般需要经历4个阶段：识别参与者：识别与系统交互的所有事物。合并需求获得用例：将需求分配给予其相关的参与者。细化用例描述：详细描述每个用例的功能。调整用例模型：优化用例之间的关系和结构，前三个阶段是必需的。2.用例图的三元素参与者：使用系统的用户或其他外部系统和设备。用例：系统所提供的服务。通信关联：参与者和用例之间的关系，或用例与用例之间的关系。3.识别参
  • 上班族可以做线上副业兼职有哪些？盘点7个适合上班族做的副业兼职！ 高省APP大九
    对于许多上班族来说，工资往往不能满足他们的生活需求，因此许多人开始寻找副业来增加收入。以下是一些适合普通人的副业赚钱路子，希望能给您带来一些灵感。1、做好物推荐现在很多职场人其实有大量的个人时间，只不过这些个人时间比较碎片化，他们不能够很好的利用起来，其实可以利用这些碎片化的时间去做副业，比如做好物推荐。在网上有很多的平台，比如头条抖音等等都开通了一个商品的分销功能，只要你发布相关的视频或者文章，
  • spring如何整合druid连接池？ 惜.己 springspringjunit数据库javaidea后端xml
    目录spring整合druid连接池1.新建maven项目2.新建mavenModule3.导入相关依赖4.配置log4j2.xml5.配置druid.xml1)xml中如何引入properties2)下面是配置文件6.准备jdbc.propertiesJDBC配置项解释7.配置druid8.测试spring整合druid连接池1.新建maven项目打开IDE（比如IntelliJIDEA,Ecl
  • ArrayList 源码解析 程序猿进阶 Java基础ArrayListListjava面试性能优化架构设计idea
    ArrayList是Java集合框架中的一个动态数组实现，提供了可变大小的数组功能。它继承自AbstractList并实现了List接口，是顺序容器，即元素存放的数据与放进去的顺序相同，允许放入null元素，底层通过数组实现。除该类未实现同步外，其余跟Vector大致相同。每个ArrayList都有一个容量capacity，表示底层数组的实际大小，容器内存储元素的个数不能多于当前容量。当向容器中添
  • 网络通信流程 记得开心一点啊 服务器网络运维
    目录♫IP地址♫子网掩码♫MAC地址♫相关设备♫ARP寻址♫网络通信流程♫IP地址我们已经知道IP地址由网络号+主机号组成，根据IP地址的不同可以有5钟划分网络号和主机号的方案：其中，各类地址的表示范围是：分类范围适用网络网络数量主机最大连接数A类0.0.0.0~127.255.255.255大型网络12616777214【(2^24)-2】B类128.0.0.0~191.255.255.255中
  • 4.C_数据结构_队列 荣世蓥 数据结构数据结构
    概述什么是队列：队列是限定在两端进行插入操作和删除操作的线性表。具有先入先出(FIFO)的特点相关名词：队尾：写入数据的一段队头：读取数据的一段空队：队列中没有数据，队头指针=队尾指针满队：队列中存满了数据，队尾指针+1=队头指针循环队列1、基本内容循环队列是以数组形式构成的队列数据结构。循环队列的结构体如下：typedefintdata_t;//队列数据类型#defineN64//队列容量typ
  • MongoDB知识概括 GeorgeLin98 持久层mongodb
    MongoDB知识概括MongoDB相关概念单机部署基本常用命令索引-IndexSpirngDataMongoDB集成副本集分片集群安全认证MongoDB相关概念业务应用场景：传统的关系型数据库（如MySQL），在数据操作的“三高”需求以及应对Web2.0的网站需求面前，显得力不从心。解释：“三高”需求：①Highperformance-对数据库高并发读写的需求。②HugeStorage-对海量数
  • ARMv8 Debug __pop_ ARMv8ARM64架构linux运维
    内容来自DEN0024A_v8_architecture_PG.pdf本质ARMv8Debug是什么历史在ARMv4开始被引入,并已发展成一系列广泛的调试(debug1)和跟踪(trace)功能ARMv6和ARMv7-a新增了自托管调试(debug2)和性能评测(trace-enhance)ARMv8处理器提供硬件功能侵入式:调试工具能够对核心活动提供显著级别的控制非侵入式:以非侵入性方式收集有关
  • 光盘文件系统 (iso9660) 格式解析 穷人小水滴 光盘文件系统iso9660denoGNU/Linuxjavascript
    越简单的系统,越可靠,越不容易出问题.光盘文件系统(iso9660)十分简单,只需不到200行代码,即可实现定位读取其中的文件.参考资料:https://wiki.osdev.org/ISO_9660相关文章:《光盘防水嘛?DVD+R刻录光盘泡水实验》https://blog.csdn.net/secext2022/article/details/140583910《光驱的内部结构及日常使用》ht
  • 科幻游戏 《外卖员模拟器》 主要地理环境设定 (1) 穷人小水滴 游戏科幻设计
    游戏名称:《外卖员模拟器》(英文名称:waimai_se)作者:穷人小水滴本故事纯属虚构,如有雷同实属巧合.故事发生在一个(架空)平行宇宙的地球,21世纪(超低空科幻流派).相关文章:https://blog.csdn.net/secext2022/article/details/141790630目录1星球整体地理设定2巨蛇国主要设定3海蛇市主要设定3.1主要地标建筑3.2交通3.3能源(电力)
  • 枚举的构造函数中抛出异常会怎样 bylijinnan javaenum单例
    首先从使用enum实现单例说起。 为什么要用enum来实现单例？ 这篇文章（ http://javarevisited.blogspot.sg/2012/07/why-enum-singleton-are-better-in-java.html）阐述了三个理由： 1.enum单例简单、容易，只需几行代码： public enum Singleton { INSTANCE;
  • CMake 教程 aigo C++
    转自：http://xiang.lf.blog.163.com/blog/static/127733322201481114456136/   CMake是一个跨平台的程序构建工具，比如起自己编写Makefile方便很多。 介绍：http://baike.baidu.com/view/1126160.htm 本文件不介绍CMake的基本语法，下面是篇不错的入门教程： http:
  • cvc-complex-type.2.3: Element 'beans' cannot have character Cb123456 springWebgis
      cvc-complex-type.2.3: Element 'beans' cannot have character     Line 33 in XML document from ServletContext resource [/WEB-INF/backend-servlet.xml] is i
  • jquery实例:随页面滚动条滚动而自动加载内容 120153216 jquery
    <script language="javascript"> $(function (){ var i = 4;$(window).bind("scroll", function (event){ //滚动条到网页头部的 高度，兼容ie,ff,chrome var top = document.documentElement.s
  • 将数据库中的数据转换成dbs文件 何必如此 sqldbs
    旗正规则引擎通过数据库配置器（DataBuilder）来管理数据库，无论是Oracle，还是其他主流的数据都支持，操作方式是一样的。旗正规则引擎的数据库配置器是用于编辑数据库结构信息以及管理数据库表数据，并且可以执行SQL 语句，主要功能如下。 1)数据库生成表结构信息：         主要生成数据库配置文件(.conf文
  • 在IBATIS中配置SQL语句的IN方式 357029540 ibatis
    在使用IBATIS进行SQL语句配置查询时，我们一定会遇到通过IN查询的地方，在使用IN查询时我们可以有两种方式进行配置参数：String和List。具体使用方式如下： 1.String:定义一个String的参数userIds，把这个参数传入IBATIS的sql配置文件，sql语句就可以这样写： <select id="getForms" param
  • Spring3 MVC 笔记（一） 7454103 springmvcbeanRESTJSF
             自从 MVC 这个概念提出来之后 struts1.X  struts2.X   jsf 。。。。。 这个view 层的技术一个接一个！ 都用过！不敢说哪个绝对的强悍！ 要看业务，和整体的设计！      最近公司要求开发个新系统！
  • Timer与Spring Quartz 定时执行程序 darkranger springbean工作quartz
    有时候需要定时触发某一项任务。其实在jdk1.3，java sdk就通过java.util.Timer提供相应的功能。一个简单的例子说明如何使用，很简单： 1、第一步，我们需要建立一项任务，我们的任务需要继承java.util.TimerTask package com.test; import java.text.SimpleDateFormat; import java.util.Date;
  • 大端小端转换，le32_to_cpu 和cpu_to_le32 aijuans C语言相关
    大端小端转换，le32_to_cpu 和cpu_to_le32  字节序 http://oss.org.cn/kernel-book/ldd3/ch11s04.html         小心不要假设字节序. PC 存储多字节值是低字节为先(小端为先, 因此是小端), 一些高级的平台以另一种方式(大端)
  • Nginx负载均衡配置实例详解 avords
    [导读] 负载均衡是我们大流量网站要做的一个东西，下面我来给大家介绍在Nginx服务器上进行负载均衡配置方法，希望对有需要的同学有所帮助哦。负载均衡先来简单了解一下什么是负载均衡，单从字面上的意思来理解就可以解 负载均衡是我们大流量网站要做的一个东西，下面我来给大家介绍在Nginx服务器上进行负载均衡配置方法，希望对有需要的同学有所帮助哦。 负载均衡 先来简单了解一下什么是负载均衡
  • 乱说的 houxinyou 框架敏捷开发软件测试
    从很久以前，大家就研究框架，开发方法，软件工程，好多！反正我是搞不明白！ 这两天看好多人研究敏捷模型，瀑布模型！也没太搞明白. 不过感觉和程序开发语言差不多， 瀑布就是顺序，敏捷就是循环. 瀑布就是需求、分析、设计、编码、测试一步一步走下来。而敏捷就是按摸块或者说迭代做个循环，第个循环中也一样是需求、分析、设计、编码、测试一步一步走下来。 也可以把软件开发理
  • 欣赏的价值——一个小故事 bijian1013 有效辅导欣赏欣赏的价值
    　　第一次参加家长会，幼儿园的老师说："您的儿子有多动症，在板凳上连三分钟都坐不了，你最好带他去医院看一看。"　　回家的路上，儿子问她老师都说了些什么，她鼻子一酸，差点流下泪来。因为全班30位小朋友，惟有他表现最差；惟有对他，老师表现出不屑，然而她还在告诉她的儿子："老师表扬你了，说宝宝原来在板凳上坐不了一分钟，现在能坐三分钟。其他妈妈都非常羡慕妈妈，因为全班只有宝宝
  • 包冲突问题的解决方法 bingyingao eclipsemavenexclusions包冲突
    包冲突是开发过程中很常见的问题： 其表现有： 1.明明在eclipse中能够索引到某个类，运行时却报出找不到类。 2.明明在eclipse中能够索引到某个类的方法，运行时却报出找不到方法。 3.类及方法都有，以正确编译成了.class文件，在本机跑的好好的，发到测试或者正式环境就 抛如下异常： java.lang.NoClassDefFoundError: Could not in
  • 【Spark七十五】Spark Streaming整合Flume-NG三之接入log4j bit1129 Stream
    先来一段废话： 实际工作中，业务系统的日志基本上是使用Log4j写入到日志文件中的，问题的关键之处在于业务日志的格式混乱，这给对日志文件中的日志进行统计分析带来了极大的困难，或者说，基本上无法进行分析，每个人写日志的习惯不同，导致日志行的格式五花八门，最后只能通过grep来查找特定的关键词缩小范围，但是在集群环境下，每个机器去grep一遍，分析一遍，这个效率如何可想之二，大好光阴都浪费在这上面了
  • sudoku solver in Haskell bookjovi sudokuhaskell
    这几天没太多的事做，想着用函数式语言来写点实用的程序，像fib和prime之类的就不想提了（就一行代码的事），写什么程序呢？在网上闲逛时发现sudoku游戏，sudoku十几年前就知道了，学生生涯时也想过用C/Java来实现个智能求解，但到最后往往没写成，主要是用C/Java写的话会很麻烦。   现在写程序，本人总是有一种思维惯性，总是想把程序写的更紧凑，更精致，代码行数最少，所以现
  • java apache ftpClient bro_feng java
    最近使用apache的ftpclient插件实现ftp下载，遇见几个问题，做如下总结。 1. 上传阻塞，一连串的上传，其中一个就阻塞了，或是用storeFile上传时返回false。查了点资料，说是FTP有主动模式和被动模式。将传出模式修改为被动模式ftp.enterLocalPassiveMode();然后就好了。 看了网上相关介绍，对主动模式和被动模式区别还是比较的模糊，不太了解被动模
  • 读《研磨设计模式》-代码笔记-工厂方法模式 bylijinnan java设计模式
    声明： 本文只为方便我个人查阅和理解，详细的分析以及源代码请移步 原作者的博客http://chjavach.iteye.com/ package design.pattern; /* * 工厂方法模式：使一个类的实例化延迟到子类 * 某次，我在工作不知不觉中就用到了工厂方法模式（称为模板方法模式更恰当。2012-10-29）： * 有很多不同的产品，它
  • 面试记录语 chenyu19891124 招聘
    或许真的在一个平台上成长成什么样，都必须靠自己去努力。有了好的平台让自己展示，就该好好努力。今天是自己单独一次去面试别人，感觉有点小紧张，说话有点打结。在面试完后写面试情况表，下笔真的好难，尤其是要对面试人的情况说明真的好难。 今天面试的是自己同事的同事，现在的这个同事要离职了，介绍了我现在这位同事以前的同事来面试。今天这位求职者面试的是配置管理，期初看了简历觉得应该很适合做配置管理，但是今天面
  • Fire Workflow 1.0正式版终于发布了 comsci 工作workflowGoogle
    Fire Workflow 是国内另外一款开源工作流，作者是著名的非也同志，哈哈.... 官方网站是 http://www.fireflow.org 经过大家努力,Fire Workflow 1.0正式版终于发布了 正式版主要变化: 1、增加IWorkItem.jumpToEx(...)方法，取消了当前环节和目标环节必须在同一条执行线的限制，使得自由流更加自由 2、增加IT
  • Python向脚本传参 daizj python脚本传参
    如果想对python脚本传参数，python中对应的argc, argv(c语言的命令行参数)是什么呢？ 需要模块：sys 参数个数：len(sys.argv) 脚本名：    sys.argv[0] 参数1：     sys.argv[1] 参数2：     sys.argv[
  • 管理用户分组的命令gpasswd dongwei_6688 passwd
    NAME： gpasswd - administer the /etc/group file SYNOPSIS： gpasswd group gpasswd -a user group gpasswd -d user group gpasswd -R group gpasswd -r group gpasswd [-A user,...] [-M user,...] g
  • 郝斌老师数据结构课程笔记 dcj3sjt126com 数据结构与算法
    <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
  • yii2 cgridview加上选择框进行操作 dcj3sjt126com GridView
    页面代码 <?=Html::beginForm(['controller/bulk'],'post');?> <?=Html::dropDownList('action','',[''=>'Mark selected as: ','c'=>'Confirmed','nc'=>'No Confirmed'],['class'=>'dropdown',])
  • linux mysql fypop linux
    enquiry mysql version in centos linux yum list installed | grep mysql yum -y remove mysql-libs.x86_64 enquiry mysql version in yum repositoryyum list | grep mysql oryum -y list mysql* install mysq
  • Scramble String hcx2013 String
    Given a string s1, we may represent it as a binary tree by partitioning it to two non-empty substrings recursively. Below is one possible representation of s1 = "great":
  • 跟我学Shiro目录贴 jinnianshilongnian 跟我学shiro
    历经三个月左右时间，《跟我学Shiro》系列教程已经完结，暂时没有需要补充的内容，因此生成PDF版供大家下载。最近项目比较紧，没有时间解答一些疑问，暂时无法回复一些问题，很抱歉，不过可以加群（334194438/348194195）一起讨论问题。     ----广告-----------------------------------------------------
  • nginx日志切割并使用flume-ng收集日志 liyonghui160com
         nginx的日志文件没有rotate功能。如果你不处理，日志文件将变得越来越大，还好我们可以写一个nginx日志切割脚本来自动切割日志文件。第一步就是重命名日志文件，不用担心重命名后nginx找不到日志文件而丢失日志。在你未重新打开原名字的日志文件前，nginx还是会向你重命名的文件写日志，linux是靠文件描述符而不是文件名定位文件。第二步向nginx主
  • Oracle死锁解决方法 pda158 oracle
    　select p.spid,c.object_name,b.session_id,b.oracle_username,b.os_user_name from v$process p,v$session a, v$locked_object b,all_objects c where p.addr=a.paddr and a.process=b.process and c.object_id=b.
  • java之List排序 shiguanghui list排序
       在Java Collection Framework中定义的List实现有Vector，ArrayList和LinkedList。这些集合提供了对对象组的索引访问。他们提供了元素的添加与删除支持。然而，它们并没有内置的元素排序支持。 　　你能够使用java.util.Collections类中的sort()方法对List元素进行排序。你既可以给方法传递
  • servlet单例多线程 utopialxw 单例多线程servlet
    转自http://www.cnblogs.com/yjhrem/articles/3160864.html 和   http://blog.chinaunix.net/uid-7374279-id-3687149.html Servlet 单例多线程 Servlet如何处理多个请求访问？Servlet容器默认是采用单实例多线程的方式处理多个请求的：1.当web服务器启动的
按字母分类： ABCDEFGHIJKLMNOPQRSTUVWXYZ其他