[oracle@racdb6 racdb6]$ tail -200 alertracdb6.log
2010-02-03 23:45:34.772
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.134 seconds
2010-02-03 23:45:35.774
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.134 seconds
2010-02-03 23:45:36.775
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.124 seconds
2010-02-03 23:45:37.768
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.134 seconds
2010-02-03 23:45:38.770
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.134 seconds
2010-02-03 23:45:39.162
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-03 23:46:10.680
[crsd(6952)]CRS-1005:The OCR upgrade was completed. Version has changed from 169870336 to 169870336. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/crsd/crsd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-03 23:46:22.278
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 00:03:42.937
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.184 seconds
2010-02-04 00:04:12.938
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.184 seconds
2010-02-04 00:04:30.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.184 seconds
2010-02-04 00:04:31.946
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.184 seconds
2010-02-04 00:04:32.947
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.174 seconds
2010-02-04 00:04:33.940
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.184 seconds
2010-02-04 00:04:34.942
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.184 seconds
2010-02-04 00:04:35.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.184 seconds
2010-02-04 00:04:36.946
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.184 seconds
2010-02-04 00:04:37.948
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.184 seconds
2010-02-04 00:04:38.949
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.174 seconds
2010-02-04 00:04:39.942
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.184 seconds
2010-02-04 00:04:40.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.184 seconds
2010-02-04 00:04:41.945
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.184 seconds
2010-02-04 00:04:42.389
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 00:05:18.040
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 02:04:21.033
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.068 seconds
2010-02-04 02:04:22.034
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 58.068 seconds
2010-02-04 02:04:51.042
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.068 seconds
2010-02-04 02:04:52.045
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 28.058 seconds
2010-02-04 02:05:09.048
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.058 seconds
2010-02-04 02:05:10.040
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.068 seconds
2010-02-04 02:05:11.043
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.068 seconds
2010-02-04 02:05:12.045
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.068 seconds
2010-02-04 02:05:13.047
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.068 seconds
2010-02-04 02:05:14.049
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.058 seconds
2010-02-04 02:05:15.041
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.068 seconds
2010-02-04 02:05:16.043
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.068 seconds
2010-02-04 02:05:17.044
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.068 seconds
2010-02-04 02:05:18.047
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.068 seconds
2010-02-04 02:05:19.049
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.058 seconds
2010-02-04 02:05:20.041
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.068 seconds
2010-02-04 02:05:20.623
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 02:05:56.341
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 09:07:37.090
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 10:27:49.888
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.024 seconds
2010-02-04 10:28:19.888
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.034 seconds
2010-02-04 10:28:37.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.034 seconds
2010-02-04 10:28:38.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.024 seconds
2010-02-04 10:28:39.888
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.034 seconds
2010-02-04 10:28:40.890
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.034 seconds
2010-02-04 10:28:41.892
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.034 seconds
2010-02-04 10:28:42.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.034 seconds
2010-02-04 10:28:43.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.024 seconds
2010-02-04 10:28:44.888
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.034 seconds
2010-02-04 10:28:45.890
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.034 seconds
2010-02-04 10:28:46.892
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.034 seconds
2010-02-04 10:28:47.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.034 seconds
2010-02-04 10:28:48.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.024 seconds
2010-02-04 10:28:49.179
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 10:29:24.957
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 12:03:52.294
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.140 seconds
2010-02-04 12:04:22.301
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.140 seconds
2010-02-04 12:04:40.306
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.130 seconds
2010-02-04 12:04:41.298
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.140 seconds
2010-02-04 12:04:42.300
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.140 seconds
2010-02-04 12:04:43.302
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.140 seconds
2010-02-04 12:04:44.303
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.140 seconds
2010-02-04 12:04:45.305
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.140 seconds
2010-02-04 12:04:46.307
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.130 seconds
2010-02-04 12:04:47.299
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.140 seconds
2010-02-04 12:04:48.301
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.140 seconds
2010-02-04 12:04:49.303
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.140 seconds
2010-02-04 12:04:50.305
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.140 seconds
2010-02-04 12:04:51.307
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.130 seconds
2010-02-04 12:04:51.440
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 12:05:31.000
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 13:11:51.686
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.222 seconds
2010-02-04 13:11:52.678
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.000 seconds
2010-02-04 13:12:21.684
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 30.000 seconds
2010-02-04 13:12:22.686
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.000 seconds
2010-02-04 13:12:39.689
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 12.000 seconds
2010-02-04 13:12:40.691
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.222 seconds
2010-02-04 13:12:41.683
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.000 seconds
2010-02-04 13:12:42.685
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.000 seconds
2010-02-04 13:12:43.687
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.000 seconds
2010-02-04 13:12:44.689
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.000 seconds
2010-02-04 13:12:45.691
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.222 seconds
2010-02-04 13:12:46.683
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.000 seconds
2010-02-04 13:12:47.684
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.000 seconds
2010-02-04 13:12:48.686
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.000 seconds
2010-02-04 13:12:49.688
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.000 seconds
2010-02-04 13:12:50.690
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.000 seconds
2010-02-04 13:12:51.693
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 13:13:27.413
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-03 23:45:34.772
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.134 seconds
2010-02-03 23:45:35.774
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.134 seconds
2010-02-03 23:45:36.775
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.124 seconds
2010-02-03 23:45:37.768
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.134 seconds
2010-02-03 23:45:38.770
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.134 seconds
2010-02-03 23:45:39.162
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-03 23:46:10.680
[crsd(6952)]CRS-1005:The OCR upgrade was completed. Version has changed from 169870336 to 169870336. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/crsd/crsd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-03 23:46:22.278
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 00:03:42.937
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.184 seconds
2010-02-04 00:04:12.938
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.184 seconds
2010-02-04 00:04:30.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.184 seconds
2010-02-04 00:04:31.946
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.184 seconds
2010-02-04 00:04:32.947
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.174 seconds
2010-02-04 00:04:33.940
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.184 seconds
2010-02-04 00:04:34.942
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.184 seconds
2010-02-04 00:04:35.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.184 seconds
2010-02-04 00:04:36.946
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.184 seconds
2010-02-04 00:04:37.948
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.184 seconds
2010-02-04 00:04:38.949
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.174 seconds
2010-02-04 00:04:39.942
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.184 seconds
2010-02-04 00:04:40.944
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.184 seconds
2010-02-04 00:04:41.945
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.184 seconds
2010-02-04 00:04:42.389
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 00:05:18.040
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 02:04:21.033
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.068 seconds
2010-02-04 02:04:22.034
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 58.068 seconds
2010-02-04 02:04:51.042
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.068 seconds
2010-02-04 02:04:52.045
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 28.058 seconds
2010-02-04 02:05:09.048
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.058 seconds
2010-02-04 02:05:10.040
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.068 seconds
2010-02-04 02:05:11.043
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.068 seconds
2010-02-04 02:05:12.045
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.068 seconds
2010-02-04 02:05:13.047
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.068 seconds
2010-02-04 02:05:14.049
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.058 seconds
2010-02-04 02:05:15.041
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.068 seconds
2010-02-04 02:05:16.043
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.068 seconds
2010-02-04 02:05:17.044
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.068 seconds
2010-02-04 02:05:18.047
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.068 seconds
2010-02-04 02:05:19.049
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.058 seconds
2010-02-04 02:05:20.041
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.068 seconds
2010-02-04 02:05:20.623
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 02:05:56.341
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 09:07:37.090
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 10:27:49.888
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.024 seconds
2010-02-04 10:28:19.888
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.034 seconds
2010-02-04 10:28:37.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.034 seconds
2010-02-04 10:28:38.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.024 seconds
2010-02-04 10:28:39.888
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.034 seconds
2010-02-04 10:28:40.890
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.034 seconds
2010-02-04 10:28:41.892
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.034 seconds
2010-02-04 10:28:42.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.034 seconds
2010-02-04 10:28:43.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.024 seconds
2010-02-04 10:28:44.888
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.034 seconds
2010-02-04 10:28:45.890
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.034 seconds
2010-02-04 10:28:46.892
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.034 seconds
2010-02-04 10:28:47.894
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.034 seconds
2010-02-04 10:28:48.896
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.024 seconds
2010-02-04 10:28:49.179
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 10:29:24.957
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 12:03:52.294
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.140 seconds
2010-02-04 12:04:22.301
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.140 seconds
2010-02-04 12:04:40.306
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 11.130 seconds
2010-02-04 12:04:41.298
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.140 seconds
2010-02-04 12:04:42.300
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.140 seconds
2010-02-04 12:04:43.302
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.140 seconds
2010-02-04 12:04:44.303
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.140 seconds
2010-02-04 12:04:45.305
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 6.140 seconds
2010-02-04 12:04:46.307
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.130 seconds
2010-02-04 12:04:47.299
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.140 seconds
2010-02-04 12:04:48.301
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.140 seconds
2010-02-04 12:04:49.303
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.140 seconds
2010-02-04 12:04:50.305
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.140 seconds
2010-02-04 12:04:51.307
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 0.130 seconds
2010-02-04 12:04:51.440
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .
2010-02-04 12:05:31.000
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
2010-02-04 13:11:51.686
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.222 seconds
2010-02-04 13:11:52.678
[cssd(7582)]CRS-1612:node racdb5 (1) at 50% heartbeat fatal, eviction in 59.000 seconds
2010-02-04 13:12:21.684
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 30.000 seconds
2010-02-04 13:12:22.686
[cssd(7582)]CRS-1611:node racdb5 (1) at 75% heartbeat fatal, eviction in 29.000 seconds
2010-02-04 13:12:39.689
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 12.000 seconds
2010-02-04 13:12:40.691
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.222 seconds
2010-02-04 13:12:41.683
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 10.000 seconds
2010-02-04 13:12:42.685
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 9.000 seconds
2010-02-04 13:12:43.687
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 8.000 seconds
2010-02-04 13:12:44.689
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 7.000 seconds
2010-02-04 13:12:45.691
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.222 seconds
2010-02-04 13:12:46.683
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 5.000 seconds
2010-02-04 13:12:47.684
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 4.000 seconds
2010-02-04 13:12:48.686
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 3.000 seconds
2010-02-04 13:12:49.688
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 2.000 seconds
2010-02-04 13:12:50.690
[cssd(7582)]CRS-1610:node racdb5 (1) at 90% heartbeat fatal, eviction in 1.000 seconds
2010-02-04 13:12:51.693
[cssd(7582)]CRS-1607:CSSD evicting node racdb5. Details in /llrac/app/oracle/product/10.2/crs/log/racdb6/cssd/ocssd.log.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb6 .
2010-02-04 13:13:27.413
[crsd(6952)]CRS-1204:Recovering CRS resources for node racdb5.
[cssd(7582)]CRS-1601:CSSD Reconfiguration complete. Active nodes are racdb5 racdb6 .