Last 2000 Lines of alertrac02.log File

Information Taken from /u01/crs/11.1.0/db_1/log/rac02/alertrac02.log

2011-03-24 16:13:38.469
[cssd(7862)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
[cssd(7862)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-24 16:13:40.635
[crsd(7368)]CRS-1012:The OCR service started on node rac02.
2011-03-24 16:13:40.637
[evmd(7303)]CRS-1401:EVMD started on node rac02.
2011-03-24 16:13:41.841
[crsd(7368)]CRS-1201:CRSD started on node rac02.
[cssd(7862)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-03-24 16:48:36.907
[cssd(7335)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-24 16:48:38.378
[cssd(7335)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-24 16:48:39.005
[crsd(6731)]CRS-1012:The OCR service started on node rac02.
2011-03-24 16:48:40.011
[evmd(6582)]CRS-1401:EVMD started on node rac02.
2011-03-24 16:48:40.844
[crsd(6731)]CRS-1201:CRSD started on node rac02.
2011-03-24 16:49:07.674
[client(7809)]CRS-1804:Node rac02 upgraded to version 11.1.0.7.0.
2011-03-24 16:49:10.336
[cssd(7335)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-03-24 16:49:44.158
[cssd(9953)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-24 16:49:46.440
[cssd(9953)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-24 16:49:46.862
[crsd(9329)]CRS-1012:The OCR service started on node rac02.
2011-03-24 16:49:47.711
[evmd(9283)]CRS-1401:EVMD started on node rac02.
2011-03-24 16:49:48.547
[crsd(9329)]CRS-1201:CRSD started on node rac02.
2011-03-24 16:49:49.085
[crsd(9329)]CRS-1205:Auto-start failed for the CRS resource . Details in rac02.
2011-03-24 16:49:49.830
[crsd(9329)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599488 to 185599488. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-03-24 16:49:51.781
[cssd(9953)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-03-24 16:49:58.803
[crsd(9329)]CRS-1204:Recovering CRS resources for node rac01.
2011-03-24 16:51:03.811
[cssd(9953)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-24 16:51:04.297
[crsd(9329)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599488 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-03-24 16:57:33.875
[cssd(9953)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-03-24 16:57:37.288
[crsd(9329)]CRS-1204:Recovering CRS resources for node rac01.
2011-03-24 17:05:50.989
[cssd(9953)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-24 17:06:55.832
[cssd(9953)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-03-24 17:17:13.993
[cssd(6470)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-24 17:17:23.368
[cssd(6470)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-03-24 17:17:23.972
[crsd(5501)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-03-24 17:17:23.973
[crsd(5501)]CRS-1012:The OCR service started on node rac02.
2011-03-24 17:17:24.731
[evmd(5376)]CRS-1401:EVMD started on node rac02.
2011-03-24 17:17:25.473
[crsd(5501)]CRS-1201:CRSD started on node rac02.
2011-03-24 17:17:29.051
[crsd(5501)]CRS-1205:Auto-start failed for the CRS resource ora.rac01.gsd. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-03-24 17:17:29.099
[crsd(5501)]CRS-1205:Auto-start failed for the CRS resource ora.rac01.ons. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-03-24 17:22:37.831
[cssd(6470)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-25 08:49:08.333
[cssd(6470)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 14.790 seconds
2011-03-25 08:49:09.333
[cssd(6470)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 13.790 seconds
2011-03-25 08:49:16.334
[cssd(6470)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 6.790 seconds
2011-03-25 08:49:20.335
[cssd(6470)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 2.790 seconds
2011-03-25 08:49:21.335
[cssd(6470)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 1.790 seconds
2011-03-25 08:49:22.335
[cssd(6470)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 0.790 seconds
2011-03-25 08:49:23.126
[cssd(6470)]CRS-1607:CSSD evicting node rac01. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-25 08:49:24.145
[cssd(6470)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-03-25 08:49:27.670
[crsd(5501)]CRS-1204:Recovering CRS resources for node rac01.
2011-03-25 09:14:53.479
[cssd(6470)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-26 18:44:01.556
[cssd(8257)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-26 18:44:02.374
[cssd(8257)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-26 18:44:03.042
[crsd(7371)]CRS-1012:The OCR service started on node rac02.
2011-03-26 18:44:03.624
[evmd(7370)]CRS-1401:EVMD started on node rac02.
2011-03-26 18:44:04.563
[crsd(7371)]CRS-1201:CRSD started on node rac02.
2011-03-28 00:52:34.252
[cssd(8245)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-03-28 00:52:35.472
[cssd(8245)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-03-28 00:52:35.823
[crsd(7365)]CRS-1012:The OCR service started on node rac02.
2011-03-28 00:52:36.753
[evmd(7363)]CRS-1401:EVMD started on node rac02.
2011-03-28 00:52:37.685
[crsd(7365)]CRS-1201:CRSD started on node rac02.
2011-04-03 13:40:25.211
[cssd(8244)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-03 13:40:26.293
[cssd(8244)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-03 13:40:26.657
[crsd(7362)]CRS-1012:The OCR service started on node rac02.
2011-04-03 13:40:27.586
[evmd(7363)]CRS-1401:EVMD started on node rac02.
2011-04-03 13:40:28.645
[crsd(7362)]CRS-1201:CRSD started on node rac02.
2011-04-05 05:33:23.805
[cssd(8249)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-05 05:33:25.004
[cssd(8249)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-05 05:33:25.930
[crsd(7384)]CRS-1012:The OCR service started on node rac02.
2011-04-05 05:33:26.587
[evmd(7357)]CRS-1401:EVMD started on node rac02.
2011-04-05 05:33:27.648
[crsd(7384)]CRS-1201:CRSD started on node rac02.
2011-04-08 16:03:03.919
[cssd(8249)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 14.570 seconds
2011-04-08 16:03:04.919
[cssd(8249)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 13.570 seconds
2011-04-08 16:03:11.920
[cssd(8249)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 6.570 seconds
2011-04-08 16:03:15.920
[cssd(8249)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 2.570 seconds
2011-04-08 16:03:16.920
[cssd(8249)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 1.570 seconds
2011-04-08 16:03:17.921
[cssd(8249)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 0.570 seconds
2011-04-08 16:03:18.491
[cssd(8249)]CRS-1607:CSSD evicting node rac01. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-08 16:03:19.494
[cssd(8249)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-08 16:03:19.783
[crsd(7384)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-08 16:03:23.363
[crsd(7384)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-08 16:07:00.564
[cssd(8249)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-09 02:26:39.067
[cssd(8236)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-09 02:26:40.007
[cssd(8236)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-09 02:26:40.546
[crsd(7376)]CRS-1012:The OCR service started on node rac02.
2011-04-09 02:26:40.567
[evmd(7349)]CRS-1401:EVMD started on node rac02.
2011-04-09 02:26:42.388
[crsd(7376)]CRS-1201:CRSD started on node rac02.
2011-04-10 19:48:37.877
[cssd(8304)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-10 19:48:38.792
[cssd(8304)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-10 19:48:39.195
[crsd(7426)]CRS-1012:The OCR service started on node rac02.
2011-04-10 19:48:40.020
[evmd(7418)]CRS-1401:EVMD started on node rac02.
2011-04-10 19:48:41.047
[crsd(7426)]CRS-1201:CRSD started on node rac02.
2011-04-14 09:36:46.898
[crsd(7426)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-14 09:36:51.827
[cssd(8304)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-14 09:36:56.652
[crsd(7426)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-14 09:59:32.093
[cssd(8304)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 10:13:18.966
[cssd(8304)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-14 10:13:22.449
[crsd(7426)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-14 10:13:53.989
[cssd(8304)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 10:34:04.785
[cssd(8304)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-14 10:43:13.264
[cssd(21505)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-14 10:43:14.832
[cssd(21505)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 10:43:15.346
[crsd(20644)]CRS-1012:The OCR service started on node rac02.
2011-04-14 10:43:16.205
[evmd(20544)]CRS-1401:EVMD started on node rac02.
2011-04-14 10:43:17.263
[crsd(20644)]CRS-1201:CRSD started on node rac02.
2011-04-14 10:54:14.048
[crsd(20644)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-14 11:07:40.828
[cssd(21505)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 14.440 seconds
2011-04-14 11:07:47.829
[cssd(21505)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 7.440 seconds
2011-04-14 11:07:48.829
[cssd(21505)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 6.440 seconds
2011-04-14 11:07:52.830
[cssd(21505)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 2.440 seconds
2011-04-14 11:07:53.830
[cssd(21505)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 1.440 seconds
2011-04-14 11:07:54.831
[cssd(21505)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 0.440 seconds
2011-04-14 11:07:55.271
[cssd(21505)]CRS-1607:CSSD evicting node rac01. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-14 11:07:56.274
[cssd(21505)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-14 11:09:06.680
[crsd(20644)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-14 11:11:40.334
[cssd(21505)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 12:00:17.034
[evmd(1237)]CRS-1401:EVMD started on node rac02.
2011-04-14 12:33:39.927
[cssd(21505)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-14 12:38:45.084
[cssd(8128)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-14 12:38:45.853
[cssd(8128)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 12:38:46.433
[crsd(7236)]CRS-1012:The OCR service started on node rac02.
2011-04-14 12:38:46.450
[evmd(7235)]CRS-1401:EVMD started on node rac02.
2011-04-14 12:38:48.545
[crsd(7236)]CRS-1201:CRSD started on node rac02.
2011-04-14 12:46:48.302
[crsd(7236)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-14 12:46:49.788
[cssd(8128)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-14 12:47:16.186
[crsd(7236)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-14 12:51:47.848
[cssd(8128)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 16:06:54.411
[cssd(8128)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-14 16:08:29.465
[cssd(9145)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-14 16:08:30.582
[cssd(9145)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-14 16:08:30.960
[crsd(8254)]CRS-1012:The OCR service started on node rac02.
2011-04-14 16:08:31.817
[evmd(8255)]CRS-1401:EVMD started on node rac02.
2011-04-14 16:08:32.853
[crsd(8254)]CRS-1201:CRSD started on node rac02.
2011-04-19 10:57:22.004
[cssd(9145)]CRS-1612:node rac01 (1) at 50% heartbeat fatal, eviction in 14.090 seconds
2011-04-19 10:57:29.005
[cssd(9145)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 7.090 seconds
2011-04-19 10:57:30.005
[cssd(9145)]CRS-1611:node rac01 (1) at 75% heartbeat fatal, eviction in 6.090 seconds
2011-04-19 10:57:34.006
[cssd(9145)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 2.090 seconds
2011-04-19 10:57:35.006
[cssd(9145)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 1.090 seconds
2011-04-19 10:57:36.006
[cssd(9145)]CRS-1610:node rac01 (1) at 90% heartbeat fatal, eviction in 0.090 seconds
2011-04-19 10:57:36.097
[cssd(9145)]CRS-1607:CSSD evicting node rac01. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-19 10:57:37.099
[cssd(9145)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-19 10:57:37.332
[crsd(8254)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-19 10:58:21.810
[crsd(8254)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-19 11:11:03.268
[cssd(9145)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 12:47:26.593
[cssd(9145)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-19 12:48:01.308
[cssd(6643)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-19 12:48:02.148
[cssd(6643)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 12:48:02.539
[crsd(5624)]CRS-1012:The OCR service started on node rac02.
2011-04-19 12:48:03.442
[evmd(5626)]CRS-1401:EVMD started on node rac02.
2011-04-19 12:48:04.477
[crsd(5624)]CRS-1201:CRSD started on node rac02.
2011-04-19 12:51:39.075
[cssd(6643)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-19 12:56:44.384
[cssd(8198)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-19 12:56:46.149
[cssd(8198)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 12:56:46.690
[crsd(7312)]CRS-1012:The OCR service started on node rac02.
2011-04-19 12:56:47.531
[evmd(7318)]CRS-1401:EVMD started on node rac02.
2011-04-19 12:56:48.559
[crsd(7312)]CRS-1201:CRSD started on node rac02.
2011-04-19 12:59:20.812
[crsd(7312)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-19 12:59:21.979
[cssd(8198)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-19 12:59:25.573
[crsd(7312)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-19 12:59:57.000
[cssd(8198)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 13:13:37.904
[cssd(8198)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-19 13:13:41.340
[crsd(7312)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-19 13:18:05.974
[cssd(8198)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 13:22:04.489
[cssd(8198)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-19 13:23:09.208
[cssd(10687)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-19 13:23:10.650
[cssd(10687)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-19 13:23:11.177
[crsd(9796)]CRS-1012:The OCR service started on node rac02.
2011-04-19 13:23:11.929
[evmd(9802)]CRS-1401:EVMD started on node rac02.
2011-04-19 13:23:13.520
[crsd(9796)]CRS-1201:CRSD started on node rac02.
2011-04-19 14:12:45.718
[crsd(9796)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-19 14:12:47.411
[cssd(10687)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-19 14:13:08.331
[crsd(9796)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-19 14:17:56.489
[cssd(10687)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-26 15:16:46.329
[cssd(8221)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-26 15:16:47.562
[cssd(8221)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-26 15:16:47.865
[crsd(7338)]CRS-1012:The OCR service started on node rac02.
2011-04-26 15:16:48.781
[evmd(7341)]CRS-1401:EVMD started on node rac02.
2011-04-26 15:16:49.989
[crsd(7338)]CRS-1201:CRSD started on node rac02.
2011-04-27 05:12:34.483
[cssd(8259)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-27 05:12:35.708
[cssd(8259)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-27 05:12:36.108
[crsd(7370)]CRS-1012:The OCR service started on node rac02.
2011-04-27 05:12:37.173
[evmd(7377)]CRS-1401:EVMD started on node rac02.
2011-04-27 05:12:38.802
[crsd(7370)]CRS-1201:CRSD started on node rac02.
2011-04-27 09:09:39.983
[cssd(8161)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-27 09:09:41.416
[cssd(8161)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-27 09:09:41.939
[crsd(7273)]CRS-1012:The OCR service started on node rac02.
2011-04-27 09:09:42.690
[evmd(7278)]CRS-1401:EVMD started on node rac02.
2011-04-27 09:09:44.125
[crsd(7273)]CRS-1201:CRSD started on node rac02.
2011-04-27 11:11:30.246
[crsd(7273)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-27 11:11:41.008
[cssd(8161)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-27 11:11:46.172
[crsd(7273)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-27 11:14:08.053
[cssd(8161)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-27 11:19:30.752
[cssd(8161)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-27 11:19:35.806
[crsd(7273)]CRS-1204:Recovering CRS resources for node rac01.
2011-04-27 11:21:16.499
[cssd(8161)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-27 11:21:51.649
[cssd(18866)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-27 11:22:00.925
[cssd(18866)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-04-27 11:22:01.454
[crsd(17961)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-27 11:22:01.455
[crsd(17961)]CRS-1012:The OCR service started on node rac02.
2011-04-27 11:22:02.230
[evmd(17823)]CRS-1401:EVMD started on node rac02.
2011-04-27 11:22:03.248
[crsd(17961)]CRS-1201:CRSD started on node rac02.
2011-04-27 11:22:07.514
[crsd(17961)]CRS-1205:Auto-start failed for the CRS resource ora.rac01.ons. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-27 11:22:07.538
[crsd(17961)]CRS-1205:Auto-start failed for the CRS resource ora.rac01.gsd. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-27 11:22:11.347
[crsd(17961)]CRS-1205:Auto-start failed for the CRS resource ora.rac01.LISTENER_RAC01.lsnr. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-04-27 11:24:32.909
[cssd(18866)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-27 11:29:19.882
[cssd(8185)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-27 11:29:20.851
[cssd(8185)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-27 11:29:21.283
[crsd(7297)]CRS-1012:The OCR service started on node rac02.
2011-04-27 11:29:21.309
[evmd(7301)]CRS-1401:EVMD started on node rac02.
2011-04-27 11:29:22.445
[crsd(7297)]CRS-1201:CRSD started on node rac02.
2011-04-29 03:10:04.037
[cssd(8185)]CRS-1603:CSSD on node rac02 shutdown by user.
2011-04-29 03:40:23.874
[cssd(11073)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-04-29 03:40:24.966
[cssd(11073)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-04-29 03:40:25.468
[crsd(10183)]CRS-1012:The OCR service started on node rac02.
2011-04-29 03:40:25.492
[evmd(10182)]CRS-1401:EVMD started on node rac02.
2011-04-29 03:40:26.950
[crsd(10183)]CRS-1201:CRSD started on node rac02.
2011-05-04 20:59:57.612
[crsd(10183)]CRS-1005:The OCR upgrade was completed. Version has changed from 185599744 to 185599744. Details in /u01/crs/11.1.0/db_1/log/rac02/crsd/crsd.log.
2011-05-04 21:00:07.079
[cssd(11073)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac02 .
2011-05-04 21:00:34.147
[cssd(11073)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-05-04 21:00:50.385
[crsd(10183)]CRS-1204:Recovering CRS resources for node rac01.
2011-05-04 23:35:17.250
[cssd(11266)]CRS-1605:CSSD voting file is online: /dev/mpath/mpath0p2. Details in /u01/crs/11.1.0/db_1/log/rac02/cssd/ocssd.log.
2011-05-04 23:35:18.595
[cssd(11266)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rac01 rac02 .
2011-05-04 23:35:19.088
[crsd(10381)]CRS-1012:The OCR service started on node rac02.
2011-05-04 23:35:19.122
[evmd(10383)]CRS-1401:EVMD started on node rac02.
2011-05-04 23:35:21.221
[crsd(10381)]CRS-1201:CRSD started on node rac02.